-- Logs begin at Wed 2022-08-10 09:22:23 UTC, end at Wed 2022-08-10 10:19:04 UTC. -- Aug 10 09:49:18.858445 dv-cinder-850836-5-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 10 09:49:18.867197 dv-cinder-850836-5-smb devstack@keystone.service[80219]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 10 09:49:18.869231 dv-cinder-850836-5-smb devstack@keystone.service[80219]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 10 09:49:18 2022] *** Aug 10 09:49:18.869231 dv-cinder-850836-5-smb devstack@keystone.service[80219]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 10 09:49:18.869231 dv-cinder-850836-5-smb devstack@keystone.service[80219]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 10 09:49:18.869231 dv-cinder-850836-5-smb devstack@keystone.service[80219]: nodename: dv-cinder-850836-5-smb Aug 10 09:49:18.869231 dv-cinder-850836-5-smb devstack@keystone.service[80219]: machine: x86_64 Aug 10 09:49:18.869231 dv-cinder-850836-5-smb devstack@keystone.service[80219]: clock source: unix Aug 10 09:49:18.869231 dv-cinder-850836-5-smb devstack@keystone.service[80219]: pcre jit disabled Aug 10 09:49:18.869231 dv-cinder-850836-5-smb devstack@keystone.service[80219]: detected number of CPU cores: 4 Aug 10 09:49:18.869231 dv-cinder-850836-5-smb devstack@keystone.service[80219]: current working directory: / Aug 10 09:49:18.869231 dv-cinder-850836-5-smb devstack@keystone.service[80219]: detected binary path: /usr/bin/uwsgi-core Aug 10 09:49:18.869856 dv-cinder-850836-5-smb devstack@keystone.service[80219]: your processes number limit is 47680 Aug 10 09:49:18.869856 dv-cinder-850836-5-smb devstack@keystone.service[80219]: your memory page size is 4096 bytes Aug 10 09:49:18.869856 dv-cinder-850836-5-smb devstack@keystone.service[80219]: detected max file descriptor number: 2048 Aug 10 09:49:18.869856 dv-cinder-850836-5-smb devstack@keystone.service[80219]: lock engine: pthread robust mutexes Aug 10 09:49:18.869856 dv-cinder-850836-5-smb devstack@keystone.service[80219]: thunder lock: enabled Aug 10 09:49:18.869856 dv-cinder-850836-5-smb devstack@keystone.service[80219]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 10 09:49:18.869856 dv-cinder-850836-5-smb devstack@keystone.service[80219]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 10 09:49:18.908123 dv-cinder-850836-5-smb devstack@keystone.service[80219]: Python main interpreter initialized at 0x55afb6ded9c0 Aug 10 09:49:18.908123 dv-cinder-850836-5-smb devstack@keystone.service[80219]: python threads support enabled Aug 10 09:49:18.908123 dv-cinder-850836-5-smb devstack@keystone.service[80219]: your server socket listen backlog is limited to 100 connections Aug 10 09:49:18.908123 dv-cinder-850836-5-smb devstack@keystone.service[80219]: your mercy for graceful operations on workers is 90 seconds Aug 10 09:49:18.908489 dv-cinder-850836-5-smb devstack@keystone.service[80219]: mapped 403077 bytes (393 KB) for 2 cores Aug 10 09:49:18.908489 dv-cinder-850836-5-smb devstack@keystone.service[80219]: *** Operational MODE: preforking *** Aug 10 09:49:18.908795 dv-cinder-850836-5-smb devstack@keystone.service[80219]: *** uWSGI is running in multiple interpreter mode *** Aug 10 09:49:18.908795 dv-cinder-850836-5-smb devstack@keystone.service[80219]: spawned uWSGI master process (pid: 80219) Aug 10 09:49:18.909000 dv-cinder-850836-5-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 10 09:49:18.910230 dv-cinder-850836-5-smb devstack@keystone.service[80219]: spawned uWSGI worker 1 (pid: 80231, cores: 1) Aug 10 09:49:18.910230 dv-cinder-850836-5-smb devstack@keystone.service[80219]: spawned uWSGI worker 2 (pid: 80232, cores: 1) Aug 10 09:49:18.910230 dv-cinder-850836-5-smb devstack@keystone.service[80219]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 10 09:49:24.336830 dv-cinder-850836-5-smb devstack@keystone.service[80231]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 09:49:24.336830 dv-cinder-850836-5-smb devstack@keystone.service[80231]: from cryptography.utils import int_from_bytes Aug 10 09:49:24.337666 dv-cinder-850836-5-smb devstack@keystone.service[80232]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 09:49:24.337666 dv-cinder-850836-5-smb devstack@keystone.service[80232]: from cryptography.utils import int_from_bytes Aug 10 09:49:24.337666 dv-cinder-850836-5-smb devstack@keystone.service[80232]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 09:49:24.337666 dv-cinder-850836-5-smb devstack@keystone.service[80232]: from cryptography.utils import int_from_bytes Aug 10 09:49:24.338177 dv-cinder-850836-5-smb devstack@keystone.service[80231]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 09:49:24.338177 dv-cinder-850836-5-smb devstack@keystone.service[80231]: from cryptography.utils import int_from_bytes Aug 10 09:49:24.385973 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 10 09:49:24.386146 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 10 09:49:24.386146 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 10 09:49:24.386312 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 10 09:49:24.386375 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] command line args: [] {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 10 09:49:24.386439 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] command line args: [] {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 10 09:49:24.386582 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 10 09:49:24.386670 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 10 09:49:24.386731 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] ================================================================================ {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 10 09:49:24.386793 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ================================================================================ {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 10 09:49:24.386991 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] admin_token = **** {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:49:24.387123 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] admin_token = **** {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:49:24.387203 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] config_dir = [] {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:49:24.387277 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] config_dir = [] {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:49:24.387410 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:49:24.387490 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:49:24.387550 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] config_source = [] {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:49:24.387607 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] config_source = [] {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:49:24.387738 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] debug = True {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:49:24.387826 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] debug = True {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:49:24.387894 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:49:24.388576 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:49:24.388576 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:49:24.388733 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:49:24.388792 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:49:24.388849 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:49:24.388905 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:49:24.388966 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:49:24.389031 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:49:24.389277 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:49:24.389433 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] list_limit = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:49:24.389529 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] list_limit = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:49:24.389623 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] log_config_append = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:49:24.389722 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] log_config_append = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:49:24.389828 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:49:24.390034 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:49:24.390143 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] log_dir = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:49:24.390237 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] log_dir = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:49:24.390355 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] log_file = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:49:24.390465 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] log_file = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:49:24.390588 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:49:24.390663 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:49:24.390727 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:49:24.390846 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:49:24.390920 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:49:24.390980 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:49:24.391092 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:49:24.391214 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:49:24.391336 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:49:24.391419 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:49:24.391484 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:49:24.391598 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:49:24.391716 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:49:24.391801 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:49:24.391919 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:49:24.391994 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:49:24.392118 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:49:24.392203 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:49:24.392316 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:49:24.392395 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:49:24.392507 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:49:24.392587 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:49:24.392700 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:49:24.392782 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:49:24.392902 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:49:24.392998 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:49:24.393088 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:49:24.393217 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:49:24.393298 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:49:24.393377 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:49:24.393621 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.27/identity {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:49:24.393745 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.27/identity {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:49:24.393842 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] publish_errors = False {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:49:24.393916 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] publish_errors = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:49:24.394048 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:49:24.394131 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:49:24.394204 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:49:24.394282 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:49:24.394353 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:49:24.394417 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:49:24.394601 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:49:24.394771 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:49:24.394856 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:49:24.394936 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:49:24.395057 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] standard_threads = False {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:49:24.395143 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] standard_threads = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:49:24.395299 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:49:24.395435 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:49:24.395517 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:49:24.395590 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:49:24.395711 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:49:24.395796 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:49:24.395866 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] use_journal = False {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:49:24.395946 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] use_journal = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:49:24.396016 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] use_json = False {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:49:24.396087 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] use_json = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:49:24.396224 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] use_stderr = False {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:49:24.396346 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] use_stderr = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:49:24.396346 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] use_syslog = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:49:24.396509 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] use_syslog = False {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:49:24.396587 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:49:24.396658 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 09:49:24.396847 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.396969 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.397047 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.397168 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.397354 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.397495 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.397574 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.397644 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.397821 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.397960 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.398040 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.398110 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.398290 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.398413 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.398502 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.398585 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.398760 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.398892 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.398970 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.399131 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.399253 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.399457 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.399578 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.399731 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.399861 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.399941 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.400012 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.400200 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.400322 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.400410 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.400617 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.400749 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.400896 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.401099 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.401188 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.401262 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.401407 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.401489 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.401644 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.401797 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.401878 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.402115 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.402196 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.402376 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.402455 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.402622 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.402758 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.402845 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.403082 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.403169 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.403348 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.403437 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.403613 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.403755 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.403916 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.404031 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.404209 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.404332 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.404496 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.404632 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.404785 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.404936 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.405120 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.405291 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.405428 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.405614 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.405720 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.405849 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.406035 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.406113 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.406318 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.406394 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.406569 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.406679 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.406809 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.406889 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.407060 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.407176 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.407288 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.407425 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.407623 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.407740 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.407850 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.407960 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.408069 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.408185 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.408305 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.408417 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.408559 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.408673 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.408824 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.408937 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.409060 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.409190 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.409301 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.409411 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.409532 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.409693 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.409816 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.409969 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.410083 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.410196 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.410313 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.410430 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.410550 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.410661 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.410831 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.410945 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.411103 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.411249 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.411359 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.411455 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.411557 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.411674 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.411776 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.411963 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.412083 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.412227 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.412330 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.412452 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.412564 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.412685 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.412799 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.412919 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.413128 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.413263 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.413377 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.413501 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.413614 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.413726 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.413845 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.413997 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.414113 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.414275 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.414391 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.414525 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.414651 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.414871 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.414989 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.415108 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.415221 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.415345 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.415493 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.415609 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.415719 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.415830 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.415941 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.416093 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.416210 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.416386 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.416500 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.416630 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.416755 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.416877 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.416990 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.417117 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.417284 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.417400 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.417549 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.417672 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.417785 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.417897 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.418029 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.418145 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.418256 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.418421 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.418538 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.418712 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.418826 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.418938 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.419048 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.419167 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.419280 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.419401 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.419555 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.419670 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.419828 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.420020 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.420136 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.420247 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.420358 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.420469 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.420579 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.420698 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.420818 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.420942 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.421056 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.421213 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.421324 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.421436 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.421585 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.421717 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.421879 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.421994 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.422135 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.422255 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.422368 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.422488 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.422601 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] auth.external = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.422713 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.422824 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.422989 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.423148 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.423274 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.423388 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.423532 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] auth.password = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.423647 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.423758 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] auth.token = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.423881 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.424000 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.424157 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.424273 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.424437 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.424580 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.424702 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.424879 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.425007 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.425144 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.425276 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.425390 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.425531 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.425656 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] credential.caching = True {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.425779 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] auth.external = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.425899 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.426012 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.426124 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.426279 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.426405 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.426526 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.426639 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.426753 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] auth.password = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.426863 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.426976 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] auth.token = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.427088 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.427212 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.427334 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.427448 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.427560 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.427672 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.427784 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.427904 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.428018 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.428130 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.428286 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.428403 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.428507 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.428610 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.428723 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.428836 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] credential.caching = True {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.428947 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.429060 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.429194 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.429319 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.429434 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] federation.caching = True {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.429547 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.429659 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.429771 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.429883 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.430007 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.430121 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.430243 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.430357 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.430532 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.430645 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.430770 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.430891 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.431004 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.431117 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.431230 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.431342 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.431466 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.431582 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.431694 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.431806 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.431918 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.432031 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.432151 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] identity.caching = True {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.432265 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.432378 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.432498 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.432613 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.432726 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] federation.caching = True {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.432851 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.432972 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.433119 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.433236 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.433349 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.433462 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.433587 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.433702 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.433815 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.433928 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.434041 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.434244 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.434360 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.434473 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.434586 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.434699 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.434811 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.434932 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.435046 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.435159 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.435270 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.435382 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.435494 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.435615 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] identity.caching = True {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.435730 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.435843 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.435955 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.436071 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.436183 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.436304 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.436417 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.436530 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.436643 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.436756 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.436869 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.436989 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.437118 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.437233 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.437350 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.437462 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.437574 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.437767 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.437958 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.438072 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.438184 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.438297 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.438416 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.438537 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.438651 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.438763 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.438877 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.438989 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.439101 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.439221 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.439334 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.439447 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.439567 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.439682 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.439794 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.439916 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.440030 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.440142 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.440260 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.440405 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.440520 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.440667 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.440782 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.440895 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.441009 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.441183 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.441365 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.441496 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.441611 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.441723 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.441842 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.441955 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.442068 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.442190 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.442304 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.442417 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.442528 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.442640 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.442752 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.442873 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.442986 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.443100 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.443212 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.443324 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.443436 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.443558 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.443671 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.443783 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.443896 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.444009 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.444122 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.444242 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.444357 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] ldap.user = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.444470 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.444582 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.444695 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.444807 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.444927 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.445041 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.445532 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.445646 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.445759 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.445870 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.445995 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.446109 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.446229 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.446343 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.446456 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.446576 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.446691 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.446803 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.446916 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.447028 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.447140 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.447266 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.447381 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.447498 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.447613 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.447725 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.447836 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.447956 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.448070 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.user = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.448183 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.448296 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.448408 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.448511 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.448614 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.448711 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.448823 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.448936 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.449047 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.449225 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.449351 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.449466 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.449580 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.449693 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.449804 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.449916 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.450037 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.450151 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.450264 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.450377 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.450490 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.450603 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.450723 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.450843 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.450957 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.451076 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.451189 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.451301 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.451423 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.451537 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.451649 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.451762 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.451875 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.451987 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.452107 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.452221 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.452335 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.452447 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.452560 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.452673 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.452794 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.452909 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.453022 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.453154 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.453267 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] resource.caching = True {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.453380 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.453503 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.453619 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.453731 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.453844 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.453956 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.454068 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.454188 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.454302 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.454415 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.454528 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.454641 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.454754 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.454875 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.454989 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.455102 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.455221 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.455335 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.455448 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.455569 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] role.caching = True {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.455686 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.455798 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] role.driver = sql {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.455910 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.456023 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.456135 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.456256 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.456370 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.456483 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.456596 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] resource.caching = True {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.456709 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.456821 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.457014 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.457158 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.457276 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.457390 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.457502 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.457614 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.457740 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.457855 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.457968 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.458080 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.458192 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.458305 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.458426 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.458540 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.458652 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.458766 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.458878 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.458998 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] role.caching = True {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.459112 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.459225 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] role.driver = sql {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.459225 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.459434 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.459546 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.459671 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.459786 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.459900 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.460013 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.460125 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.460237 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.460357 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.460472 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.460584 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.460697 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.460809 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.460928 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.461049 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.461183 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.461296 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.461409 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.461521 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.461633 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.461793 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.461909 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.462022 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.462134 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.462248 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.462361 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.462481 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.462595 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.462707 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.462819 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.462931 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.463044 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.463165 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.463279 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.463391 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.463391 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.463600 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.463712 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] token.caching = True {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.463832 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.463946 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.464060 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.464172 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.464286 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.464406 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.464520 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.464632 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.464744 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.464856 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.464968 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.465136 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.465253 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.465366 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.465478 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.465589 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.465707 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.465828 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.465942 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.466054 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.466168 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.466280 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.466391 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.466511 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.466625 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.466737 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.466849 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.466960 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.467073 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] token.caching = True {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.467193 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.467310 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.467416 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.467527 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.467639 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.467750 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.467870 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] database.connection = **** {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.467996 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.468122 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.468236 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.468348 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.468466 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.468579 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.468690 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.468810 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.468924 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.469036 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.469164 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.469277 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.469390 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.469513 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.469628 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.469739 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.469851 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.469962 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.470074 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.470193 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.470308 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.470419 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.470531 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.470643 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.470755 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.470875 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.470989 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.471100 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.471212 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] database.connection = **** {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.471333 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.471455 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.471569 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.471690 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.471803 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.471915 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.472027 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.472027 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 10 09:49:24.472236 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.472236 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.472236 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.472236 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.472649 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.472649 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.472857 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.473122 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.473351 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.473597 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.473832 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.474074 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.474304 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.474544 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.474778 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 09:49:24.474946 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 10 09:49:24.500958 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80232) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 09:49:24.501224 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80232) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 09:49:24.501455 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80232) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 09:49:24.503156 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 09:49:24.503392 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 09:49:24.503621 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 09:49:24.511244 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80232) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 09:49:24.513430 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 09:49:24.539351 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80232) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 09:49:24.539574 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80232) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 09:49:24.541346 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 09:49:24.541578 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 09:49:24.591167 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80232) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 09:49:24.591323 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 09:49:24.640644 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80232) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 09:49:24.640849 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80232) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 09:49:24.641164 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 09:49:24.641403 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 09:49:24.704364 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80232) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 09:49:24.704594 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80232) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 09:49:24.704721 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 09:49:24.704866 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80232) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 09:49:24.704975 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 09:49:24.705126 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80232) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 09:49:24.705209 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 09:49:24.705273 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80232) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 09:49:24.705395 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 09:49:24.705475 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80232) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 09:49:24.705609 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 09:49:24.705690 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 09:49:24.728233 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80232) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 09:49:24.728465 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80232) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 09:49:24.728591 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 09:49:24.728754 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80232) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 09:49:24.728841 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 09:49:24.728905 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80232) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 09:49:24.729029 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 09:49:24.729183 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80232) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 09:49:24.729279 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 09:49:24.729357 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80232) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 09:49:24.729433 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 09:49:24.729508 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 09:49:24.729581 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80232) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 09:49:24.729701 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 09:49:24.740483 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80232) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 09:49:24.740657 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 09:49:24.753159 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80232) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 09:49:24.753382 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80232) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 09:49:24.753509 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 09:49:24.753675 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80232) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 09:49:24.753762 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 09:49:24.753826 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80232) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 09:49:24.753894 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 09:49:24.753994 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80232) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 09:49:24.754136 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 09:49:24.754218 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80232) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 09:49:24.754282 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 09:49:24.754401 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80232) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 09:49:24.754490 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 09:49:24.754671 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 09:49:24.771218 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.771430 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 10 09:49:24.771728 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.771855 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.771994 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 10 09:49:24.772097 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 10 09:49:24.772217 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.772298 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.772452 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 10 09:49:24.772578 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.772739 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.772824 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.772931 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.773019 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.773253 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.773511 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.784407 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.784686 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.784931 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.785059 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.785223 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.785325 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.785453 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.785772 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.792193 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=80232) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 09:49:24.792731 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=80231) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 09:49:24.795260 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=80232) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 09:49:24.795576 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.795840 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=80231) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 09:49:24.795968 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.796108 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.796192 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.796399 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.796527 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.796668 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.796749 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.796932 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.797110 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.797197 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.797272 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.797489 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.797616 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.797757 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.797859 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.797985 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.798066 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.798284 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.798563 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.821652 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.822354 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.823174 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80232) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 09:49:24.823460 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.823873 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80231) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 09:49:24.824169 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.828102 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=80232) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 09:49:24.828388 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.828676 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.828802 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=80231) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 09:49:24.829094 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.829389 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.835320 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=80232) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 09:49:24.835609 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.835988 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=80231) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 09:49:24.836277 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.839703 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80232) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 09:49:24.839994 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.840277 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.840403 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80231) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 09:49:24.840564 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.840702 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.840834 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.840916 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.841089 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.841222 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.841391 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.841498 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.841618 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.841701 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.841984 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.842250 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.857422 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.857702 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.858095 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.858379 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.861721 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80232) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 09:49:24.862314 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80231) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 09:49:24.864876 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.865199 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.865503 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.865801 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.869627 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80232) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 09:49:24.870252 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80231) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 09:49:24.872795 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80232) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 09:49:24.873439 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80231) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 09:49:24.875991 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.876296 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.876591 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.876718 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.876877 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.877006 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.877187 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.877335 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.877481 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.877610 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.877756 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.878036 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.893600 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80232) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 09:49:24.893855 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.894151 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.894277 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80231) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 09:49:24.894393 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.894506 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.894761 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.895029 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.901380 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.902216 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.902946 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.903199 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.903802 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.904079 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.906065 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=80232) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 09:49:24.906319 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.906646 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.906934 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=80231) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 09:49:24.907063 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.907217 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.907315 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.907495 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.907810 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.908084 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.918695 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=80232) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 09:49:24.918981 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.919267 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.919549 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.919689 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=80231) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 09:49:24.919809 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.919903 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.920105 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.920234 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.920365 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.920461 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.920683 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.920959 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.921264 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.936995 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=80232) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 09:49:24.937821 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=80231) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 09:49:24.939974 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80232) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 09:49:24.940782 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80231) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 09:49:24.942942 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.943768 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.944524 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.945738 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.946468 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=80232) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 09:49:24.946755 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.947051 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.947299 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=80231) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 09:49:24.947623 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.947907 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.953483 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.954355 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.955107 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=80232) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 09:49:24.955990 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=80231) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 09:49:24.958064 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.958359 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.958645 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.958927 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.959057 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.959224 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.959518 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.959796 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.967038 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80232) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 09:49:24.967301 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.967615 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.967909 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80231) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 09:49:24.968203 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.968482 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.974537 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=80232) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 09:49:24.974825 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.975110 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.975388 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.975533 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=80231) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 09:49:24.975608 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.975685 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.975927 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.976055 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.976179 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.976273 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.976478 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.976606 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.976745 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.976841 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.976994 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.977112 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.977366 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.977592 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.977680 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.977757 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.977980 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.978108 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.978193 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80232) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.978277 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.978544 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.978816 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:24.979048 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 09:49:25.011543 dv-cinder-850836-5-smb devstack@keystone.service[80232]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55afb6ded9c0 pid: 80232 (default app) Aug 10 09:49:25.012346 dv-cinder-850836-5-smb devstack@keystone.service[80231]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55afb6ded9c0 pid: 80231 (default app) Aug 10 09:49:25.014857 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f8cf72-78ad-4e38-83e1-9d7b0d20a5eb None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:25.015142 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f8cf72-78ad-4e38-83e1-9d7b0d20a5eb None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:25.015414 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f8cf72-78ad-4e38-83e1-9d7b0d20a5eb None None] PATH_INFO: `/v3` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:25.019769 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1/1] 10.222.0.27 () {50 vars in 791 bytes} [Wed Aug 10 09:49:25 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:49:32.685208 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242de7cf-3d25-4225-8005-5e96e20e329c None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:32.685708 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242de7cf-3d25-4225-8005-5e96e20e329c None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:32.685802 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242de7cf-3d25-4225-8005-5e96e20e329c None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:32.690275 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1/2] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:49:32 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:49:32.696093 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f205289-3376-4341-a837-a4d46392ca05 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:32.696550 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f205289-3376-4341-a837-a4d46392ca05 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:32.696640 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f205289-3376-4341-a837-a4d46392ca05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:32.766594 dv-cinder-850836-5-smb devstack@keystone.service[80232]: INFO dbcounter [None req-7f205289-3376-4341-a837-a4d46392ca05 None None] Registered counter for database keystone Aug 10 09:49:32.788037 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG oslo_db.sqlalchemy.engines [None req-7f205289-3376-4341-a837-a4d46392ca05 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80232) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 09:49:32.799510 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writer thread running {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 09:49:32.980600 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG passlib.handlers.bcrypt [None req-7f205289-3376-4341-a837-a4d46392ca05 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80232) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 10 09:49:32.980981 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG passlib.handlers.bcrypt [None req-7f205289-3376-4341-a837-a4d46392ca05 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80232) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 10 09:49:33.037116 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-7f205289-3376-4341-a837-a4d46392ca05 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:49:33.038749 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-7f205289-3376-4341-a837-a4d46392ca05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:49:33.184000 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 2/3] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:49:32 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 489 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 10 09:49:33.319701 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242de7cf-3d25-4225-8005-5e96e20e329c None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:49:33.389885 dv-cinder-850836-5-smb devstack@keystone.service[80231]: INFO dbcounter [None req-242de7cf-3d25-4225-8005-5e96e20e329c None None] Registered counter for database keystone Aug 10 09:49:33.414497 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG oslo_db.sqlalchemy.engines [None req-242de7cf-3d25-4225-8005-5e96e20e329c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80231) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 09:49:33.422196 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writer thread running {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 09:49:33.542987 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242de7cf-3d25-4225-8005-5e96e20e329c None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:49:33.548395 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49bd0d2-a7c9-4b3b-9714-ba10077ed66a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:49:33.549014 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49bd0d2-a7c9-4b3b-9714-ba10077ed66a admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:33.549319 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49bd0d2-a7c9-4b3b-9714-ba10077ed66a admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:33.549591 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49bd0d2-a7c9-4b3b-9714-ba10077ed66a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:33.558076 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49bd0d2-a7c9-4b3b-9714-ba10077ed66a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:49:33.609297 dv-cinder-850836-5-smb devstack@keystone.service[80231]: WARNING keystone.common.rbac_enforcer.enforcer [None req-e49bd0d2-a7c9-4b3b-9714-ba10077ed66a admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 10 09:49:33.609567 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49bd0d2-a7c9-4b3b-9714-ba10077ed66a admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:49:33.620015 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 2/4] 10.222.0.27 () {58 vars in 1324 bytes} [Wed Aug 10 09:49:33 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 09:49:33.627123 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f205289-3376-4341-a837-a4d46392ca05 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:49:33.650420 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f205289-3376-4341-a837-a4d46392ca05 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:49:33.656068 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ed0715-cc3d-41f4-945b-09d8dbf0774e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:49:33.657219 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed0715-cc3d-41f4-945b-09d8dbf0774e admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:33.657504 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed0715-cc3d-41f4-945b-09d8dbf0774e admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:33.657775 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed0715-cc3d-41f4-945b-09d8dbf0774e admin admin] PATH_INFO: `/v3/projects/e16002ad64714b509607c7c129a68ed7` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:33.659226 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ed0715-cc3d-41f4-945b-09d8dbf0774e admin admin] RBAC: Authorizing `identity:get_project(project_id=e16002ad64714b509607c7c129a68ed7)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:49:33.709628 dv-cinder-850836-5-smb devstack@keystone.service[80232]: WARNING keystone.common.rbac_enforcer.enforcer [None req-72ed0715-cc3d-41f4-945b-09d8dbf0774e admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 10 09:49:33.710173 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ed0715-cc3d-41f4-945b-09d8dbf0774e admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:49:33.714754 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 3/5] 10.222.0.27 () {56 vars in 1207 bytes} [Wed Aug 10 09:49:33 2022] GET /identity/v3/projects/e16002ad64714b509607c7c129a68ed7 => generated 344 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:49:35.692350 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6944a28-e154-41b5-af95-de971aa3ab7b None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:35.692849 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6944a28-e154-41b5-af95-de971aa3ab7b None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:35.692849 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6944a28-e154-41b5-af95-de971aa3ab7b None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:35.697478 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 3/6] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:49:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:49:35.703004 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13bd684-dc06-4217-a5a2-d324a674728d None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:35.703449 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13bd684-dc06-4217-a5a2-d324a674728d None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:35.703543 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13bd684-dc06-4217-a5a2-d324a674728d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:35.727002 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-e13bd684-dc06-4217-a5a2-d324a674728d None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:49:35.728547 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-e13bd684-dc06-4217-a5a2-d324a674728d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:49:35.739054 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 4/7] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:49:35 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 10 09:49:35.760834 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6944a28-e154-41b5-af95-de971aa3ab7b None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:49:35.774875 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6944a28-e154-41b5-af95-de971aa3ab7b None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:49:35.783385 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05599b25-0bb9-4c69-ad67-c53b15787f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:49:35.784279 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05599b25-0bb9-4c69-ad67-c53b15787f6a admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:35.784725 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05599b25-0bb9-4c69-ad67-c53b15787f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:35.785135 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05599b25-0bb9-4c69-ad67-c53b15787f6a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:35.798898 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05599b25-0bb9-4c69-ad67-c53b15787f6a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:49:35.801821 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05599b25-0bb9-4c69-ad67-c53b15787f6a admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:49:35.812153 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 4/8] 10.222.0.27 () {58 vars in 1324 bytes} [Wed Aug 10 09:49:35 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 09:49:35.818000 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13bd684-dc06-4217-a5a2-d324a674728d None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:49:35.828625 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13bd684-dc06-4217-a5a2-d324a674728d None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:49:35.834265 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bfb2fd-b5b0-48d3-a273-8fd41ea48381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:49:35.834895 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bfb2fd-b5b0-48d3-a273-8fd41ea48381 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:35.835176 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bfb2fd-b5b0-48d3-a273-8fd41ea48381 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:35.835449 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bfb2fd-b5b0-48d3-a273-8fd41ea48381 admin admin] PATH_INFO: `/v3/users/68006355826841798d09dd7cab67ec78` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:35.836968 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bfb2fd-b5b0-48d3-a273-8fd41ea48381 admin admin] RBAC: Authorizing `identity:get_user(user_id=68006355826841798d09dd7cab67ec78)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:49:35.838848 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bfb2fd-b5b0-48d3-a273-8fd41ea48381 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:49:35.840381 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 5/9] 10.222.0.27 () {56 vars in 1198 bytes} [Wed Aug 10 09:49:35 2022] GET /identity/v3/users/68006355826841798d09dd7cab67ec78 => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:49:37.880797 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41cb533-4e3a-484f-8e9a-2169f80ecf1b None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:37.881378 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41cb533-4e3a-484f-8e9a-2169f80ecf1b None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:37.881378 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41cb533-4e3a-484f-8e9a-2169f80ecf1b None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:37.882727 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 5/10] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:49:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:49:37.888138 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddbc604-8a73-4964-ba27-7c9f6328d512 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:37.888581 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddbc604-8a73-4964-ba27-7c9f6328d512 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:37.888684 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddbc604-8a73-4964-ba27-7c9f6328d512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:37.906970 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-2ddbc604-8a73-4964-ba27-7c9f6328d512 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:49:37.908165 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-2ddbc604-8a73-4964-ba27-7c9f6328d512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:49:37.916861 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de533ae-48cf-4ba5-99c2-51d54a6e89aa None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:37.917180 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de533ae-48cf-4ba5-99c2-51d54a6e89aa None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:37.917456 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de533ae-48cf-4ba5-99c2-51d54a6e89aa None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:37.918759 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 6/11] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:49:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:49:37.923748 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c0bbc0-5adc-4746-bc96-0089d03025c2 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:37.924032 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c0bbc0-5adc-4746-bc96-0089d03025c2 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:37.924304 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c0bbc0-5adc-4746-bc96-0089d03025c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:37.968394 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG passlib.handlers.bcrypt [None req-37c0bbc0-5adc-4746-bc96-0089d03025c2 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80231) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 10 09:49:37.968836 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG passlib.handlers.bcrypt [None req-37c0bbc0-5adc-4746-bc96-0089d03025c2 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80231) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 10 09:49:37.990871 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 6/12] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:49:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 09:49:38.013706 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddbc604-8a73-4964-ba27-7c9f6328d512 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:49:38.013924 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-37c0bbc0-5adc-4746-bc96-0089d03025c2 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:49:38.015549 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-37c0bbc0-5adc-4746-bc96-0089d03025c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:49:38.038341 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:49:38.120221 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 7/13] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:49:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 09:49:38.123064 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddbc604-8a73-4964-ba27-7c9f6328d512 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:49:38.142286 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c0bbc0-5adc-4746-bc96-0089d03025c2 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:49:38.156194 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b55c71b-519b-4244-a70c-3adc558a27ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:49:38.156840 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b55c71b-519b-4244-a70c-3adc558a27ef None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:38.157150 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b55c71b-519b-4244-a70c-3adc558a27ef None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:38.157436 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b55c71b-519b-4244-a70c-3adc558a27ef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:38.168742 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b55c71b-519b-4244-a70c-3adc558a27ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 09:49:38.177575 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-1b55c71b-519b-4244-a70c-3adc558a27ef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 09:49:38.177575 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:49:38.177575 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:49:38.177575 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:49:38.177575 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:49:38.177575 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:49:38.177575 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:49:38.177575 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:49:38.177575 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:49:38.177575 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:49:38.177575 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:49:38.177575 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:49:38.177575 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 09:49:38.177575 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 09:49:38.177575 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 09:49:38.177575 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 09:49:38.178498 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 09:49:38.178498 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 09:49:38.178498 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 09:49:38.178498 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 09:49:38.178498 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:49:38.178498 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:49:38.178498 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:49:38.178498 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:49:38.178498 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:49:38.178498 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:49:38.178498 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:49:38.178498 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:49:38.178498 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:49:38.178498 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:49:38.178498 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:49:38.178498 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:49:38.179325 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:49:38.179325 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:49:38.179325 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:49:38.179325 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:49:38.179325 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 09:49:38.179325 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 09:49:38.179325 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 09:49:38.179325 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 09:49:38.179325 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 09:49:38.179325 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 09:49:38.179325 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 09:49:38.179325 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:49:38.179325 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 7/14] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Aug 10 09:49:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:49:38.185220 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b55c71b-519b-4244-a70c-3adc558a27ef None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:49:38.242125 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c0bbc0-5adc-4746-bc96-0089d03025c2 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:49:38.244349 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:49:38.270575 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:49:38.280852 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06034a9d-ba06-4804-b56d-03883d170294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:49:38.281760 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06034a9d-ba06-4804-b56d-03883d170294 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:38.282041 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06034a9d-ba06-4804-b56d-03883d170294 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:38.282317 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06034a9d-ba06-4804-b56d-03883d170294 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:38.289334 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b55c71b-519b-4244-a70c-3adc558a27ef None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:49:38.325021 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54b00a7-79e1-4d4a-bd12-f9518131b81b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:49:38.325654 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b00a7-79e1-4d4a-bd12-f9518131b81b None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:38.325905 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b00a7-79e1-4d4a-bd12-f9518131b81b None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:38.326175 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b00a7-79e1-4d4a-bd12-f9518131b81b None admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:38.326850 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54b00a7-79e1-4d4a-bd12-f9518131b81b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:49:38.327152 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54b00a7-79e1-4d4a-bd12-f9518131b81b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:49:38.328546 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54b00a7-79e1-4d4a-bd12-f9518131b81b None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:49:38.339708 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 8/15] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 10 09:49:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 09:49:38.345495 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54b00a7-79e1-4d4a-bd12-f9518131b81b None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:49:38.353058 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06034a9d-ba06-4804-b56d-03883d170294 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:49:38.354656 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06034a9d-ba06-4804-b56d-03883d170294 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:49:38.464348 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 8/16] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 10 09:49:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 10 09:49:38.470117 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06034a9d-ba06-4804-b56d-03883d170294 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:49:38.472978 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:49:38.558414 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54b00a7-79e1-4d4a-bd12-f9518131b81b None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:49:38.570588 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06034a9d-ba06-4804-b56d-03883d170294 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:49:38.591928 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41a4386-e9b1-430d-a0fd-43e3a6591a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:49:38.592567 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41a4386-e9b1-430d-a0fd-43e3a6591a00 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:38.592851 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41a4386-e9b1-430d-a0fd-43e3a6591a00 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:38.593157 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41a4386-e9b1-430d-a0fd-43e3a6591a00 None admin] PATH_INFO: `/v3/users/68006355826841798d09dd7cab67ec78` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:38.594323 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41a4386-e9b1-430d-a0fd-43e3a6591a00 None admin] RBAC: Authorizing `identity:get_user(user_id=68006355826841798d09dd7cab67ec78)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:49:38.595784 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41a4386-e9b1-430d-a0fd-43e3a6591a00 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:49:38.597426 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 9/17] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 10 09:49:38 2022] GET /identity/v3/users/68006355826841798d09dd7cab67ec78 => generated 247 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 09:49:38.603007 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41a4386-e9b1-430d-a0fd-43e3a6591a00 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:49:38.604368 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817f4313-b57c-4a64-a795-5979160921b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:49:38.605304 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817f4313-b57c-4a64-a795-5979160921b8 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:38.605578 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817f4313-b57c-4a64-a795-5979160921b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:38.605868 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817f4313-b57c-4a64-a795-5979160921b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:38.617767 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:49:38.624678 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817f4313-b57c-4a64-a795-5979160921b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:49:38.626220 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817f4313-b57c-4a64-a795-5979160921b8 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:49:38.645125 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-817f4313-b57c-4a64-a795-5979160921b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:49:38.645125 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:49:38.645125 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:49:38.645125 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:49:38.645125 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:49:38.645125 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:49:38.645125 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:49:38.645125 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:49:38.645125 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:49:38.645125 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:49:38.645125 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:49:38.645125 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:49:38.645125 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 09:49:38.645125 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 09:49:38.645125 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 09:49:38.645125 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 09:49:38.646115 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:49:38.646115 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:49:38.646115 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:49:38.646115 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:49:38.646115 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:49:38.646115 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:49:38.646115 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:49:38.646115 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:49:38.646115 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:49:38.646115 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:49:38.646115 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:49:38.646115 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:49:38.646115 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:49:38.646115 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:49:38.646115 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:49:38.646115 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:49:38.646115 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 09:49:38.646896 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 09:49:38.646896 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:49:38.646896 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:49:38.646896 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 9/18] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 10 09:49:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 09:49:38.652227 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817f4313-b57c-4a64-a795-5979160921b8 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:49:38.710690 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:49:38.714553 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41a4386-e9b1-430d-a0fd-43e3a6591a00 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:49:38.748593 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b68adf-9228-4c17-9ad8-e0a0787187a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:49:38.749343 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b68adf-9228-4c17-9ad8-e0a0787187a2 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:38.749689 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b68adf-9228-4c17-9ad8-e0a0787187a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:38.749969 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b68adf-9228-4c17-9ad8-e0a0787187a2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:38.751096 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b68adf-9228-4c17-9ad8-e0a0787187a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:49:38.752569 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b68adf-9228-4c17-9ad8-e0a0787187a2 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:49:38.754175 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 10/19] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 10 09:49:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:49:38.754808 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817f4313-b57c-4a64-a795-5979160921b8 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:49:38.760137 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b68adf-9228-4c17-9ad8-e0a0787187a2 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:49:38.788567 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d87d44-fd42-4a41-a235-11ac8f4647fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:49:38.789244 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d87d44-fd42-4a41-a235-11ac8f4647fb None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:38.789530 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d87d44-fd42-4a41-a235-11ac8f4647fb None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:38.789802 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d87d44-fd42-4a41-a235-11ac8f4647fb None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:38.790446 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d87d44-fd42-4a41-a235-11ac8f4647fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:49:38.790749 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d87d44-fd42-4a41-a235-11ac8f4647fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:49:38.792134 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d87d44-fd42-4a41-a235-11ac8f4647fb None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:49:38.809037 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 10/20] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 10 09:49:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 09:49:38.841998 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:49:38.863507 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b68adf-9228-4c17-9ad8-e0a0787187a2 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:49:38.900245 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffd9240-84c4-47c0-a035-6d3d95b49c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:49:38.900926 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffd9240-84c4-47c0-a035-6d3d95b49c7e None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:38.901126 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffd9240-84c4-47c0-a035-6d3d95b49c7e None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:38.901417 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffd9240-84c4-47c0-a035-6d3d95b49c7e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:38.902161 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffd9240-84c4-47c0-a035-6d3d95b49c7e None admin] RBAC: Adding query filter params (role.id=eb04edc46b3742d7a0f0ead26f68bc22, scope.domain.id=default, user.id=68006355826841798d09dd7cab67ec78) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:49:38.902500 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffd9240-84c4-47c0-a035-6d3d95b49c7e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:49:38.903985 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffd9240-84c4-47c0-a035-6d3d95b49c7e None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:49:38.911620 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 11/21] 10.222.0.27 () {56 vars in 1322 bytes} [Wed Aug 10 09:49:38 2022] GET /identity/v3/role_assignments?user.id=68006355826841798d09dd7cab67ec78&scope.domain.id=default&role.id=eb04edc46b3742d7a0f0ead26f68bc22 => generated 233 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 09:49:41.202402 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6db23c2-612b-4b30-a486-0945851ce232 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:41.203373 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6db23c2-612b-4b30-a486-0945851ce232 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:41.203846 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6db23c2-612b-4b30-a486-0945851ce232 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:41.205438 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 11/22] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:49:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:49:41.221205 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c0c6f2-32eb-4b63-93ed-57f51a11da22 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:41.221657 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c0c6f2-32eb-4b63-93ed-57f51a11da22 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:41.221729 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c0c6f2-32eb-4b63-93ed-57f51a11da22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:41.229726 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17598b3-6622-4ff8-8701-af4a3126bbff None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:41.230241 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17598b3-6622-4ff8-8701-af4a3126bbff None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:41.230727 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17598b3-6622-4ff8-8701-af4a3126bbff None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:41.232456 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 12/23] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:49:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:49:41.247883 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-b9c0c6f2-32eb-4b63-93ed-57f51a11da22 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:49:41.248722 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43114a58-042e-4b92-86d3-d176ce644307 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:41.249137 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-b9c0c6f2-32eb-4b63-93ed-57f51a11da22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:49:41.249476 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43114a58-042e-4b92-86d3-d176ce644307 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:41.249937 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43114a58-042e-4b92-86d3-d176ce644307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:41.282142 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-43114a58-042e-4b92-86d3-d176ce644307 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:49:41.283681 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-43114a58-042e-4b92-86d3-d176ce644307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:49:41.351408 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 12/24] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:49:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 09:49:41.390600 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c0c6f2-32eb-4b63-93ed-57f51a11da22 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:49:41.430728 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 13/25] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:49:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 09:49:41.501428 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43114a58-042e-4b92-86d3-d176ce644307 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:49:41.509982 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:49:41.537326 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c0c6f2-32eb-4b63-93ed-57f51a11da22 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:49:41.592941 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:49:41.594372 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fd4709-9700-46c3-bf56-74bce8c9e74a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:49:41.595226 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fd4709-9700-46c3-bf56-74bce8c9e74a None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:41.595648 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fd4709-9700-46c3-bf56-74bce8c9e74a None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:41.596062 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fd4709-9700-46c3-bf56-74bce8c9e74a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:41.607974 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fd4709-9700-46c3-bf56-74bce8c9e74a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:49:41.609765 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fd4709-9700-46c3-bf56-74bce8c9e74a None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:49:41.626387 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-50fd4709-9700-46c3-bf56-74bce8c9e74a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:49:41.626387 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:49:41.626387 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:49:41.626387 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:49:41.626387 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:49:41.626387 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:49:41.626387 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:49:41.626387 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:49:41.626387 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:49:41.626387 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:49:41.626387 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:49:41.626387 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:49:41.626387 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 09:49:41.626387 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 09:49:41.626387 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 09:49:41.626387 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 09:49:41.627389 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:49:41.627389 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:49:41.627389 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:49:41.627389 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:49:41.627389 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:49:41.627389 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:49:41.627389 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:49:41.627389 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:49:41.627389 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:49:41.627389 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:49:41.627389 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:49:41.627389 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:49:41.627389 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:49:41.627389 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:49:41.627389 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:49:41.627389 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:49:41.627389 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 09:49:41.628411 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 09:49:41.628411 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:49:41.628411 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:49:41.629809 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 13/26] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 10 09:49:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:49:41.631378 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3a976c-84b7-4b11-94ca-59c44762b185 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:41.631794 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3a976c-84b7-4b11-94ca-59c44762b185 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:41.632200 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3a976c-84b7-4b11-94ca-59c44762b185 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:41.634097 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 14/27] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:49:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:49:41.640181 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3a976c-84b7-4b11-94ca-59c44762b185 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:49:41.737284 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43114a58-042e-4b92-86d3-d176ce644307 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:49:41.788060 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3a976c-84b7-4b11-94ca-59c44762b185 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:49:41.809196 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b216dbde-3055-4187-b763-e327690f21c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:49:41.809834 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b216dbde-3055-4187-b763-e327690f21c8 None admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:41.810114 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b216dbde-3055-4187-b763-e327690f21c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:41.810387 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b216dbde-3055-4187-b763-e327690f21c8 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:41.811064 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b216dbde-3055-4187-b763-e327690f21c8 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:49:41.812476 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b216dbde-3055-4187-b763-e327690f21c8 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:49:41.840553 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:49:41.864531 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2899ddb-4815-4a7b-a413-47d0bbd99fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:49:41.865569 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2899ddb-4815-4a7b-a413-47d0bbd99fa7 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:41.866044 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2899ddb-4815-4a7b-a413-47d0bbd99fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:41.866503 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2899ddb-4815-4a7b-a413-47d0bbd99fa7 None admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:41.867429 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2899ddb-4815-4a7b-a413-47d0bbd99fa7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:49:41.868046 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2899ddb-4815-4a7b-a413-47d0bbd99fa7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:49:41.869774 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2899ddb-4815-4a7b-a413-47d0bbd99fa7 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:49:41.909916 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 15/28] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 10 09:49:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:49:41.911896 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20af4d4f-3dff-424a-a141-089db234862b None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:41.912453 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20af4d4f-3dff-424a-a141-089db234862b None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:41.912961 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20af4d4f-3dff-424a-a141-089db234862b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:41.935609 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-20af4d4f-3dff-424a-a141-089db234862b None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:49:41.937269 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-20af4d4f-3dff-424a-a141-089db234862b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:49:42.016017 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 16/29] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:49:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 09:49:42.017274 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20af4d4f-3dff-424a-a141-089db234862b None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:49:42.114237 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 14/30] 10.222.0.27 () {60 vars in 1131 bytes} [Wed Aug 10 09:49:41 2022] POST /identity/v3/roles => generated 219 bytes in 613 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 09:49:42.122930 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19de55e9-8f0a-4a79-af4a-c103303e45c4 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:42.123248 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19de55e9-8f0a-4a79-af4a-c103303e45c4 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:42.123498 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19de55e9-8f0a-4a79-af4a-c103303e45c4 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:42.123741 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20af4d4f-3dff-424a-a141-089db234862b None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:49:42.125110 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 15/31] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:49:42 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:49:42.125584 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19de55e9-8f0a-4a79-af4a-c103303e45c4 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:49:42.147853 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:49:42.170806 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa55350-8e77-45db-ade2-5e542619d95e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:49:42.171438 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa55350-8e77-45db-ade2-5e542619d95e None admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:42.171719 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa55350-8e77-45db-ade2-5e542619d95e None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:42.171997 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa55350-8e77-45db-ade2-5e542619d95e None admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:42.172663 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa55350-8e77-45db-ade2-5e542619d95e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:49:42.174208 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa55350-8e77-45db-ade2-5e542619d95e None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:49:42.263583 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19de55e9-8f0a-4a79-af4a-c103303e45c4 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:49:42.273472 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:49:42.307068 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5d8f53-b21b-4ab6-8f1f-161f8fc95a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:49:42.308082 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d8f53-b21b-4ab6-8f1f-161f8fc95a82 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:42.308569 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d8f53-b21b-4ab6-8f1f-161f8fc95a82 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:42.309202 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d8f53-b21b-4ab6-8f1f-161f8fc95a82 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:42.325205 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5d8f53-b21b-4ab6-8f1f-161f8fc95a82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 09:49:42.332674 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-ca5d8f53-b21b-4ab6-8f1f-161f8fc95a82 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 09:49:42.332674 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:49:42.332674 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:49:42.332674 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:49:42.332674 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:49:42.332674 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:49:42.332674 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:49:42.332674 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:49:42.332674 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:49:42.332674 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:49:42.332674 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:49:42.332674 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:49:42.332674 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 09:49:42.332674 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 09:49:42.332674 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 09:49:42.332674 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 09:49:42.333557 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 09:49:42.333557 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 09:49:42.333557 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 09:49:42.333557 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 09:49:42.333557 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:49:42.333557 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:49:42.333557 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:49:42.333557 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:49:42.333557 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:49:42.333557 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:49:42.333557 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:49:42.333557 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:49:42.333557 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:49:42.333557 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:49:42.333557 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:49:42.333557 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:49:42.334368 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:49:42.334368 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:49:42.334368 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:49:42.334368 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:49:42.334368 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 09:49:42.334368 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 09:49:42.334368 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 09:49:42.334368 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 09:49:42.334368 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 09:49:42.334368 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 09:49:42.334368 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 09:49:42.334368 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:49:42.334943 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 17/32] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Aug 10 09:49:42 2022] POST /identity/v3/projects => generated 301 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 09:49:42.335343 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56135271-58e6-4dee-a5bc-ef66d939a763 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:42.336023 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56135271-58e6-4dee-a5bc-ef66d939a763 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:42.336023 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56135271-58e6-4dee-a5bc-ef66d939a763 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:42.337203 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 18/33] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:49:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:49:42.337890 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 16/34] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Aug 10 09:49:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:49:42.338287 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c1d64-7104-4c1c-bc93-51981f2daf5f None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:42.338570 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c1d64-7104-4c1c-bc93-51981f2daf5f None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:42.339228 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c1d64-7104-4c1c-bc93-51981f2daf5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:42.344829 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c43780-322f-4f06-8f39-0635144236f9 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:42.345308 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c43780-322f-4f06-8f39-0635144236f9 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:42.345636 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c43780-322f-4f06-8f39-0635144236f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:42.363764 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-633c1d64-7104-4c1c-bc93-51981f2daf5f None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:49:42.365446 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-633c1d64-7104-4c1c-bc93-51981f2daf5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:49:42.366051 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-65c43780-322f-4f06-8f39-0635144236f9 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:49:42.367814 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-65c43780-322f-4f06-8f39-0635144236f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:49:42.442195 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 19/35] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:49:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 09:49:42.442908 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633c1d64-7104-4c1c-bc93-51981f2daf5f None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:49:42.461499 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 17/36] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:49:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 09:49:42.484503 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c43780-322f-4f06-8f39-0635144236f9 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:49:42.560023 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:49:42.564298 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633c1d64-7104-4c1c-bc93-51981f2daf5f None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:49:42.611283 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3544d7b-1cdc-44b3-b69a-ed91e1b8ee4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:49:42.611889 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:49:42.612978 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3544d7b-1cdc-44b3-b69a-ed91e1b8ee4c None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:42.613364 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3544d7b-1cdc-44b3-b69a-ed91e1b8ee4c None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:42.613636 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3544d7b-1cdc-44b3-b69a-ed91e1b8ee4c None admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:42.614260 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3544d7b-1cdc-44b3-b69a-ed91e1b8ee4c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:49:42.614599 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3544d7b-1cdc-44b3-b69a-ed91e1b8ee4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:49:42.616481 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3544d7b-1cdc-44b3-b69a-ed91e1b8ee4c None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:49:42.619127 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c43780-322f-4f06-8f39-0635144236f9 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:49:42.629201 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 20/37] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 10 09:49:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:49:42.629201 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3544d7b-1cdc-44b3-b69a-ed91e1b8ee4c None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:49:42.657325 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f187aed2-0e7b-4c29-a1f6-6e09d7e09fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:49:42.657949 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f187aed2-0e7b-4c29-a1f6-6e09d7e09fbb None admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:42.658233 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f187aed2-0e7b-4c29-a1f6-6e09d7e09fbb None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:42.658505 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f187aed2-0e7b-4c29-a1f6-6e09d7e09fbb None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:42.659184 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f187aed2-0e7b-4c29-a1f6-6e09d7e09fbb None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:49:42.660717 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f187aed2-0e7b-4c29-a1f6-6e09d7e09fbb None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:49:42.697095 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 18/38] 10.222.0.27 () {60 vars in 1131 bytes} [Wed Aug 10 09:49:42 2022] POST /identity/v3/roles => generated 225 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 09:49:42.697095 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f187aed2-0e7b-4c29-a1f6-6e09d7e09fbb None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:49:42.796788 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3544d7b-1cdc-44b3-b69a-ed91e1b8ee4c None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:49:42.859826 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e75dbce-701a-4e11-80d2-d6ec5eda793a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:49:42.860455 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e75dbce-701a-4e11-80d2-d6ec5eda793a None admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:42.861005 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e75dbce-701a-4e11-80d2-d6ec5eda793a None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:42.861333 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e75dbce-701a-4e11-80d2-d6ec5eda793a None admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:42.862016 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e75dbce-701a-4e11-80d2-d6ec5eda793a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:49:42.862840 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f187aed2-0e7b-4c29-a1f6-6e09d7e09fbb None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:49:42.863427 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e75dbce-701a-4e11-80d2-d6ec5eda793a None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:49:42.882929 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 21/39] 10.222.0.27 () {60 vars in 1131 bytes} [Wed Aug 10 09:49:42 2022] POST /identity/v3/roles => generated 223 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 09:49:42.904132 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8225f733-faa0-453d-8f6b-b709025b26e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:49:42.904813 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8225f733-faa0-453d-8f6b-b709025b26e8 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:42.905123 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8225f733-faa0-453d-8f6b-b709025b26e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:42.905403 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8225f733-faa0-453d-8f6b-b709025b26e8 None admin] PATH_INFO: `/v3/users/68006355826841798d09dd7cab67ec78` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:42.907099 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8225f733-faa0-453d-8f6b-b709025b26e8 None admin] RBAC: Authorizing `identity:get_user(user_id=68006355826841798d09dd7cab67ec78)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:49:42.908630 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8225f733-faa0-453d-8f6b-b709025b26e8 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:49:42.910640 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 19/40] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 10 09:49:42 2022] GET /identity/v3/users/68006355826841798d09dd7cab67ec78 => generated 247 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:49:42.913323 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c626b3-e456-4236-bd40-079dfc330a7d None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:42.913617 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c626b3-e456-4236-bd40-079dfc330a7d None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:42.913895 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c626b3-e456-4236-bd40-079dfc330a7d None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:42.915512 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 22/41] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:49:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:49:42.915918 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8225f733-faa0-453d-8f6b-b709025b26e8 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:49:42.921010 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d815ded2-ff47-4b59-bbe1-4958141d29ee None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:42.921359 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d815ded2-ff47-4b59-bbe1-4958141d29ee None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:42.921635 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d815ded2-ff47-4b59-bbe1-4958141d29ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:42.941754 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-d815ded2-ff47-4b59-bbe1-4958141d29ee None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:49:42.943127 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-d815ded2-ff47-4b59-bbe1-4958141d29ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:49:42.946689 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:49:42.964636 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:49:43.030365 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 23/42] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:49:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 09:49:43.042855 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8225f733-faa0-453d-8f6b-b709025b26e8 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:49:43.052735 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d815ded2-ff47-4b59-bbe1-4958141d29ee None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:49:43.084678 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792e1f17-8862-40d5-bb8f-2f4fa44c7cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:49:43.085398 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792e1f17-8862-40d5-bb8f-2f4fa44c7cdc None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:43.085663 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792e1f17-8862-40d5-bb8f-2f4fa44c7cdc None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:43.085931 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792e1f17-8862-40d5-bb8f-2f4fa44c7cdc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:43.087624 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792e1f17-8862-40d5-bb8f-2f4fa44c7cdc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:49:43.089098 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792e1f17-8862-40d5-bb8f-2f4fa44c7cdc None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:49:43.090958 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 20/43] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 10 09:49:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 09:49:43.096432 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792e1f17-8862-40d5-bb8f-2f4fa44c7cdc None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:49:43.162225 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d815ded2-ff47-4b59-bbe1-4958141d29ee None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:49:43.185889 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:49:43.195368 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792e1f17-8862-40d5-bb8f-2f4fa44c7cdc None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:49:43.195503 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af81cc7-35d0-4a56-98aa-b66d89e1fc58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:49:43.196116 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af81cc7-35d0-4a56-98aa-b66d89e1fc58 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:43.196401 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af81cc7-35d0-4a56-98aa-b66d89e1fc58 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:43.196678 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af81cc7-35d0-4a56-98aa-b66d89e1fc58 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:43.197847 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af81cc7-35d0-4a56-98aa-b66d89e1fc58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:49:43.199332 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af81cc7-35d0-4a56-98aa-b66d89e1fc58 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:49:43.200924 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 24/44] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 10 09:49:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 09:49:43.206597 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af81cc7-35d0-4a56-98aa-b66d89e1fc58 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:49:43.224983 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:49:43.228514 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c71630-6ddc-4e2c-8afb-0af5da0f96d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:49:43.229217 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c71630-6ddc-4e2c-8afb-0af5da0f96d6 None admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:43.229497 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c71630-6ddc-4e2c-8afb-0af5da0f96d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:43.229774 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c71630-6ddc-4e2c-8afb-0af5da0f96d6 None admin] PATH_INFO: `/v3/domains/default/users/68006355826841798d09dd7cab67ec78/roles/eb04edc46b3742d7a0f0ead26f68bc22` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:43.231711 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c71630-6ddc-4e2c-8afb-0af5da0f96d6 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=68006355826841798d09dd7cab67ec78, role_id=eb04edc46b3742d7a0f0ead26f68bc22)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:49:43.233193 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c71630-6ddc-4e2c-8afb-0af5da0f96d6 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:49:43.247686 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 21/45] 10.222.0.27 () {58 vars in 1361 bytes} [Wed Aug 10 09:49:43 2022] PUT /identity/v3/domains/default/users/68006355826841798d09dd7cab67ec78/roles/eb04edc46b3742d7a0f0ead26f68bc22 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 09:49:43.313880 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af81cc7-35d0-4a56-98aa-b66d89e1fc58 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:49:43.352329 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1511a1-502b-4824-8490-554a355ccdd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:49:43.353013 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1511a1-502b-4824-8490-554a355ccdd3 None admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:43.353245 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1511a1-502b-4824-8490-554a355ccdd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:43.353517 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1511a1-502b-4824-8490-554a355ccdd3 None admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:43.354201 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1511a1-502b-4824-8490-554a355ccdd3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:49:43.355696 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1511a1-502b-4824-8490-554a355ccdd3 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:49:43.386233 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 25/46] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Aug 10 09:49:43 2022] POST /identity/v3/projects => generated 312 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 09:49:45.188748 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6742c6d-13b3-4691-9ce9-41980c5239a5 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:45.189354 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6742c6d-13b3-4691-9ce9-41980c5239a5 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:45.189354 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6742c6d-13b3-4691-9ce9-41980c5239a5 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:45.190715 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 22/47] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:49:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:49:45.196431 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ee1d3c-8bd1-4548-9969-177c67ca6b38 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:45.196902 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ee1d3c-8bd1-4548-9969-177c67ca6b38 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:45.197015 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ee1d3c-8bd1-4548-9969-177c67ca6b38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:45.215663 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-48ee1d3c-8bd1-4548-9969-177c67ca6b38 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:49:45.216873 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-48ee1d3c-8bd1-4548-9969-177c67ca6b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:49:45.281814 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:49:45.286349 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 26/48] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:49:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 09:49:45.308989 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6742c6d-13b3-4691-9ce9-41980c5239a5 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:49:45.347982 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a8b6e-8a97-4d7c-b4d2-924354599856 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:45.348259 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a8b6e-8a97-4d7c-b4d2-924354599856 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:45.348524 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a8b6e-8a97-4d7c-b4d2-924354599856 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:45.349934 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 27/49] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:49:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 09:49:45.354877 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3bfe69-e662-44e2-9d2b-dc50a8d2f393 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:45.355163 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3bfe69-e662-44e2-9d2b-dc50a8d2f393 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:45.355439 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3bfe69-e662-44e2-9d2b-dc50a8d2f393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:45.373586 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-df3bfe69-e662-44e2-9d2b-dc50a8d2f393 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:49:45.374781 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-df3bfe69-e662-44e2-9d2b-dc50a8d2f393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:49:45.415535 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6742c6d-13b3-4691-9ce9-41980c5239a5 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:49:45.439201 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 28/50] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:49:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 09:49:45.449006 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa31c9c1-d583-479d-84d6-444c308b3cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:49:45.449690 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa31c9c1-d583-479d-84d6-444c308b3cae None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:45.449976 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa31c9c1-d583-479d-84d6-444c308b3cae None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:45.450252 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa31c9c1-d583-479d-84d6-444c308b3cae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:45.460844 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa31c9c1-d583-479d-84d6-444c308b3cae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 09:49:45.462161 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3bfe69-e662-44e2-9d2b-dc50a8d2f393 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:49:45.466306 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-fa31c9c1-d583-479d-84d6-444c308b3cae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 09:49:45.466306 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:49:45.466306 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:49:45.466306 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:49:45.466306 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:49:45.466306 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:49:45.466306 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:49:45.466306 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:49:45.466306 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:49:45.466306 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:49:45.466306 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:49:45.466306 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:49:45.466306 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 09:49:45.466306 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 09:49:45.466306 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 09:49:45.466306 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 09:49:45.467233 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 09:49:45.467233 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 09:49:45.467233 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 09:49:45.467233 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 09:49:45.467233 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:49:45.467233 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:49:45.467233 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:49:45.467233 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:49:45.467233 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:49:45.467233 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:49:45.467233 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:49:45.467233 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:49:45.467233 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:49:45.467233 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:49:45.467233 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:49:45.467233 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:49:45.467954 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:49:45.467954 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:49:45.467954 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:49:45.467954 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:49:45.467954 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 09:49:45.467954 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 09:49:45.467954 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 09:49:45.467954 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 09:49:45.467954 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 09:49:45.467954 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 09:49:45.467954 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 09:49:45.467954 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:49:45.467954 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 23/51] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Aug 10 09:49:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:49:45.473269 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa31c9c1-d583-479d-84d6-444c308b3cae None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:49:45.488380 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:49:45.561003 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3bfe69-e662-44e2-9d2b-dc50a8d2f393 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:49:45.571051 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa31c9c1-d583-479d-84d6-444c308b3cae None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:49:45.589768 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:49:45.596719 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1fb001-935d-4425-bc7c-51f98062dc44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:49:45.597410 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1fb001-935d-4425-bc7c-51f98062dc44 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:45.597690 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1fb001-935d-4425-bc7c-51f98062dc44 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:45.597960 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1fb001-935d-4425-bc7c-51f98062dc44 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:45.599086 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1fb001-935d-4425-bc7c-51f98062dc44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:49:45.600554 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1fb001-935d-4425-bc7c-51f98062dc44 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:49:45.602222 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 29/52] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 10 09:49:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 09:49:45.604463 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92acff78-81a8-4bf4-9036-d4603119d6db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:49:45.605091 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92acff78-81a8-4bf4-9036-d4603119d6db None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:45.605410 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92acff78-81a8-4bf4-9036-d4603119d6db None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:45.605688 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92acff78-81a8-4bf4-9036-d4603119d6db None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:45.606362 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92acff78-81a8-4bf4-9036-d4603119d6db None admin] RBAC: Adding query filter params (name=admin) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:49:45.606669 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92acff78-81a8-4bf4-9036-d4603119d6db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:49:45.607868 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1fb001-935d-4425-bc7c-51f98062dc44 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:49:45.608171 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92acff78-81a8-4bf4-9036-d4603119d6db None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:49:45.620334 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 24/53] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 10 09:49:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:49:45.625805 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92acff78-81a8-4bf4-9036-d4603119d6db None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:49:45.705890 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:49:45.709709 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1fb001-935d-4425-bc7c-51f98062dc44 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:49:45.734070 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92acff78-81a8-4bf4-9036-d4603119d6db None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:49:45.742923 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf10efe6-870f-4e04-8e60-1603e2f8141f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:49:45.743527 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf10efe6-870f-4e04-8e60-1603e2f8141f None admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:45.743807 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf10efe6-870f-4e04-8e60-1603e2f8141f None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:45.744078 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf10efe6-870f-4e04-8e60-1603e2f8141f None admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:45.744736 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf10efe6-870f-4e04-8e60-1603e2f8141f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:49:45.746225 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf10efe6-870f-4e04-8e60-1603e2f8141f None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:49:45.766819 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa473c6e-a827-474d-9949-521a25a10cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:49:45.767640 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa473c6e-a827-474d-9949-521a25a10cd5 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:45.767924 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa473c6e-a827-474d-9949-521a25a10cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:45.768276 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa473c6e-a827-474d-9949-521a25a10cd5 None admin] PATH_INFO: `/v3/users/68006355826841798d09dd7cab67ec78` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:45.769488 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa473c6e-a827-474d-9949-521a25a10cd5 None admin] RBAC: Authorizing `identity:get_user(user_id=68006355826841798d09dd7cab67ec78)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:49:45.770939 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa473c6e-a827-474d-9949-521a25a10cd5 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:49:45.772532 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 25/54] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 10 09:49:45 2022] GET /identity/v3/users/68006355826841798d09dd7cab67ec78 => generated 247 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 09:49:45.773549 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 30/55] 10.222.0.27 () {60 vars in 1140 bytes} [Wed Aug 10 09:49:45 2022] POST /identity/v3/projects => generated 298 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 09:49:45.782251 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa473c6e-a827-474d-9949-521a25a10cd5 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:49:45.889740 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa473c6e-a827-474d-9949-521a25a10cd5 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:49:45.927003 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a90706a-b203-4d30-b421-b9bd581728a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:49:45.927963 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a90706a-b203-4d30-b421-b9bd581728a9 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:45.927963 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a90706a-b203-4d30-b421-b9bd581728a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:45.928199 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a90706a-b203-4d30-b421-b9bd581728a9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:45.929377 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a90706a-b203-4d30-b421-b9bd581728a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:49:45.930864 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a90706a-b203-4d30-b421-b9bd581728a9 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:49:45.933011 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 26/56] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 10 09:49:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:49:45.938440 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf10efe6-870f-4e04-8e60-1603e2f8141f None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:49:45.990452 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:49:46.040602 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf10efe6-870f-4e04-8e60-1603e2f8141f None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:49:46.074823 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e3735a-d6be-40e6-9ed3-a533d6ee8573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:49:46.075466 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e3735a-d6be-40e6-9ed3-a533d6ee8573 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:46.075750 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e3735a-d6be-40e6-9ed3-a533d6ee8573 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:46.076025 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e3735a-d6be-40e6-9ed3-a533d6ee8573 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:46.076756 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e3735a-d6be-40e6-9ed3-a533d6ee8573 None admin] RBAC: Adding query filter params (role.id=eb04edc46b3742d7a0f0ead26f68bc22, scope.domain.id=default, user.id=68006355826841798d09dd7cab67ec78) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:49:46.077080 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e3735a-d6be-40e6-9ed3-a533d6ee8573 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:49:46.078558 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e3735a-d6be-40e6-9ed3-a533d6ee8573 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:49:46.084410 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 31/57] 10.222.0.27 () {56 vars in 1322 bytes} [Wed Aug 10 09:49:45 2022] GET /identity/v3/role_assignments?user.id=68006355826841798d09dd7cab67ec78&scope.domain.id=default&role.id=eb04edc46b3742d7a0f0ead26f68bc22 => generated 530 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:49:47.735007 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5130a79b-6df6-4e07-84c9-68a9853b2315 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:47.735542 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5130a79b-6df6-4e07-84c9-68a9853b2315 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:47.735542 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5130a79b-6df6-4e07-84c9-68a9853b2315 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:47.736903 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 27/58] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:49:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:49:47.743182 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b870cac-924c-4907-bc98-3a862abb2d49 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:47.743907 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b870cac-924c-4907-bc98-3a862abb2d49 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:47.744033 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b870cac-924c-4907-bc98-3a862abb2d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:47.774775 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-9b870cac-924c-4907-bc98-3a862abb2d49 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:49:47.775981 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-9b870cac-924c-4907-bc98-3a862abb2d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:49:47.846848 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 32/59] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:49:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 09:49:47.878490 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5130a79b-6df6-4e07-84c9-68a9853b2315 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:49:47.892258 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:49:47.989494 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5130a79b-6df6-4e07-84c9-68a9853b2315 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:49:48.026741 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706f9788-bf23-4dc0-a124-e362bc5b0e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:49:48.027360 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f9788-bf23-4dc0-a124-e362bc5b0e52 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:48.027644 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f9788-bf23-4dc0-a124-e362bc5b0e52 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:48.027915 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f9788-bf23-4dc0-a124-e362bc5b0e52 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:48.029202 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706f9788-bf23-4dc0-a124-e362bc5b0e52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:49:48.030668 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706f9788-bf23-4dc0-a124-e362bc5b0e52 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:49:48.032220 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 28/60] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 10 09:49:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:49:48.038033 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b870cac-924c-4907-bc98-3a862abb2d49 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:49:48.085620 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:49:48.147631 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b870cac-924c-4907-bc98-3a862abb2d49 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:49:48.182344 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3730ec41-dbfd-48a1-b5ea-d17f67afa5cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:49:48.182938 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3730ec41-dbfd-48a1-b5ea-d17f67afa5cc None admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:48.183218 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3730ec41-dbfd-48a1-b5ea-d17f67afa5cc None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:48.183485 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3730ec41-dbfd-48a1-b5ea-d17f67afa5cc None admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:48.184124 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3730ec41-dbfd-48a1-b5ea-d17f67afa5cc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:49:48.185624 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3730ec41-dbfd-48a1-b5ea-d17f67afa5cc None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:49:48.213707 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 33/61] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Aug 10 09:49:48 2022] POST /identity/v3/users => generated 275 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 09:49:51.270001 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552b7a8c-c597-4d74-b2c8-14c68215e20d None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:51.270553 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552b7a8c-c597-4d74-b2c8-14c68215e20d None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:51.270924 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552b7a8c-c597-4d74-b2c8-14c68215e20d None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:51.272456 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 29/62] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:49:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:49:51.277752 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e51bc4-e10f-41a1-b815-9b10b37fac66 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:51.278163 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e51bc4-e10f-41a1-b815-9b10b37fac66 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:51.278314 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e51bc4-e10f-41a1-b815-9b10b37fac66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:51.306066 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-e4e51bc4-e10f-41a1-b815-9b10b37fac66 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:49:51.307293 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-e4e51bc4-e10f-41a1-b815-9b10b37fac66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:49:51.396247 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 34/63] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:49:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 09:49:51.434693 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552b7a8c-c597-4d74-b2c8-14c68215e20d None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:49:51.543011 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e10afc4-ae9b-48f2-b6d2-1bcac3083d52 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:51.543822 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e10afc4-ae9b-48f2-b6d2-1bcac3083d52 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:51.544467 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e10afc4-ae9b-48f2-b6d2-1bcac3083d52 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:51.547595 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 35/64] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:49:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:49:51.549537 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:49:51.555259 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da943f59-5199-4a38-901e-074e23509ba7 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:51.555843 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da943f59-5199-4a38-901e-074e23509ba7 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:51.556745 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da943f59-5199-4a38-901e-074e23509ba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:51.589089 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-da943f59-5199-4a38-901e-074e23509ba7 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:49:51.590623 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-da943f59-5199-4a38-901e-074e23509ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:49:51.595091 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552b7a8c-c597-4d74-b2c8-14c68215e20d None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:49:51.626417 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:49:51.639146 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c95333-5e9d-42aa-9285-ea70336e08fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:49:51.639809 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c95333-5e9d-42aa-9285-ea70336e08fb None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:51.640233 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c95333-5e9d-42aa-9285-ea70336e08fb None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:51.640642 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c95333-5e9d-42aa-9285-ea70336e08fb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:51.653919 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c95333-5e9d-42aa-9285-ea70336e08fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 09:49:51.661219 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-73c95333-5e9d-42aa-9285-ea70336e08fb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 09:49:51.661219 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:49:51.661219 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:49:51.661219 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:49:51.661219 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:49:51.661219 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:49:51.661219 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:49:51.661219 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:49:51.661219 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:49:51.661219 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:49:51.661219 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:49:51.661219 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:49:51.661219 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 09:49:51.661219 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 09:49:51.661219 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 09:49:51.661219 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 09:49:51.662048 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 09:49:51.662048 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 09:49:51.662048 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 09:49:51.662048 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 09:49:51.662048 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:49:51.662048 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:49:51.662048 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:49:51.662048 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:49:51.662048 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:49:51.662048 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:49:51.662048 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:49:51.662048 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:49:51.662048 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:49:51.662048 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:49:51.662048 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:49:51.662048 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:49:51.662786 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:49:51.662786 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:49:51.662786 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:49:51.662786 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:49:51.662786 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 09:49:51.662786 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 09:49:51.662786 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 09:49:51.662786 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 09:49:51.662786 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 09:49:51.662786 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 09:49:51.662786 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 09:49:51.662786 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:49:51.662786 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 30/65] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 10 09:49:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:49:51.663904 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe1917-bda4-4a72-8089-746672b0bd1f None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:51.664812 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe1917-bda4-4a72-8089-746672b0bd1f None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:51.665262 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe1917-bda4-4a72-8089-746672b0bd1f None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:51.666645 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 31/66] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:49:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:49:51.672176 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebe1917-bda4-4a72-8089-746672b0bd1f None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:49:51.699714 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 36/67] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:49:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 09:49:51.701316 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd129d1-d532-4ff1-aed3-d97cf4da73c6 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:51.701742 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd129d1-d532-4ff1-aed3-d97cf4da73c6 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:51.702268 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd129d1-d532-4ff1-aed3-d97cf4da73c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:51.737155 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-1fd129d1-d532-4ff1-aed3-d97cf4da73c6 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:49:51.738649 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-1fd129d1-d532-4ff1-aed3-d97cf4da73c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:49:51.810616 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebe1917-bda4-4a72-8089-746672b0bd1f None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:49:51.839867 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 37/68] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:49:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 09:49:51.841023 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd129d1-d532-4ff1-aed3-d97cf4da73c6 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:49:51.870041 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f56da27-7c4c-4caf-aec2-a49e11dbd07c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:49:51.870664 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f56da27-7c4c-4caf-aec2-a49e11dbd07c None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:51.870946 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f56da27-7c4c-4caf-aec2-a49e11dbd07c None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:51.871214 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f56da27-7c4c-4caf-aec2-a49e11dbd07c None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:51.872025 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f56da27-7c4c-4caf-aec2-a49e11dbd07c None admin] RBAC: Adding query filter params (name=member) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:49:51.872310 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f56da27-7c4c-4caf-aec2-a49e11dbd07c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:49:51.873746 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f56da27-7c4c-4caf-aec2-a49e11dbd07c None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:49:51.879470 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:49:51.884427 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 32/69] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Aug 10 09:49:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:49:51.885773 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f56da27-7c4c-4caf-aec2-a49e11dbd07c None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:49:51.951938 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:49:51.966891 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd129d1-d532-4ff1-aed3-d97cf4da73c6 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:49:51.990446 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f56da27-7c4c-4caf-aec2-a49e11dbd07c None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:49:52.003368 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af4c283-bebb-42de-b82a-8bfc02a53eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:49:52.004212 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af4c283-bebb-42de-b82a-8bfc02a53eff None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:52.004648 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af4c283-bebb-42de-b82a-8bfc02a53eff None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:52.004924 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af4c283-bebb-42de-b82a-8bfc02a53eff None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:52.016060 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af4c283-bebb-42de-b82a-8bfc02a53eff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 09:49:52.021348 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-4af4c283-bebb-42de-b82a-8bfc02a53eff None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 09:49:52.021348 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:49:52.021348 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:49:52.021348 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:49:52.021348 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:49:52.021348 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:49:52.021348 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:49:52.021348 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:49:52.021348 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:49:52.021348 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:49:52.021348 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:49:52.021348 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:49:52.021348 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 09:49:52.021348 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 09:49:52.021348 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 09:49:52.021348 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 09:49:52.022166 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 09:49:52.022166 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 09:49:52.022166 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 09:49:52.022166 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 09:49:52.022166 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:49:52.022166 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:49:52.022166 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:49:52.022166 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:49:52.022166 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:49:52.022166 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:49:52.022166 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:49:52.022166 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:49:52.022166 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:49:52.022166 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:49:52.022166 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:49:52.022166 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:49:52.022914 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:49:52.022914 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:49:52.022914 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:49:52.022914 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:49:52.022914 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 09:49:52.022914 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 09:49:52.022914 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 09:49:52.022914 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 09:49:52.022914 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 09:49:52.022914 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 09:49:52.022914 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 09:49:52.022914 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:49:52.022914 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 38/70] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Aug 10 09:49:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:49:52.023512 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af4c283-bebb-42de-b82a-8bfc02a53eff None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:49:52.029703 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80766904-1a21-4ff3-9a54-4cba5400e946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:49:52.030341 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80766904-1a21-4ff3-9a54-4cba5400e946 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:52.030973 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80766904-1a21-4ff3-9a54-4cba5400e946 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:52.031243 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80766904-1a21-4ff3-9a54-4cba5400e946 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:52.041626 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80766904-1a21-4ff3-9a54-4cba5400e946 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 09:49:52.046306 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-80766904-1a21-4ff3-9a54-4cba5400e946 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 09:49:52.046306 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:49:52.046306 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:49:52.046306 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:49:52.046306 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:49:52.046306 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:49:52.046306 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:49:52.046306 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:49:52.046306 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:49:52.046306 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:49:52.046306 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:49:52.046306 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:49:52.046306 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 09:49:52.046306 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 09:49:52.046306 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 09:49:52.046306 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 09:49:52.047112 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 09:49:52.047112 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 09:49:52.047112 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 09:49:52.047112 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 09:49:52.047112 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:49:52.047112 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:49:52.047112 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:49:52.047112 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:49:52.047112 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:49:52.047112 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:49:52.047112 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:49:52.047112 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:49:52.047112 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:49:52.047112 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:49:52.047112 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:49:52.047112 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:49:52.047866 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:49:52.047866 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:49:52.047866 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:49:52.047866 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:49:52.047866 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 09:49:52.047866 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 09:49:52.047866 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 09:49:52.047866 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 09:49:52.047866 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 09:49:52.047866 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 09:49:52.047866 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 09:49:52.047866 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:49:52.047866 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 33/71] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Aug 10 09:49:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:49:52.048865 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fed9d30-da81-4c57-9157-8d6bfb921ad1 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:52.048865 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fed9d30-da81-4c57-9157-8d6bfb921ad1 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:52.049299 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fed9d30-da81-4c57-9157-8d6bfb921ad1 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:52.053186 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 34/72] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:49:52 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:49:52.053186 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fed9d30-da81-4c57-9157-8d6bfb921ad1 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:49:52.115863 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:49:52.137528 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af4c283-bebb-42de-b82a-8bfc02a53eff None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:49:52.161026 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fed9d30-da81-4c57-9157-8d6bfb921ad1 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:49:52.172911 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5e9e5d-d2f2-410e-aee3-f3bc8d60f74b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:49:52.173582 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5e9e5d-d2f2-410e-aee3-f3bc8d60f74b None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:52.173866 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5e9e5d-d2f2-410e-aee3-f3bc8d60f74b None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:52.174137 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5e9e5d-d2f2-410e-aee3-f3bc8d60f74b None admin] PATH_INFO: `/v3/users/09ce8c0b6d584400af33d8c86a3b8bba` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:52.188381 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5e9e5d-d2f2-410e-aee3-f3bc8d60f74b None admin] RBAC: Authorizing `identity:get_user(user_id=09ce8c0b6d584400af33d8c86a3b8bba)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:49:52.189913 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5e9e5d-d2f2-410e-aee3-f3bc8d60f74b None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:49:52.191565 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 39/73] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 10 09:49:52 2022] GET /identity/v3/users/09ce8c0b6d584400af33d8c86a3b8bba => generated 275 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:49:52.192694 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e523c533-19eb-4319-8e46-d6b4b26d4683 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:52.192973 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e523c533-19eb-4319-8e46-d6b4b26d4683 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:52.193266 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e523c533-19eb-4319-8e46-d6b4b26d4683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:52.200843 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08a82c8-b9e9-4f8b-b363-f4d19681bb44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:49:52.201496 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08a82c8-b9e9-4f8b-b363-f4d19681bb44 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:52.201779 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08a82c8-b9e9-4f8b-b363-f4d19681bb44 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:52.202045 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08a82c8-b9e9-4f8b-b363-f4d19681bb44 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:52.202711 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08a82c8-b9e9-4f8b-b363-f4d19681bb44 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:49:52.203013 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08a82c8-b9e9-4f8b-b363-f4d19681bb44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:49:52.204410 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08a82c8-b9e9-4f8b-b363-f4d19681bb44 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:49:52.212074 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-e523c533-19eb-4319-8e46-d6b4b26d4683 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:49:52.213309 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-e523c533-19eb-4319-8e46-d6b4b26d4683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:49:52.214245 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 35/74] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 10 09:49:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:49:52.215616 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:49:52.217883 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08a82c8-b9e9-4f8b-b363-f4d19681bb44 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:49:52.281245 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 40/75] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:49:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 09:49:52.282104 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e523c533-19eb-4319-8e46-d6b4b26d4683 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:49:52.325298 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08a82c8-b9e9-4f8b-b363-f4d19681bb44 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:49:52.347095 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:49:52.358648 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbf6a89-5bc3-4e85-aabe-b3507031d20a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:49:52.359262 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbf6a89-5bc3-4e85-aabe-b3507031d20a None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:52.359539 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbf6a89-5bc3-4e85-aabe-b3507031d20a None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:52.359809 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbf6a89-5bc3-4e85-aabe-b3507031d20a None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:52.360476 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbf6a89-5bc3-4e85-aabe-b3507031d20a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:49:52.360778 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbf6a89-5bc3-4e85-aabe-b3507031d20a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:49:52.362193 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbf6a89-5bc3-4e85-aabe-b3507031d20a None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:49:52.370100 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 36/76] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 10 09:49:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:49:52.370646 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbf6a89-5bc3-4e85-aabe-b3507031d20a None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:49:52.384198 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e523c533-19eb-4319-8e46-d6b4b26d4683 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:49:52.418407 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbffdeed-79c2-4ef3-b6aa-1bed7e9957ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:49:52.419013 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbffdeed-79c2-4ef3-b6aa-1bed7e9957ee None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:52.419295 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbffdeed-79c2-4ef3-b6aa-1bed7e9957ee None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:52.419569 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbffdeed-79c2-4ef3-b6aa-1bed7e9957ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:52.427571 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:49:52.468562 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbf6a89-5bc3-4e85-aabe-b3507031d20a None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:49:52.487161 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbffdeed-79c2-4ef3-b6aa-1bed7e9957ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:49:52.488659 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbffdeed-79c2-4ef3-b6aa-1bed7e9957ee None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:49:52.500267 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d222bc-6f88-418e-b68a-82568e089dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:49:52.500883 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d222bc-6f88-418e-b68a-82568e089dda None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:52.501236 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d222bc-6f88-418e-b68a-82568e089dda None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:52.501512 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d222bc-6f88-418e-b68a-82568e089dda None admin] PATH_INFO: `/v3/users/68006355826841798d09dd7cab67ec78` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:52.502663 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d222bc-6f88-418e-b68a-82568e089dda None admin] RBAC: Authorizing `identity:get_user(user_id=68006355826841798d09dd7cab67ec78)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:49:52.504094 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d222bc-6f88-418e-b68a-82568e089dda None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:49:52.505693 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 37/77] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 10 09:49:52 2022] GET /identity/v3/users/68006355826841798d09dd7cab67ec78 => generated 247 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:49:52.507083 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd62b60-cae8-455e-b9bb-3a1b3cd7020a None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:52.507368 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd62b60-cae8-455e-b9bb-3a1b3cd7020a None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:52.507646 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd62b60-cae8-455e-b9bb-3a1b3cd7020a None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:52.509023 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 38/78] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:49:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:49:52.509593 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd62b60-cae8-455e-b9bb-3a1b3cd7020a None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:49:52.565275 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:49:52.590626 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 41/79] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 10 09:49:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 09:49:52.591690 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbffdeed-79c2-4ef3-b6aa-1bed7e9957ee None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:49:52.622353 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd62b60-cae8-455e-b9bb-3a1b3cd7020a None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:49:52.632980 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:49:52.657979 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd9bb80-6068-4852-ae90-6d73d2fb8a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:49:52.658615 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd9bb80-6068-4852-ae90-6d73d2fb8a27 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:52.658896 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd9bb80-6068-4852-ae90-6d73d2fb8a27 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:52.659170 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd9bb80-6068-4852-ae90-6d73d2fb8a27 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:52.669418 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd9bb80-6068-4852-ae90-6d73d2fb8a27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 09:49:52.674808 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-9dd9bb80-6068-4852-ae90-6d73d2fb8a27 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 09:49:52.674808 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:49:52.674808 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:49:52.674808 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:49:52.674808 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:49:52.674808 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:49:52.674808 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:49:52.674808 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:49:52.674808 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:49:52.674808 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:49:52.674808 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:49:52.674808 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:49:52.674808 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 09:49:52.674808 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 09:49:52.674808 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 09:49:52.674808 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 09:49:52.675666 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 09:49:52.675666 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 09:49:52.675666 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 09:49:52.675666 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 09:49:52.675666 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:49:52.675666 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:49:52.675666 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:49:52.675666 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:49:52.675666 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:49:52.675666 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:49:52.675666 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:49:52.675666 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:49:52.675666 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:49:52.675666 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:49:52.675666 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:49:52.675666 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:49:52.676416 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:49:52.676416 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:49:52.676416 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:49:52.676416 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:49:52.676416 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 09:49:52.676416 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 09:49:52.676416 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 09:49:52.676416 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 09:49:52.676416 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 09:49:52.676416 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 09:49:52.676416 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 09:49:52.676416 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:49:52.676416 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 39/80] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 10 09:49:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:49:52.677088 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd9bb80-6068-4852-ae90-6d73d2fb8a27 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:49:52.701774 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbffdeed-79c2-4ef3-b6aa-1bed7e9957ee None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:49:52.735765 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd45b9f-486a-4bfd-ae28-5baabee7b028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:49:52.736403 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd45b9f-486a-4bfd-ae28-5baabee7b028 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:52.736686 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd45b9f-486a-4bfd-ae28-5baabee7b028 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:52.736958 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd45b9f-486a-4bfd-ae28-5baabee7b028 None admin] PATH_INFO: `/v3/users/09ce8c0b6d584400af33d8c86a3b8bba` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:52.738246 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd45b9f-486a-4bfd-ae28-5baabee7b028 None admin] RBAC: Authorizing `identity:get_user(user_id=09ce8c0b6d584400af33d8c86a3b8bba)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:49:52.739724 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd45b9f-486a-4bfd-ae28-5baabee7b028 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:49:52.741390 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 42/81] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 10 09:49:52 2022] GET /identity/v3/users/09ce8c0b6d584400af33d8c86a3b8bba => generated 275 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:49:52.742568 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02635859-6c83-4cc3-b2fb-31f826a0b4c9 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:52.742909 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02635859-6c83-4cc3-b2fb-31f826a0b4c9 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:52.743191 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02635859-6c83-4cc3-b2fb-31f826a0b4c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:52.760905 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-02635859-6c83-4cc3-b2fb-31f826a0b4c9 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:49:52.762133 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-02635859-6c83-4cc3-b2fb-31f826a0b4c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:49:52.784654 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd9bb80-6068-4852-ae90-6d73d2fb8a27 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:49:52.797806 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:49:52.819195 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e024a1e2-27ce-4d6b-a080-b747e843ef42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:49:52.820165 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e024a1e2-27ce-4d6b-a080-b747e843ef42 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:52.820447 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e024a1e2-27ce-4d6b-a080-b747e843ef42 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:52.820766 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e024a1e2-27ce-4d6b-a080-b747e843ef42 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:52.828789 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 43/82] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:49:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 09:49:52.829665 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02635859-6c83-4cc3-b2fb-31f826a0b4c9 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:49:52.875795 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:49:52.888844 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e024a1e2-27ce-4d6b-a080-b747e843ef42 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:49:52.890380 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e024a1e2-27ce-4d6b-a080-b747e843ef42 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:49:52.939351 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02635859-6c83-4cc3-b2fb-31f826a0b4c9 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:49:52.976256 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ece90b9-26b9-47ef-a7c9-52d909df786f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:49:52.976917 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ece90b9-26b9-47ef-a7c9-52d909df786f None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:52.977234 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ece90b9-26b9-47ef-a7c9-52d909df786f None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:52.977516 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ece90b9-26b9-47ef-a7c9-52d909df786f None admin] PATH_INFO: `/v3/projects/b812d355220c4d00b5c4835f163074aa` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:52.978648 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ece90b9-26b9-47ef-a7c9-52d909df786f None admin] RBAC: Authorizing `identity:get_project(project_id=b812d355220c4d00b5c4835f163074aa)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:49:52.980124 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ece90b9-26b9-47ef-a7c9-52d909df786f None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:49:52.981967 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 44/83] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 10 09:49:52 2022] GET /identity/v3/projects/b812d355220c4d00b5c4835f163074aa => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:49:52.982554 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ece90b9-26b9-47ef-a7c9-52d909df786f None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:49:53.003446 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 40/84] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 10 09:49:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 09:49:53.006158 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e024a1e2-27ce-4d6b-a080-b747e843ef42 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:49:53.019780 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:49:53.080867 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ece90b9-26b9-47ef-a7c9-52d909df786f None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:49:53.083162 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:49:53.103602 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e024a1e2-27ce-4d6b-a080-b747e843ef42 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:49:53.114132 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b98df07-d63e-4cd5-b9b8-75d57e512cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:49:53.114733 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b98df07-d63e-4cd5-b9b8-75d57e512cb3 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:53.115008 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b98df07-d63e-4cd5-b9b8-75d57e512cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:53.115280 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b98df07-d63e-4cd5-b9b8-75d57e512cb3 None admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:53.115947 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b98df07-d63e-4cd5-b9b8-75d57e512cb3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:49:53.116260 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b98df07-d63e-4cd5-b9b8-75d57e512cb3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:49:53.117780 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b98df07-d63e-4cd5-b9b8-75d57e512cb3 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:49:53.125878 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 45/85] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Aug 10 09:49:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:49:53.126808 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b98df07-d63e-4cd5-b9b8-75d57e512cb3 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:49:53.141623 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736c1584-c243-4165-90db-a1234b520cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:49:53.142240 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736c1584-c243-4165-90db-a1234b520cdc None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:53.142515 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736c1584-c243-4165-90db-a1234b520cdc None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:53.142775 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736c1584-c243-4165-90db-a1234b520cdc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:53.209354 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736c1584-c243-4165-90db-a1234b520cdc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:49:53.210837 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736c1584-c243-4165-90db-a1234b520cdc None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:49:53.223192 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b98df07-d63e-4cd5-b9b8-75d57e512cb3 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:49:53.223952 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:49:53.256630 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705adbd0-ad80-4e5e-9abc-1f74a155eea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:49:53.257290 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705adbd0-ad80-4e5e-9abc-1f74a155eea0 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:53.257571 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705adbd0-ad80-4e5e-9abc-1f74a155eea0 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:53.257837 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705adbd0-ad80-4e5e-9abc-1f74a155eea0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:53.258976 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705adbd0-ad80-4e5e-9abc-1f74a155eea0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:49:53.260432 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705adbd0-ad80-4e5e-9abc-1f74a155eea0 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:49:53.262187 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 46/86] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 10 09:49:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:49:53.262829 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705adbd0-ad80-4e5e-9abc-1f74a155eea0 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:49:53.297780 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:49:53.313558 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 41/87] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 10 09:49:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 09:49:53.314396 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736c1584-c243-4165-90db-a1234b520cdc None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:49:53.368126 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705adbd0-ad80-4e5e-9abc-1f74a155eea0 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:49:53.401327 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e475aaf-b9e2-47b0-bb3d-b5565ed1c78f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:49:53.401853 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e475aaf-b9e2-47b0-bb3d-b5565ed1c78f None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:53.402139 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e475aaf-b9e2-47b0-bb3d-b5565ed1c78f None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:53.402413 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e475aaf-b9e2-47b0-bb3d-b5565ed1c78f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:53.403121 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e475aaf-b9e2-47b0-bb3d-b5565ed1c78f None admin] RBAC: Adding query filter params (role.id=8daabcb6b7394e39b06a3453e33e32db, scope.project.id=b812d355220c4d00b5c4835f163074aa, user.id=09ce8c0b6d584400af33d8c86a3b8bba) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:49:53.403434 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e475aaf-b9e2-47b0-bb3d-b5565ed1c78f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:49:53.404903 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e475aaf-b9e2-47b0-bb3d-b5565ed1c78f None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:49:53.410558 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 47/88] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 10 09:49:53 2022] GET /identity/v3/role_assignments?user.id=09ce8c0b6d584400af33d8c86a3b8bba&scope.project.id=b812d355220c4d00b5c4835f163074aa&role.id=8daabcb6b7394e39b06a3453e33e32db => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:49:53.411328 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e475aaf-b9e2-47b0-bb3d-b5565ed1c78f None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:49:53.411655 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736c1584-c243-4165-90db-a1234b520cdc None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:49:53.433376 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:49:53.459203 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0057dc7d-3e49-4b18-9856-f3d7c77be9f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:49:53.459869 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0057dc7d-3e49-4b18-9856-f3d7c77be9f2 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:53.460152 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0057dc7d-3e49-4b18-9856-f3d7c77be9f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:53.460428 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0057dc7d-3e49-4b18-9856-f3d7c77be9f2 None admin] PATH_INFO: `/v3/projects/b812d355220c4d00b5c4835f163074aa` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:53.461737 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0057dc7d-3e49-4b18-9856-f3d7c77be9f2 None admin] RBAC: Authorizing `identity:get_project(project_id=b812d355220c4d00b5c4835f163074aa)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:49:53.463269 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0057dc7d-3e49-4b18-9856-f3d7c77be9f2 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:49:53.465244 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 42/89] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 10 09:49:53 2022] GET /identity/v3/projects/b812d355220c4d00b5c4835f163074aa => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:49:53.465860 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0057dc7d-3e49-4b18-9856-f3d7c77be9f2 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:49:53.523650 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:49:53.528037 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e475aaf-b9e2-47b0-bb3d-b5565ed1c78f None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:49:53.563376 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc72dadd-a292-487a-8744-f35a963a99cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:49:53.564043 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc72dadd-a292-487a-8744-f35a963a99cc None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:53.564327 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc72dadd-a292-487a-8744-f35a963a99cc None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:53.564607 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc72dadd-a292-487a-8744-f35a963a99cc None admin] PATH_INFO: `/v3/users/09ce8c0b6d584400af33d8c86a3b8bba` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:53.565741 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc72dadd-a292-487a-8744-f35a963a99cc None admin] RBAC: Authorizing `identity:get_user(user_id=09ce8c0b6d584400af33d8c86a3b8bba)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:49:53.567234 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc72dadd-a292-487a-8744-f35a963a99cc None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:49:53.568840 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 48/90] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 10 09:49:53 2022] GET /identity/v3/users/09ce8c0b6d584400af33d8c86a3b8bba => generated 275 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:49:53.569993 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc72dadd-a292-487a-8744-f35a963a99cc None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:49:53.584137 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0057dc7d-3e49-4b18-9856-f3d7c77be9f2 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:49:53.619104 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ca21c3-ac2f-495a-bb93-c26970a308e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:49:53.619717 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ca21c3-ac2f-495a-bb93-c26970a308e6 None admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:53.619997 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ca21c3-ac2f-495a-bb93-c26970a308e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:53.620271 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ca21c3-ac2f-495a-bb93-c26970a308e6 None admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:53.620929 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ca21c3-ac2f-495a-bb93-c26970a308e6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:49:53.622419 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ca21c3-ac2f-495a-bb93-c26970a308e6 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:49:53.651292 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 43/91] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Aug 10 09:49:53 2022] POST /identity/v3/users => generated 289 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 09:49:53.652194 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ca21c3-ac2f-495a-bb93-c26970a308e6 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:49:53.695948 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc72dadd-a292-487a-8744-f35a963a99cc None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:49:53.722325 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:49:53.745230 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb98467-c74b-49af-a55c-2cd26961697c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:49:53.745852 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb98467-c74b-49af-a55c-2cd26961697c None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:53.746189 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb98467-c74b-49af-a55c-2cd26961697c None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:53.746469 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb98467-c74b-49af-a55c-2cd26961697c None admin] PATH_INFO: `/v3/projects/b812d355220c4d00b5c4835f163074aa` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:53.747764 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb98467-c74b-49af-a55c-2cd26961697c None admin] RBAC: Authorizing `identity:get_project(project_id=b812d355220c4d00b5c4835f163074aa)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:49:53.749622 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb98467-c74b-49af-a55c-2cd26961697c None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:49:53.756930 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 49/92] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 10 09:49:53 2022] GET /identity/v3/projects/b812d355220c4d00b5c4835f163074aa => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:49:53.758125 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb98467-c74b-49af-a55c-2cd26961697c None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:49:53.798955 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:49:53.822216 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ca21c3-ac2f-495a-bb93-c26970a308e6 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:49:53.863438 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a1b79a-1c81-45f6-8716-4a6c7a206333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:49:53.864342 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a1b79a-1c81-45f6-8716-4a6c7a206333 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:53.864791 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a1b79a-1c81-45f6-8716-4a6c7a206333 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:53.865110 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a1b79a-1c81-45f6-8716-4a6c7a206333 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:53.865865 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a1b79a-1c81-45f6-8716-4a6c7a206333 None admin] RBAC: Adding query filter params (role.id=eb04edc46b3742d7a0f0ead26f68bc22, scope.project.id=b812d355220c4d00b5c4835f163074aa, user.id=68006355826841798d09dd7cab67ec78) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:49:53.866351 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a1b79a-1c81-45f6-8716-4a6c7a206333 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:49:53.867912 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a1b79a-1c81-45f6-8716-4a6c7a206333 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:49:53.877000 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 44/93] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 10 09:49:53 2022] GET /identity/v3/role_assignments?user.id=68006355826841798d09dd7cab67ec78&scope.project.id=b812d355220c4d00b5c4835f163074aa&role.id=eb04edc46b3742d7a0f0ead26f68bc22 => generated 259 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:49:53.877919 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a1b79a-1c81-45f6-8716-4a6c7a206333 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:49:53.899622 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb98467-c74b-49af-a55c-2cd26961697c None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:49:53.942864 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5fd37c-b4d9-422c-811a-a0f354156be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:49:53.943437 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5fd37c-b4d9-422c-811a-a0f354156be5 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:53.944348 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5fd37c-b4d9-422c-811a-a0f354156be5 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:53.945001 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5fd37c-b4d9-422c-811a-a0f354156be5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:54.017461 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:49:54.023440 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a1b79a-1c81-45f6-8716-4a6c7a206333 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:49:54.063525 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5fd37c-b4d9-422c-811a-a0f354156be5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:49:54.065490 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5fd37c-b4d9-422c-811a-a0f354156be5 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:49:54.075786 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7d904e-c05f-4f18-83b7-443adc8ae42a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:49:54.076733 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7d904e-c05f-4f18-83b7-443adc8ae42a None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:54.076858 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7d904e-c05f-4f18-83b7-443adc8ae42a None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:54.077098 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7d904e-c05f-4f18-83b7-443adc8ae42a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:54.077853 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7d904e-c05f-4f18-83b7-443adc8ae42a None admin] RBAC: Adding query filter params (role.id=5d80017a50774daba0c1fee326754295, scope.project.id=b812d355220c4d00b5c4835f163074aa, user.id=09ce8c0b6d584400af33d8c86a3b8bba) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:49:54.078175 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7d904e-c05f-4f18-83b7-443adc8ae42a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:49:54.080109 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7d904e-c05f-4f18-83b7-443adc8ae42a None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:49:54.086859 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 45/94] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 10 09:49:53 2022] GET /identity/v3/role_assignments?user.id=09ce8c0b6d584400af33d8c86a3b8bba&scope.project.id=b812d355220c4d00b5c4835f163074aa&role.id=5d80017a50774daba0c1fee326754295 => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:49:54.109416 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:49:54.188383 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 50/95] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 10 09:49:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 09:49:54.194273 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7d904e-c05f-4f18-83b7-443adc8ae42a None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:49:54.315974 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7d904e-c05f-4f18-83b7-443adc8ae42a None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:49:54.360597 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe330b4-72ff-4ae3-a74f-bb684d6a6dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:49:54.361297 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe330b4-72ff-4ae3-a74f-bb684d6a6dc1 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:54.361585 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe330b4-72ff-4ae3-a74f-bb684d6a6dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:54.361867 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe330b4-72ff-4ae3-a74f-bb684d6a6dc1 None admin] PATH_INFO: `/v3/projects/0ec9f428129e464b94bde0ecb73fe27d` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:54.363139 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe330b4-72ff-4ae3-a74f-bb684d6a6dc1 None admin] RBAC: Authorizing `identity:get_project(project_id=0ec9f428129e464b94bde0ecb73fe27d)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:49:54.364663 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe330b4-72ff-4ae3-a74f-bb684d6a6dc1 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:49:54.366758 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 46/96] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 10 09:49:54 2022] GET /identity/v3/projects/0ec9f428129e464b94bde0ecb73fe27d => generated 312 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:49:54.373504 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5fd37c-b4d9-422c-811a-a0f354156be5 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:49:54.514084 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5fd37c-b4d9-422c-811a-a0f354156be5 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:49:54.566931 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7550bbb-7272-43e5-905a-ebbfd4c63ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:49:54.567928 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7550bbb-7272-43e5-905a-ebbfd4c63ea1 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:54.568421 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7550bbb-7272-43e5-905a-ebbfd4c63ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:54.568882 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7550bbb-7272-43e5-905a-ebbfd4c63ea1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:54.570193 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7550bbb-7272-43e5-905a-ebbfd4c63ea1 None admin] RBAC: Adding query filter params (role.id=8daabcb6b7394e39b06a3453e33e32db, scope.project.id=0ec9f428129e464b94bde0ecb73fe27d, user.id=09ce8c0b6d584400af33d8c86a3b8bba) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:49:54.570752 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7550bbb-7272-43e5-905a-ebbfd4c63ea1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:49:54.572395 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7550bbb-7272-43e5-905a-ebbfd4c63ea1 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:49:54.574565 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:49:54.585351 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 51/97] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 10 09:49:54 2022] GET /identity/v3/role_assignments?user.id=09ce8c0b6d584400af33d8c86a3b8bba&scope.project.id=0ec9f428129e464b94bde0ecb73fe27d&role.id=8daabcb6b7394e39b06a3453e33e32db => generated 259 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:49:56.616856 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139e6be8-5f32-4bf3-83c6-9dac7586025e None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:56.617456 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139e6be8-5f32-4bf3-83c6-9dac7586025e None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:56.617564 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139e6be8-5f32-4bf3-83c6-9dac7586025e None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:56.618891 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 47/98] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:49:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:49:56.624266 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be6e96b-c9e3-48ef-97f1-73cc4aa2eba0 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:56.624687 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be6e96b-c9e3-48ef-97f1-73cc4aa2eba0 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:56.624858 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be6e96b-c9e3-48ef-97f1-73cc4aa2eba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:56.647931 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13432b6f-e5c6-41d4-bd0c-c27b90661cad None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:56.648240 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13432b6f-e5c6-41d4-bd0c-c27b90661cad None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:56.648485 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13432b6f-e5c6-41d4-bd0c-c27b90661cad None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:56.649920 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 48/99] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:49:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:49:56.654927 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4042b42f-3ba4-4ef2-8828-c3052c92c0d7 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:56.655201 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4042b42f-3ba4-4ef2-8828-c3052c92c0d7 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:56.655474 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4042b42f-3ba4-4ef2-8828-c3052c92c0d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:56.666657 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-7be6e96b-c9e3-48ef-97f1-73cc4aa2eba0 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:49:56.667874 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-7be6e96b-c9e3-48ef-97f1-73cc4aa2eba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:49:56.686888 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-4042b42f-3ba4-4ef2-8828-c3052c92c0d7 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:49:56.688084 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-4042b42f-3ba4-4ef2-8828-c3052c92c0d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:49:56.715908 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:49:56.799542 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 49/100] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:49:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 09:49:56.801261 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4bdd6b-8017-46c1-a095-3c9f202e6cab None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:56.801685 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4bdd6b-8017-46c1-a095-3c9f202e6cab None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:56.802092 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4bdd6b-8017-46c1-a095-3c9f202e6cab None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:56.804019 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 50/101] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:49:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:49:56.809346 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c987ba45-d2c4-4f0f-94f5-92fd9e332e4d None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:56.809626 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c987ba45-d2c4-4f0f-94f5-92fd9e332e4d None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:56.809902 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c987ba45-d2c4-4f0f-94f5-92fd9e332e4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:56.815751 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 52/102] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:49:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 09:49:56.831776 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-c987ba45-d2c4-4f0f-94f5-92fd9e332e4d None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:49:56.833252 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-c987ba45-d2c4-4f0f-94f5-92fd9e332e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:49:56.834440 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be6e96b-c9e3-48ef-97f1-73cc4aa2eba0 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:49:56.969615 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 51/103] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:49:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 09:49:56.970491 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c987ba45-d2c4-4f0f-94f5-92fd9e332e4d None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:49:57.004842 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be6e96b-c9e3-48ef-97f1-73cc4aa2eba0 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:49:57.071770 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:49:57.074056 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1be4958-13a1-4d89-afe4-b13b7b59db1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:49:57.074702 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1be4958-13a1-4d89-afe4-b13b7b59db1a None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:57.075227 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1be4958-13a1-4d89-afe4-b13b7b59db1a None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:57.075227 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1be4958-13a1-4d89-afe4-b13b7b59db1a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:57.098305 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1be4958-13a1-4d89-afe4-b13b7b59db1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 09:49:57.112164 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-b1be4958-13a1-4d89-afe4-b13b7b59db1a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 09:49:57.112164 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:49:57.112164 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:49:57.112164 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:49:57.112164 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:49:57.112164 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:49:57.112164 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:49:57.112164 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:49:57.112164 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:49:57.112164 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:49:57.112164 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:49:57.112164 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:49:57.112164 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 09:49:57.112164 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 09:49:57.112164 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 09:49:57.112164 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 09:49:57.113616 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 09:49:57.113616 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 09:49:57.113616 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 09:49:57.113616 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 09:49:57.113616 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:49:57.113616 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:49:57.113616 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:49:57.113616 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:49:57.113616 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:49:57.113616 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:49:57.113616 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:49:57.113616 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:49:57.113616 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:49:57.113616 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:49:57.113616 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:49:57.113616 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:49:57.114351 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:49:57.114351 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:49:57.114351 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:49:57.114351 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:49:57.114351 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 09:49:57.114351 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 09:49:57.114351 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 09:49:57.114351 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 09:49:57.114351 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 09:49:57.114351 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 09:49:57.114351 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 09:49:57.114351 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:49:57.114351 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 53/104] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 10 09:49:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 09:49:57.114351 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1be4958-13a1-4d89-afe4-b13b7b59db1a None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:49:57.142947 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:49:57.159726 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c987ba45-d2c4-4f0f-94f5-92fd9e332e4d None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:49:57.204791 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4fc61a-f12b-4011-9ec0-4cfc2f6fc87c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:49:57.206004 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4fc61a-f12b-4011-9ec0-4cfc2f6fc87c None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:57.206767 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4fc61a-f12b-4011-9ec0-4cfc2f6fc87c None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:57.207245 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4fc61a-f12b-4011-9ec0-4cfc2f6fc87c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:57.221178 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4fc61a-f12b-4011-9ec0-4cfc2f6fc87c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 09:49:57.222158 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1be4958-13a1-4d89-afe4-b13b7b59db1a None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:49:57.227581 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-bb4fc61a-f12b-4011-9ec0-4cfc2f6fc87c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 09:49:57.227581 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:49:57.227581 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:49:57.227581 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:49:57.227581 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:49:57.227581 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:49:57.227581 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:49:57.227581 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:49:57.227581 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:49:57.227581 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:49:57.227581 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:49:57.227581 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:49:57.227581 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 09:49:57.227581 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 09:49:57.227581 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 09:49:57.227581 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 09:49:57.228410 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 09:49:57.228410 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 09:49:57.228410 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 09:49:57.228410 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 09:49:57.228410 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:49:57.228410 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:49:57.228410 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:49:57.228410 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:49:57.228410 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:49:57.228410 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:49:57.228410 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:49:57.228410 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:49:57.228410 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:49:57.228410 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:49:57.228410 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:49:57.228410 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:49:57.229579 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:49:57.229579 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:49:57.229579 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:49:57.229579 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:49:57.229579 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 09:49:57.229579 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 09:49:57.229579 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 09:49:57.229579 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 09:49:57.229579 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 09:49:57.229579 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 09:49:57.229579 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 09:49:57.229579 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:49:57.232075 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 52/105] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Aug 10 09:49:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:49:57.234707 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d9d8f9-81b1-4b2d-87f3-621ecf09ec03 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:57.235355 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d9d8f9-81b1-4b2d-87f3-621ecf09ec03 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:57.235936 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d9d8f9-81b1-4b2d-87f3-621ecf09ec03 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:57.237751 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 53/106] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:49:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:49:57.238361 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d9d8f9-81b1-4b2d-87f3-621ecf09ec03 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:49:57.272119 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361a06ac-509b-422e-8ea0-75773fbcecaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:49:57.272861 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361a06ac-509b-422e-8ea0-75773fbcecaf None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:57.273307 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361a06ac-509b-422e-8ea0-75773fbcecaf None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:57.273608 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361a06ac-509b-422e-8ea0-75773fbcecaf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:57.285316 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361a06ac-509b-422e-8ea0-75773fbcecaf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 09:49:57.290549 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-361a06ac-509b-422e-8ea0-75773fbcecaf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 09:49:57.290549 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:49:57.290549 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:49:57.290549 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:49:57.290549 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:49:57.290549 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:49:57.290549 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:49:57.290549 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:49:57.290549 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:49:57.290549 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:49:57.290549 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:49:57.290549 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:49:57.290549 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 09:49:57.290549 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 09:49:57.290549 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 09:49:57.290549 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 09:49:57.291435 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 09:49:57.291435 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 09:49:57.291435 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 09:49:57.291435 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 09:49:57.291435 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:49:57.291435 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:49:57.291435 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:49:57.291435 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:49:57.291435 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:49:57.291435 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:49:57.291435 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:49:57.291435 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:49:57.291435 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:49:57.291435 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:49:57.291435 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:49:57.291435 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:49:57.292171 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:49:57.292171 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:49:57.292171 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:49:57.292171 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:49:57.292171 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 09:49:57.292171 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 09:49:57.292171 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 09:49:57.292171 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 09:49:57.292171 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 09:49:57.292171 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 09:49:57.292171 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 09:49:57.292171 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:49:57.292171 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 54/107] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 10 09:49:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:49:57.293597 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361a06ac-509b-422e-8ea0-75773fbcecaf None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:49:57.345999 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:49:57.357360 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d9d8f9-81b1-4b2d-87f3-621ecf09ec03 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:49:57.396336 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5474de-f821-4247-899c-7a4597dc77b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:49:57.396955 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5474de-f821-4247-899c-7a4597dc77b7 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:57.397265 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5474de-f821-4247-899c-7a4597dc77b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:57.397511 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361a06ac-509b-422e-8ea0-75773fbcecaf None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:49:57.397609 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5474de-f821-4247-899c-7a4597dc77b7 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:57.398201 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5474de-f821-4247-899c-7a4597dc77b7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:49:57.398545 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5474de-f821-4247-899c-7a4597dc77b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:49:57.400372 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5474de-f821-4247-899c-7a4597dc77b7 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:49:57.409112 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 54/108] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Aug 10 09:49:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:49:57.410361 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24ae51f-25e9-4158-89fd-1b0e78faf4b0 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:57.410649 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24ae51f-25e9-4158-89fd-1b0e78faf4b0 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:57.410926 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24ae51f-25e9-4158-89fd-1b0e78faf4b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:57.429535 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-f24ae51f-25e9-4158-89fd-1b0e78faf4b0 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:49:57.430937 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-f24ae51f-25e9-4158-89fd-1b0e78faf4b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:49:57.436966 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69feb8bc-e90a-4895-b188-0c734dc18132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:49:57.437626 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69feb8bc-e90a-4895-b188-0c734dc18132 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:57.437908 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69feb8bc-e90a-4895-b188-0c734dc18132 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:57.438239 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69feb8bc-e90a-4895-b188-0c734dc18132 None admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:57.438924 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69feb8bc-e90a-4895-b188-0c734dc18132 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:49:57.439280 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69feb8bc-e90a-4895-b188-0c734dc18132 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:49:57.440691 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69feb8bc-e90a-4895-b188-0c734dc18132 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:49:57.441580 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:49:57.455617 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 55/109] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 10 09:49:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:49:57.456898 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d1d311-cd94-4557-95c8-1fd1d8055f8b None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:57.457231 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d1d311-cd94-4557-95c8-1fd1d8055f8b None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:57.457494 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d1d311-cd94-4557-95c8-1fd1d8055f8b None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:57.458824 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 56/110] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:49:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:49:57.461301 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d1d311-cd94-4557-95c8-1fd1d8055f8b None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:49:57.511254 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 55/111] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:49:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 09:49:57.512044 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24ae51f-25e9-4158-89fd-1b0e78faf4b0 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:49:57.577645 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d1d311-cd94-4557-95c8-1fd1d8055f8b None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:49:57.588082 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:49:57.607998 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24ae51f-25e9-4158-89fd-1b0e78faf4b0 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:49:57.612204 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617bf1e8-37e7-4c7b-a720-233137d6ddff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:49:57.612822 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617bf1e8-37e7-4c7b-a720-233137d6ddff None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:57.613135 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617bf1e8-37e7-4c7b-a720-233137d6ddff None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:57.613434 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617bf1e8-37e7-4c7b-a720-233137d6ddff None admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:57.614100 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617bf1e8-37e7-4c7b-a720-233137d6ddff None admin] RBAC: Adding query filter params (name=reader) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:49:57.614404 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617bf1e8-37e7-4c7b-a720-233137d6ddff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:49:57.615809 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617bf1e8-37e7-4c7b-a720-233137d6ddff None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:49:57.623915 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 57/112] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Aug 10 09:49:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:49:57.624693 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617bf1e8-37e7-4c7b-a720-233137d6ddff None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:49:57.647497 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f5dd76-ed25-4318-b229-c8bc10e7dc7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:49:57.648130 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f5dd76-ed25-4318-b229-c8bc10e7dc7e None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:57.648415 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f5dd76-ed25-4318-b229-c8bc10e7dc7e None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:57.648750 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f5dd76-ed25-4318-b229-c8bc10e7dc7e None admin] PATH_INFO: `/v3/users/09ce8c0b6d584400af33d8c86a3b8bba` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:57.649907 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f5dd76-ed25-4318-b229-c8bc10e7dc7e None admin] RBAC: Authorizing `identity:get_user(user_id=09ce8c0b6d584400af33d8c86a3b8bba)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:49:57.651375 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f5dd76-ed25-4318-b229-c8bc10e7dc7e None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:49:57.652965 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 56/113] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 10 09:49:57 2022] GET /identity/v3/users/09ce8c0b6d584400af33d8c86a3b8bba => generated 275 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:49:57.654095 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dcd3c2-b27f-4373-9c20-950d9aa19b01 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:57.654379 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dcd3c2-b27f-4373-9c20-950d9aa19b01 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:57.654665 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dcd3c2-b27f-4373-9c20-950d9aa19b01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:57.671720 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-80dcd3c2-b27f-4373-9c20-950d9aa19b01 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:49:57.672914 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-80dcd3c2-b27f-4373-9c20-950d9aa19b01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:49:57.682579 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:49:57.723504 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617bf1e8-37e7-4c7b-a720-233137d6ddff None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:49:57.740697 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 57/114] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:49:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 09:49:57.747149 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dee2361-b23c-42e9-8c92-ca4bfed15288 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:57.747149 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dee2361-b23c-42e9-8c92-ca4bfed15288 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:57.747149 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dee2361-b23c-42e9-8c92-ca4bfed15288 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:57.747149 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 58/115] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:49:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:49:57.747149 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dee2361-b23c-42e9-8c92-ca4bfed15288 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:49:57.763210 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d399598-5dba-42ac-a11c-25f7b8e119e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:49:57.763783 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d399598-5dba-42ac-a11c-25f7b8e119e4 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:57.764067 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d399598-5dba-42ac-a11c-25f7b8e119e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:57.764352 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d399598-5dba-42ac-a11c-25f7b8e119e4 None admin] PATH_INFO: `/v3/users/68006355826841798d09dd7cab67ec78` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:57.765575 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d399598-5dba-42ac-a11c-25f7b8e119e4 None admin] RBAC: Authorizing `identity:get_user(user_id=68006355826841798d09dd7cab67ec78)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:49:57.767064 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d399598-5dba-42ac-a11c-25f7b8e119e4 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:49:57.768685 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 58/116] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 10 09:49:57 2022] GET /identity/v3/users/68006355826841798d09dd7cab67ec78 => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:49:57.769463 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d399598-5dba-42ac-a11c-25f7b8e119e4 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:49:57.811031 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:49:57.858034 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dee2361-b23c-42e9-8c92-ca4bfed15288 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:49:57.872158 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d399598-5dba-42ac-a11c-25f7b8e119e4 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:49:57.892383 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9916aa60-6535-4816-9465-43ac6c5865f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:49:57.893016 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9916aa60-6535-4816-9465-43ac6c5865f6 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:57.893330 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9916aa60-6535-4816-9465-43ac6c5865f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:57.893603 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9916aa60-6535-4816-9465-43ac6c5865f6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:57.904317 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9916aa60-6535-4816-9465-43ac6c5865f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 09:49:57.905731 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d611689f-d740-4d29-87f9-63cd2c9fa4dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:49:57.906379 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d611689f-d740-4d29-87f9-63cd2c9fa4dc None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:57.906659 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d611689f-d740-4d29-87f9-63cd2c9fa4dc None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:57.906933 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d611689f-d740-4d29-87f9-63cd2c9fa4dc None admin] PATH_INFO: `/v3/users/3c0f486722054cd5a2f88cca1e4ab1de` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:57.909091 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-9916aa60-6535-4816-9465-43ac6c5865f6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 09:49:57.909091 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:49:57.909091 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:49:57.909091 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:49:57.909091 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:49:57.909091 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:49:57.909091 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:49:57.909091 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:49:57.909091 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:49:57.909091 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:49:57.909091 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:49:57.909091 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:49:57.909091 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 09:49:57.909091 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 09:49:57.909091 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 09:49:57.909091 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 09:49:57.909961 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 09:49:57.909961 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 09:49:57.909961 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 09:49:57.909961 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 09:49:57.909961 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:49:57.909961 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:49:57.909961 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:49:57.909961 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:49:57.909961 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:49:57.909961 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:49:57.909961 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:49:57.909961 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:49:57.909961 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:49:57.909961 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:49:57.909961 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:49:57.909961 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:49:57.915840 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:49:57.915840 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:49:57.915840 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:49:57.915840 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:49:57.915840 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 09:49:57.915840 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 09:49:57.915840 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 09:49:57.915840 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 09:49:57.915840 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 09:49:57.915840 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 09:49:57.915840 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 09:49:57.915840 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:49:57.915840 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 59/117] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Aug 10 09:49:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:49:57.915840 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9916aa60-6535-4816-9465-43ac6c5865f6 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:49:57.916515 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:49:57.920791 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d611689f-d740-4d29-87f9-63cd2c9fa4dc None admin] RBAC: Authorizing `identity:get_user(user_id=3c0f486722054cd5a2f88cca1e4ab1de)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:49:57.922314 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d611689f-d740-4d29-87f9-63cd2c9fa4dc None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:49:57.923988 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 59/118] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 10 09:49:57 2022] GET /identity/v3/users/3c0f486722054cd5a2f88cca1e4ab1de => generated 289 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:49:57.925153 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3750985-1c36-4a56-ad04-51792dc985db None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:57.925439 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3750985-1c36-4a56-ad04-51792dc985db None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:57.925714 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3750985-1c36-4a56-ad04-51792dc985db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:57.943273 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-d3750985-1c36-4a56-ad04-51792dc985db None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:49:57.944477 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-d3750985-1c36-4a56-ad04-51792dc985db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:49:58.008904 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 60/119] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:49:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 09:49:58.009748 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3750985-1c36-4a56-ad04-51792dc985db None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:49:58.022805 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9916aa60-6535-4816-9465-43ac6c5865f6 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:49:58.038056 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:49:58.058278 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b6cabc-58bc-4ea0-8190-38a8130cfb83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:49:58.058912 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b6cabc-58bc-4ea0-8190-38a8130cfb83 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:58.059192 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b6cabc-58bc-4ea0-8190-38a8130cfb83 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:58.059463 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b6cabc-58bc-4ea0-8190-38a8130cfb83 None admin] PATH_INFO: `/v3/projects/b812d355220c4d00b5c4835f163074aa` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:58.060596 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b6cabc-58bc-4ea0-8190-38a8130cfb83 None admin] RBAC: Authorizing `identity:get_project(project_id=b812d355220c4d00b5c4835f163074aa)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:49:58.062116 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b6cabc-58bc-4ea0-8190-38a8130cfb83 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:49:58.063753 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 60/120] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 10 09:49:57 2022] GET /identity/v3/projects/b812d355220c4d00b5c4835f163074aa => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:49:58.064613 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b6cabc-58bc-4ea0-8190-38a8130cfb83 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:49:58.109031 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3750985-1c36-4a56-ad04-51792dc985db None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:49:58.134574 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:49:58.143492 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a09ff2b-d767-42bf-9878-3ae601f166a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:49:58.144156 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a09ff2b-d767-42bf-9878-3ae601f166a8 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:58.144433 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a09ff2b-d767-42bf-9878-3ae601f166a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:58.144704 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a09ff2b-d767-42bf-9878-3ae601f166a8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:58.156321 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a09ff2b-d767-42bf-9878-3ae601f166a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 09:49:58.161086 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-5a09ff2b-d767-42bf-9878-3ae601f166a8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 09:49:58.161086 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:49:58.161086 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:49:58.161086 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:49:58.161086 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:49:58.161086 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:49:58.161086 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:49:58.161086 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:49:58.161086 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:49:58.161086 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:49:58.161086 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:49:58.161086 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:49:58.161086 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 09:49:58.161086 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 09:49:58.161086 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 09:49:58.161086 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 09:49:58.162113 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 09:49:58.162113 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 09:49:58.162113 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 09:49:58.162113 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 09:49:58.162113 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:49:58.162113 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:49:58.162113 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:49:58.162113 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:49:58.162113 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:49:58.162113 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:49:58.162113 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:49:58.162113 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:49:58.162113 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:49:58.162113 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:49:58.162113 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:49:58.162113 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:49:58.168158 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:49:58.168158 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:49:58.168158 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:49:58.168158 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:49:58.168158 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 09:49:58.168158 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 09:49:58.168158 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 09:49:58.168158 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 09:49:58.168158 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 09:49:58.168158 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 09:49:58.168158 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 09:49:58.168158 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:49:58.168158 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 61/121] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 10 09:49:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:49:58.168158 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a09ff2b-d767-42bf-9878-3ae601f166a8 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:49:58.175406 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b6cabc-58bc-4ea0-8190-38a8130cfb83 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:49:58.215236 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e13d33-f634-4475-95a6-254e0539767a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:49:58.215883 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e13d33-f634-4475-95a6-254e0539767a None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:58.216167 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e13d33-f634-4475-95a6-254e0539767a None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:58.216445 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e13d33-f634-4475-95a6-254e0539767a None admin] PATH_INFO: `/v3/projects/b812d355220c4d00b5c4835f163074aa` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:58.217614 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e13d33-f634-4475-95a6-254e0539767a None admin] RBAC: Authorizing `identity:get_project(project_id=b812d355220c4d00b5c4835f163074aa)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:49:58.219113 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e13d33-f634-4475-95a6-254e0539767a None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:49:58.221011 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 61/122] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 10 09:49:58 2022] GET /identity/v3/projects/b812d355220c4d00b5c4835f163074aa => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:49:58.221608 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e13d33-f634-4475-95a6-254e0539767a None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:49:58.251617 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:49:58.266067 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a09ff2b-d767-42bf-9878-3ae601f166a8 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:49:58.300109 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6727538f-efdc-4a20-acae-282cb5a2c6ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:49:58.300656 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6727538f-efdc-4a20-acae-282cb5a2c6ad None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:58.300938 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6727538f-efdc-4a20-acae-282cb5a2c6ad None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:58.301244 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6727538f-efdc-4a20-acae-282cb5a2c6ad None admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:58.301920 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6727538f-efdc-4a20-acae-282cb5a2c6ad None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:49:58.302227 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6727538f-efdc-4a20-acae-282cb5a2c6ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:49:58.303644 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6727538f-efdc-4a20-acae-282cb5a2c6ad None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:49:58.311399 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 62/123] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 10 09:49:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:49:58.313966 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6727538f-efdc-4a20-acae-282cb5a2c6ad None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:49:58.318391 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e13d33-f634-4475-95a6-254e0539767a None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:49:58.353649 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1ac25e-ddb6-4af0-ad5c-5d5b892e4086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:49:58.354272 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1ac25e-ddb6-4af0-ad5c-5d5b892e4086 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:58.354558 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1ac25e-ddb6-4af0-ad5c-5d5b892e4086 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:58.354834 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1ac25e-ddb6-4af0-ad5c-5d5b892e4086 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:58.362823 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:49:58.409675 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6727538f-efdc-4a20-acae-282cb5a2c6ad None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:49:58.422239 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1ac25e-ddb6-4af0-ad5c-5d5b892e4086 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:49:58.423760 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1ac25e-ddb6-4af0-ad5c-5d5b892e4086 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:49:58.441978 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc64f24c-ede7-47f6-9829-7bfd3c56a796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:49:58.442613 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc64f24c-ede7-47f6-9829-7bfd3c56a796 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:58.442894 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc64f24c-ede7-47f6-9829-7bfd3c56a796 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:58.443171 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc64f24c-ede7-47f6-9829-7bfd3c56a796 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:58.444297 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc64f24c-ede7-47f6-9829-7bfd3c56a796 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:49:58.446174 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc64f24c-ede7-47f6-9829-7bfd3c56a796 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:49:58.447805 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 63/124] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 10 09:49:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:49:58.448538 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc64f24c-ede7-47f6-9829-7bfd3c56a796 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:49:58.467055 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:49:58.532705 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 62/125] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 10 09:49:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 09:49:58.532705 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1ac25e-ddb6-4af0-ad5c-5d5b892e4086 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:49:58.546094 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc64f24c-ede7-47f6-9829-7bfd3c56a796 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:49:58.571852 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:49:58.579643 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7841e2-d580-4f8f-b884-41bd7ce79548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:49:58.580314 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7841e2-d580-4f8f-b884-41bd7ce79548 None admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:58.580597 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7841e2-d580-4f8f-b884-41bd7ce79548 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:58.580870 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7841e2-d580-4f8f-b884-41bd7ce79548 None admin] PATH_INFO: `/v3/projects/b812d355220c4d00b5c4835f163074aa/users/09ce8c0b6d584400af33d8c86a3b8bba/roles/8daabcb6b7394e39b06a3453e33e32db` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:58.582865 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7841e2-d580-4f8f-b884-41bd7ce79548 None admin] RBAC: Authorizing `identity:create_grant(project_id=b812d355220c4d00b5c4835f163074aa, user_id=09ce8c0b6d584400af33d8c86a3b8bba, role_id=8daabcb6b7394e39b06a3453e33e32db)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:49:58.584348 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7841e2-d580-4f8f-b884-41bd7ce79548 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:49:58.599085 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 64/126] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Aug 10 09:49:58 2022] PUT /identity/v3/projects/b812d355220c4d00b5c4835f163074aa/users/09ce8c0b6d584400af33d8c86a3b8bba/roles/8daabcb6b7394e39b06a3453e33e32db => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 09:49:58.605191 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7841e2-d580-4f8f-b884-41bd7ce79548 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:49:58.650352 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1ac25e-ddb6-4af0-ad5c-5d5b892e4086 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:49:58.693919 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:49:58.698885 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405e3676-754a-4ea6-a03a-5c24641e0d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:49:58.699605 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e3676-754a-4ea6-a03a-5c24641e0d8d None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:58.699971 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e3676-754a-4ea6-a03a-5c24641e0d8d None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:58.700340 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e3676-754a-4ea6-a03a-5c24641e0d8d None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:58.701393 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405e3676-754a-4ea6-a03a-5c24641e0d8d None admin] RBAC: Adding query filter params (name=member) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:49:58.701837 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405e3676-754a-4ea6-a03a-5c24641e0d8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:49:58.703350 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405e3676-754a-4ea6-a03a-5c24641e0d8d None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:49:58.712270 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 63/127] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Aug 10 09:49:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:49:58.713179 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405e3676-754a-4ea6-a03a-5c24641e0d8d None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:49:58.726376 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7841e2-d580-4f8f-b884-41bd7ce79548 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:49:58.768986 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a194c9f8-67f3-4575-a4fd-927eae738177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:49:58.769671 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a194c9f8-67f3-4575-a4fd-927eae738177 None admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:58.769956 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a194c9f8-67f3-4575-a4fd-927eae738177 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:58.770245 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a194c9f8-67f3-4575-a4fd-927eae738177 None admin] PATH_INFO: `/v3/projects/b812d355220c4d00b5c4835f163074aa/users/68006355826841798d09dd7cab67ec78/roles/eb04edc46b3742d7a0f0ead26f68bc22` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:58.772178 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a194c9f8-67f3-4575-a4fd-927eae738177 None admin] RBAC: Authorizing `identity:create_grant(project_id=b812d355220c4d00b5c4835f163074aa, user_id=68006355826841798d09dd7cab67ec78, role_id=eb04edc46b3742d7a0f0ead26f68bc22)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:49:58.773811 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a194c9f8-67f3-4575-a4fd-927eae738177 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:49:58.788102 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 65/128] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Aug 10 09:49:58 2022] PUT /identity/v3/projects/b812d355220c4d00b5c4835f163074aa/users/68006355826841798d09dd7cab67ec78/roles/eb04edc46b3742d7a0f0ead26f68bc22 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 09:49:58.789338 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a194c9f8-67f3-4575-a4fd-927eae738177 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:49:58.851870 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:49:58.858776 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405e3676-754a-4ea6-a03a-5c24641e0d8d None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:49:58.897510 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95942da7-b19c-4146-bfbf-35d82d848e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:49:58.898456 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95942da7-b19c-4146-bfbf-35d82d848e48 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:58.899125 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95942da7-b19c-4146-bfbf-35d82d848e48 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:58.899544 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95942da7-b19c-4146-bfbf-35d82d848e48 None admin] PATH_INFO: `/v3/users/09ce8c0b6d584400af33d8c86a3b8bba` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:58.900932 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95942da7-b19c-4146-bfbf-35d82d848e48 None admin] RBAC: Authorizing `identity:get_user(user_id=09ce8c0b6d584400af33d8c86a3b8bba)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:49:58.902634 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95942da7-b19c-4146-bfbf-35d82d848e48 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:49:58.904603 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 64/129] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 10 09:49:58 2022] GET /identity/v3/users/09ce8c0b6d584400af33d8c86a3b8bba => generated 275 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:49:58.905784 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95942da7-b19c-4146-bfbf-35d82d848e48 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:49:58.920857 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a194c9f8-67f3-4575-a4fd-927eae738177 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:49:58.971410 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4810e70-a872-427b-920e-c62e256bf590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:49:58.972243 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4810e70-a872-427b-920e-c62e256bf590 None admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:58.972852 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4810e70-a872-427b-920e-c62e256bf590 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:58.973240 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4810e70-a872-427b-920e-c62e256bf590 None admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:58.974429 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4810e70-a872-427b-920e-c62e256bf590 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:49:58.976371 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4810e70-a872-427b-920e-c62e256bf590 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:49:58.992525 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:49:59.015561 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 66/130] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Aug 10 09:49:58 2022] POST /identity/v3/projects => generated 302 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 09:49:59.015561 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4810e70-a872-427b-920e-c62e256bf590 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:49:59.040482 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95942da7-b19c-4146-bfbf-35d82d848e48 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:49:59.118937 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e36aa1a-e0ee-4516-a17b-80c8055722b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:49:59.119972 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e36aa1a-e0ee-4516-a17b-80c8055722b2 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:59.120399 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e36aa1a-e0ee-4516-a17b-80c8055722b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:59.120844 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e36aa1a-e0ee-4516-a17b-80c8055722b2 None admin] PATH_INFO: `/v3/projects/b812d355220c4d00b5c4835f163074aa` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:59.128948 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e36aa1a-e0ee-4516-a17b-80c8055722b2 None admin] RBAC: Authorizing `identity:get_project(project_id=b812d355220c4d00b5c4835f163074aa)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:49:59.130739 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e36aa1a-e0ee-4516-a17b-80c8055722b2 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:49:59.137844 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 65/131] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 10 09:49:58 2022] GET /identity/v3/projects/b812d355220c4d00b5c4835f163074aa => generated 298 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:49:59.138958 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e36aa1a-e0ee-4516-a17b-80c8055722b2 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:49:59.165180 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4810e70-a872-427b-920e-c62e256bf590 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:49:59.217648 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:49:59.238450 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826fd35c-dc50-4c08-91b3-3c22b1445216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:49:59.239154 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826fd35c-dc50-4c08-91b3-3c22b1445216 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:59.239456 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826fd35c-dc50-4c08-91b3-3c22b1445216 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:59.239720 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826fd35c-dc50-4c08-91b3-3c22b1445216 None admin] PATH_INFO: `/v3/users/09ce8c0b6d584400af33d8c86a3b8bba` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:59.241056 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826fd35c-dc50-4c08-91b3-3c22b1445216 None admin] RBAC: Authorizing `identity:get_user(user_id=09ce8c0b6d584400af33d8c86a3b8bba)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:49:59.242626 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826fd35c-dc50-4c08-91b3-3c22b1445216 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:49:59.244461 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 67/132] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 10 09:49:59 2022] GET /identity/v3/users/09ce8c0b6d584400af33d8c86a3b8bba => generated 275 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:49:59.245099 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826fd35c-dc50-4c08-91b3-3c22b1445216 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:49:59.323230 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e36aa1a-e0ee-4516-a17b-80c8055722b2 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:49:59.330179 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:49:59.373642 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64251f6c-bcec-4b50-b610-7ebc3e9cfde7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:49:59.374359 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64251f6c-bcec-4b50-b610-7ebc3e9cfde7 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:59.374644 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64251f6c-bcec-4b50-b610-7ebc3e9cfde7 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:59.375241 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64251f6c-bcec-4b50-b610-7ebc3e9cfde7 None admin] PATH_INFO: `/v3/projects/b812d355220c4d00b5c4835f163074aa` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:59.376683 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64251f6c-bcec-4b50-b610-7ebc3e9cfde7 None admin] RBAC: Authorizing `identity:get_project(project_id=b812d355220c4d00b5c4835f163074aa)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:49:59.379054 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64251f6c-bcec-4b50-b610-7ebc3e9cfde7 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:49:59.381737 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 66/133] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 10 09:49:59 2022] GET /identity/v3/projects/b812d355220c4d00b5c4835f163074aa => generated 298 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:49:59.382643 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64251f6c-bcec-4b50-b610-7ebc3e9cfde7 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:49:59.383772 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826fd35c-dc50-4c08-91b3-3c22b1445216 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:49:59.423325 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e656082-ec30-4dd9-8a06-1f2c0323bf06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:49:59.423955 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e656082-ec30-4dd9-8a06-1f2c0323bf06 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:59.424232 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e656082-ec30-4dd9-8a06-1f2c0323bf06 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:59.424509 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e656082-ec30-4dd9-8a06-1f2c0323bf06 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:59.425288 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e656082-ec30-4dd9-8a06-1f2c0323bf06 None admin] RBAC: Adding query filter params (role.id=362321830b5e4df5a2864d0852f5b7c4, scope.project.id=b812d355220c4d00b5c4835f163074aa, user.id=3c0f486722054cd5a2f88cca1e4ab1de) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:49:59.425602 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e656082-ec30-4dd9-8a06-1f2c0323bf06 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:49:59.427127 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e656082-ec30-4dd9-8a06-1f2c0323bf06 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:49:59.433845 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 68/134] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 10 09:49:59 2022] GET /identity/v3/role_assignments?user.id=3c0f486722054cd5a2f88cca1e4ab1de&scope.project.id=b812d355220c4d00b5c4835f163074aa&role.id=362321830b5e4df5a2864d0852f5b7c4 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:49:59.434693 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e656082-ec30-4dd9-8a06-1f2c0323bf06 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:49:59.512895 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64251f6c-bcec-4b50-b610-7ebc3e9cfde7 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:49:59.515492 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:49:59.552582 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b492b23f-9cb2-418b-bd7d-25d3cfb65f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:49:59.553525 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b492b23f-9cb2-418b-bd7d-25d3cfb65f11 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:59.553947 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b492b23f-9cb2-418b-bd7d-25d3cfb65f11 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:59.554357 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b492b23f-9cb2-418b-bd7d-25d3cfb65f11 None admin] PATH_INFO: `/v3/projects/0ec9f428129e464b94bde0ecb73fe27d` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:59.557048 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b492b23f-9cb2-418b-bd7d-25d3cfb65f11 None admin] RBAC: Authorizing `identity:get_project(project_id=0ec9f428129e464b94bde0ecb73fe27d)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:49:59.559680 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b492b23f-9cb2-418b-bd7d-25d3cfb65f11 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:49:59.561617 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 67/135] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 10 09:49:59 2022] GET /identity/v3/projects/0ec9f428129e464b94bde0ecb73fe27d => generated 312 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:49:59.570663 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b492b23f-9cb2-418b-bd7d-25d3cfb65f11 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:49:59.742884 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e656082-ec30-4dd9-8a06-1f2c0323bf06 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:49:59.794280 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b492b23f-9cb2-418b-bd7d-25d3cfb65f11 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:49:59.809466 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:49:59.839856 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544e8ce6-500b-4ce7-9e95-9b398b6c9ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:49:59.840531 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544e8ce6-500b-4ce7-9e95-9b398b6c9ca2 None admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:59.840821 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544e8ce6-500b-4ce7-9e95-9b398b6c9ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:59.841125 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544e8ce6-500b-4ce7-9e95-9b398b6c9ca2 None admin] PATH_INFO: `/v3/projects/b812d355220c4d00b5c4835f163074aa/users/09ce8c0b6d584400af33d8c86a3b8bba/roles/5d80017a50774daba0c1fee326754295` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:59.847286 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544e8ce6-500b-4ce7-9e95-9b398b6c9ca2 None admin] RBAC: Authorizing `identity:create_grant(project_id=b812d355220c4d00b5c4835f163074aa, user_id=09ce8c0b6d584400af33d8c86a3b8bba, role_id=5d80017a50774daba0c1fee326754295)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:49:59.848790 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544e8ce6-500b-4ce7-9e95-9b398b6c9ca2 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:49:59.876768 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 69/136] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Aug 10 09:49:59 2022] PUT /identity/v3/projects/b812d355220c4d00b5c4835f163074aa/users/09ce8c0b6d584400af33d8c86a3b8bba/roles/5d80017a50774daba0c1fee326754295 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 09:49:59.883592 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d955e83-f98c-49cd-9cbb-9ab92ed12997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:49:59.884314 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d955e83-f98c-49cd-9cbb-9ab92ed12997 None admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:49:59.884605 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d955e83-f98c-49cd-9cbb-9ab92ed12997 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:49:59.884888 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d955e83-f98c-49cd-9cbb-9ab92ed12997 None admin] PATH_INFO: `/v3/projects/0ec9f428129e464b94bde0ecb73fe27d/users/09ce8c0b6d584400af33d8c86a3b8bba/roles/8daabcb6b7394e39b06a3453e33e32db` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:49:59.887181 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d955e83-f98c-49cd-9cbb-9ab92ed12997 None admin] RBAC: Authorizing `identity:create_grant(project_id=0ec9f428129e464b94bde0ecb73fe27d, user_id=09ce8c0b6d584400af33d8c86a3b8bba, role_id=8daabcb6b7394e39b06a3453e33e32db)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:49:59.888799 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d955e83-f98c-49cd-9cbb-9ab92ed12997 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:49:59.924887 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 68/137] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Aug 10 09:49:59 2022] PUT /identity/v3/projects/0ec9f428129e464b94bde0ecb73fe27d/users/09ce8c0b6d584400af33d8c86a3b8bba/roles/8daabcb6b7394e39b06a3453e33e32db => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 09:50:00.946666 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1adfd1-d6f6-4ecc-82cd-b60e68d6f651 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:00.947179 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1adfd1-d6f6-4ecc-82cd-b60e68d6f651 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:00.947179 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1adfd1-d6f6-4ecc-82cd-b60e68d6f651 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:00.948521 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 70/138] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:50:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:50:00.953860 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183f2f21-6179-4cef-bc0b-2517403c8451 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:00.954247 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183f2f21-6179-4cef-bc0b-2517403c8451 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:00.954421 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183f2f21-6179-4cef-bc0b-2517403c8451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:00.981303 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-183f2f21-6179-4cef-bc0b-2517403c8451 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:50:00.982505 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-183f2f21-6179-4cef-bc0b-2517403c8451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:50:01.018876 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:01.071749 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 69/139] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:50:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 09:50:01.106597 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1adfd1-d6f6-4ecc-82cd-b60e68d6f651 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:01.178854 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2a8058-08c4-462e-8bfd-dc9f9794e32c None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:01.179272 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2a8058-08c4-462e-8bfd-dc9f9794e32c None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:01.179466 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2a8058-08c4-462e-8bfd-dc9f9794e32c None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:01.180880 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 70/140] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:50:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 09:50:01.186193 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e79af1-10ca-4d63-810d-0a1e272457f7 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:01.186476 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e79af1-10ca-4d63-810d-0a1e272457f7 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:01.186755 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e79af1-10ca-4d63-810d-0a1e272457f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:01.222027 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-95e79af1-10ca-4d63-810d-0a1e272457f7 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:50:01.223231 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-95e79af1-10ca-4d63-810d-0a1e272457f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:50:01.263988 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1adfd1-d6f6-4ecc-82cd-b60e68d6f651 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:01.326343 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 71/141] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:50:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 10 09:50:01.333954 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0c164d-55dc-4e04-9bb6-a13f2b45e704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:01.334841 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0c164d-55dc-4e04-9bb6-a13f2b45e704 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:01.335309 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0c164d-55dc-4e04-9bb6-a13f2b45e704 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:01.335814 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0c164d-55dc-4e04-9bb6-a13f2b45e704 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:01.353844 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0c164d-55dc-4e04-9bb6-a13f2b45e704 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 09:50:01.358992 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-cb0c164d-55dc-4e04-9bb6-a13f2b45e704 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 09:50:01.358992 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:50:01.358992 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:50:01.358992 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:50:01.358992 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:50:01.358992 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:50:01.358992 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:50:01.358992 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:50:01.358992 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:50:01.358992 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:50:01.358992 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:50:01.358992 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:50:01.358992 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 09:50:01.358992 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 09:50:01.358992 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 09:50:01.358992 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 09:50:01.359814 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 09:50:01.359814 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 09:50:01.359814 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 09:50:01.359814 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 09:50:01.359814 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:50:01.359814 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:50:01.359814 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:50:01.359814 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:50:01.359814 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:50:01.359814 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:50:01.359814 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:50:01.359814 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:50:01.359814 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:50:01.359814 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:50:01.359814 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:50:01.359814 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:50:01.360567 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:50:01.360567 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:50:01.360567 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:50:01.360567 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:50:01.360567 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 09:50:01.360567 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 09:50:01.360567 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 09:50:01.360567 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 09:50:01.360567 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 09:50:01.360567 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 09:50:01.360567 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 09:50:01.360567 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:50:01.362733 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e79af1-10ca-4d63-810d-0a1e272457f7 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:01.380722 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 71/142] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 10 09:50:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:50:01.384799 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0c164d-55dc-4e04-9bb6-a13f2b45e704 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:01.481821 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:01.558526 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:01.571907 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e79af1-10ca-4d63-810d-0a1e272457f7 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:01.581369 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0c164d-55dc-4e04-9bb6-a13f2b45e704 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:01.621135 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72889be-95ac-49c6-a541-22d72602211e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:01.622383 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72889be-95ac-49c6-a541-22d72602211e None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:01.623004 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72889be-95ac-49c6-a541-22d72602211e None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:01.623542 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72889be-95ac-49c6-a541-22d72602211e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:01.629801 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36840dc1-d1fa-44dc-acce-6cd20e89f238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:01.630428 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36840dc1-d1fa-44dc-acce-6cd20e89f238 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:01.630710 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36840dc1-d1fa-44dc-acce-6cd20e89f238 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:01.630985 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36840dc1-d1fa-44dc-acce-6cd20e89f238 None admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:01.631683 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36840dc1-d1fa-44dc-acce-6cd20e89f238 None admin] RBAC: Adding query filter params (name=member) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:01.632007 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36840dc1-d1fa-44dc-acce-6cd20e89f238 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:01.633504 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36840dc1-d1fa-44dc-acce-6cd20e89f238 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:01.637565 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72889be-95ac-49c6-a541-22d72602211e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 09:50:01.642837 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-c72889be-95ac-49c6-a541-22d72602211e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 09:50:01.642837 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:50:01.642837 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:50:01.642837 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:50:01.642837 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:50:01.642837 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:50:01.642837 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:50:01.642837 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:50:01.642837 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:50:01.642837 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:50:01.642837 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:50:01.642837 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:50:01.642837 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 09:50:01.642837 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 09:50:01.642837 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 09:50:01.642837 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 09:50:01.643795 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 09:50:01.643795 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 09:50:01.643795 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 09:50:01.643795 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 09:50:01.643795 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:50:01.643795 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:50:01.643795 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:50:01.643795 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:50:01.643795 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:50:01.643795 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:50:01.643795 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:50:01.643795 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:50:01.643795 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:50:01.643795 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:50:01.643795 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:50:01.643795 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:50:01.644571 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:50:01.644571 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:50:01.644571 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:50:01.644571 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:50:01.644571 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 09:50:01.644571 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 09:50:01.644571 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 09:50:01.644571 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 09:50:01.644571 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 09:50:01.644571 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 09:50:01.644571 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 09:50:01.644571 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:50:01.646996 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 72/143] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Aug 10 09:50:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:50:01.647705 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 72/144] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Aug 10 09:50:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:01.653821 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72889be-95ac-49c6-a541-22d72602211e None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:01.657249 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36840dc1-d1fa-44dc-acce-6cd20e89f238 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:01.832710 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72889be-95ac-49c6-a541-22d72602211e None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:01.840491 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36840dc1-d1fa-44dc-acce-6cd20e89f238 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:01.846891 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:01.901791 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18298e0-1694-4628-8dc2-ffbbe8c4a104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:01.902454 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18298e0-1694-4628-8dc2-ffbbe8c4a104 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:01.902751 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18298e0-1694-4628-8dc2-ffbbe8c4a104 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:01.903020 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18298e0-1694-4628-8dc2-ffbbe8c4a104 None admin] PATH_INFO: `/v3/users/09ce8c0b6d584400af33d8c86a3b8bba` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:01.904225 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18298e0-1694-4628-8dc2-ffbbe8c4a104 None admin] RBAC: Authorizing `identity:get_user(user_id=09ce8c0b6d584400af33d8c86a3b8bba)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:01.905723 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18298e0-1694-4628-8dc2-ffbbe8c4a104 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:01.907530 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 73/145] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 10 09:50:01 2022] GET /identity/v3/users/09ce8c0b6d584400af33d8c86a3b8bba => generated 275 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:01.912709 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18298e0-1694-4628-8dc2-ffbbe8c4a104 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:01.914841 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cac56c-286c-4bfa-94eb-d4caa0741ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:01.915468 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cac56c-286c-4bfa-94eb-d4caa0741ea1 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:01.915748 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cac56c-286c-4bfa-94eb-d4caa0741ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:01.916029 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cac56c-286c-4bfa-94eb-d4caa0741ea1 None admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:01.916704 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cac56c-286c-4bfa-94eb-d4caa0741ea1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:01.917010 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cac56c-286c-4bfa-94eb-d4caa0741ea1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:01.918414 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cac56c-286c-4bfa-94eb-d4caa0741ea1 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:01.934611 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 73/146] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 10 09:50:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:01.939981 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cac56c-286c-4bfa-94eb-d4caa0741ea1 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:01.963745 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:02.100893 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cac56c-286c-4bfa-94eb-d4caa0741ea1 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:02.149157 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b403e3-6d78-4e4b-a23a-ae1f631dc5f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:02.150927 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b403e3-6d78-4e4b-a23a-ae1f631dc5f1 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:02.152502 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b403e3-6d78-4e4b-a23a-ae1f631dc5f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:02.154764 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b403e3-6d78-4e4b-a23a-ae1f631dc5f1 None admin] PATH_INFO: `/v3/users/68006355826841798d09dd7cab67ec78` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:02.156088 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b403e3-6d78-4e4b-a23a-ae1f631dc5f1 None admin] RBAC: Authorizing `identity:get_user(user_id=68006355826841798d09dd7cab67ec78)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:02.157736 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b403e3-6d78-4e4b-a23a-ae1f631dc5f1 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:02.158191 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18298e0-1694-4628-8dc2-ffbbe8c4a104 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:02.161359 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 74/147] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 10 09:50:01 2022] GET /identity/v3/users/68006355826841798d09dd7cab67ec78 => generated 247 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:02.169295 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fde027-ca98-4ea6-a4c3-bbbf07322a93 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:02.169823 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fde027-ca98-4ea6-a4c3-bbbf07322a93 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:02.170284 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fde027-ca98-4ea6-a4c3-bbbf07322a93 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:02.171700 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 75/148] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:50:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:50:02.172532 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fde027-ca98-4ea6-a4c3-bbbf07322a93 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:02.219522 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada0fa3f-d0ff-4142-ae4f-9858f5dfb9f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:02.220146 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada0fa3f-d0ff-4142-ae4f-9858f5dfb9f8 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:02.220428 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada0fa3f-d0ff-4142-ae4f-9858f5dfb9f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:02.220699 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada0fa3f-d0ff-4142-ae4f-9858f5dfb9f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:02.260543 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:02.359237 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fde027-ca98-4ea6-a4c3-bbbf07322a93 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:02.379519 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada0fa3f-d0ff-4142-ae4f-9858f5dfb9f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:02.381004 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada0fa3f-d0ff-4142-ae4f-9858f5dfb9f8 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:02.394147 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3991a772-4b67-4b63-9a50-98d474d28d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:02.394913 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3991a772-4b67-4b63-9a50-98d474d28d1c None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:02.395191 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3991a772-4b67-4b63-9a50-98d474d28d1c None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:02.395459 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3991a772-4b67-4b63-9a50-98d474d28d1c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:02.417027 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:02.467803 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3991a772-4b67-4b63-9a50-98d474d28d1c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:02.469851 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3991a772-4b67-4b63-9a50-98d474d28d1c None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:02.517437 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:02.568931 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 74/149] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 10 09:50:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 656 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 10 09:50:02.570674 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aeb3b5-dcf3-4460-b176-0aa14afa2b5f None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:02.570972 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aeb3b5-dcf3-4460-b176-0aa14afa2b5f None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:02.571247 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aeb3b5-dcf3-4460-b176-0aa14afa2b5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:02.572421 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 76/150] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 10 09:50:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 09:50:02.580365 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3991a772-4b67-4b63-9a50-98d474d28d1c None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:02.605404 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-d6aeb3b5-dcf3-4460-b176-0aa14afa2b5f None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:50:02.605404 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-d6aeb3b5-dcf3-4460-b176-0aa14afa2b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:50:02.710128 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 75/151] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:50:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 09:50:02.710500 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3991a772-4b67-4b63-9a50-98d474d28d1c None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:02.711735 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aeb3b5-dcf3-4460-b176-0aa14afa2b5f None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:02.754703 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a18fd7c-cd68-44b4-9bd5-33dbc5b959fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:02.755719 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a18fd7c-cd68-44b4-9bd5-33dbc5b959fd None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:02.756185 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a18fd7c-cd68-44b4-9bd5-33dbc5b959fd None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:02.756664 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a18fd7c-cd68-44b4-9bd5-33dbc5b959fd None admin] PATH_INFO: `/v3/projects/b812d355220c4d00b5c4835f163074aa` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:02.758116 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a18fd7c-cd68-44b4-9bd5-33dbc5b959fd None admin] RBAC: Authorizing `identity:get_project(project_id=b812d355220c4d00b5c4835f163074aa)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:02.760344 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a18fd7c-cd68-44b4-9bd5-33dbc5b959fd None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:02.763263 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 77/152] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 10 09:50:02 2022] GET /identity/v3/projects/b812d355220c4d00b5c4835f163074aa => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:02.764573 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e840a430-fec9-48e1-ac96-2538d9300022 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:02.764854 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e840a430-fec9-48e1-ac96-2538d9300022 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:02.765254 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e840a430-fec9-48e1-ac96-2538d9300022 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:02.766569 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 78/153] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:50:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:50:02.767198 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e840a430-fec9-48e1-ac96-2538d9300022 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:02.770111 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:02.774255 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:02.826664 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aeb3b5-dcf3-4460-b176-0aa14afa2b5f None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:02.860744 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f5d620-db5f-480e-b4b9-be2d3dae5b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:02.861412 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f5d620-db5f-480e-b4b9-be2d3dae5b75 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:02.861691 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f5d620-db5f-480e-b4b9-be2d3dae5b75 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:02.861960 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f5d620-db5f-480e-b4b9-be2d3dae5b75 None admin] PATH_INFO: `/v3/projects/b812d355220c4d00b5c4835f163074aa` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:02.863840 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f5d620-db5f-480e-b4b9-be2d3dae5b75 None admin] RBAC: Authorizing `identity:get_project(project_id=b812d355220c4d00b5c4835f163074aa)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:02.865334 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f5d620-db5f-480e-b4b9-be2d3dae5b75 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:02.871712 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 76/154] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 10 09:50:02 2022] GET /identity/v3/projects/b812d355220c4d00b5c4835f163074aa => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:02.871712 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2899b31-9f1a-4380-8390-6d96c05409d1 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:02.871712 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2899b31-9f1a-4380-8390-6d96c05409d1 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:02.871712 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2899b31-9f1a-4380-8390-6d96c05409d1 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:02.871712 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 77/155] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:50:02 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:50:02.874574 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2899b31-9f1a-4380-8390-6d96c05409d1 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:02.888107 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e840a430-fec9-48e1-ac96-2538d9300022 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:02.923055 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863a129e-3b93-40a5-83a9-882a1849d298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:02.923690 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863a129e-3b93-40a5-83a9-882a1849d298 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:02.923961 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863a129e-3b93-40a5-83a9-882a1849d298 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:02.924228 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863a129e-3b93-40a5-83a9-882a1849d298 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:02.934635 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863a129e-3b93-40a5-83a9-882a1849d298 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 09:50:02.939246 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-863a129e-3b93-40a5-83a9-882a1849d298 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 09:50:02.939246 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:50:02.939246 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:50:02.939246 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:50:02.939246 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:50:02.939246 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:50:02.939246 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:50:02.939246 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:50:02.939246 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:50:02.939246 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:50:02.939246 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:50:02.939246 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:50:02.939246 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 09:50:02.939246 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 09:50:02.939246 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 09:50:02.939246 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 09:50:02.940164 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 09:50:02.940164 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 09:50:02.940164 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 09:50:02.940164 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 09:50:02.940164 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:50:02.940164 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:50:02.940164 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:50:02.940164 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:50:02.940164 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:50:02.940164 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:50:02.940164 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:50:02.940164 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:50:02.940164 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:50:02.940164 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:50:02.940164 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:50:02.940164 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:50:02.946709 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:50:02.946709 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:50:02.946709 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:50:02.946709 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:50:02.946709 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 09:50:02.946709 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 09:50:02.946709 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 09:50:02.946709 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 09:50:02.946709 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 09:50:02.946709 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 09:50:02.946709 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 09:50:02.946709 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:50:02.946709 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 79/156] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 10 09:50:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:50:02.946709 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4474b9fb-1960-4b72-8a8e-49758ac56f8a None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:02.947507 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4474b9fb-1960-4b72-8a8e-49758ac56f8a None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:02.947507 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4474b9fb-1960-4b72-8a8e-49758ac56f8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:02.960056 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-4474b9fb-1960-4b72-8a8e-49758ac56f8a None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:50:02.961374 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-4474b9fb-1960-4b72-8a8e-49758ac56f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:50:02.990512 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2899b31-9f1a-4380-8390-6d96c05409d1 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:03.008428 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:03.020455 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:03.028962 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb72cc1-e8cf-4972-950e-6ebdf1713580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:03.029662 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb72cc1-e8cf-4972-950e-6ebdf1713580 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:03.029939 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb72cc1-e8cf-4972-950e-6ebdf1713580 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:03.030209 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb72cc1-e8cf-4972-950e-6ebdf1713580 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:03.031041 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb72cc1-e8cf-4972-950e-6ebdf1713580 None admin] RBAC: Adding query filter params (role.id=8daabcb6b7394e39b06a3453e33e32db, scope.project.id=b812d355220c4d00b5c4835f163074aa, user.id=09ce8c0b6d584400af33d8c86a3b8bba) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:03.031381 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb72cc1-e8cf-4972-950e-6ebdf1713580 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:03.039447 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 80/157] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:50:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 09:50:03.039595 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb72cc1-e8cf-4972-950e-6ebdf1713580 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:03.039692 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287ed515-3eba-43c5-9546-f7e98b49d511 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:03.039692 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287ed515-3eba-43c5-9546-f7e98b49d511 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:03.039692 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287ed515-3eba-43c5-9546-f7e98b49d511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:03.047424 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 78/158] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 10 09:50:02 2022] GET /identity/v3/role_assignments?user.id=09ce8c0b6d584400af33d8c86a3b8bba&scope.project.id=b812d355220c4d00b5c4835f163074aa&role.id=8daabcb6b7394e39b06a3453e33e32db => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:03.048382 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb72cc1-e8cf-4972-950e-6ebdf1713580 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:03.052594 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-287ed515-3eba-43c5-9546-f7e98b49d511 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:50:03.053997 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-287ed515-3eba-43c5-9546-f7e98b49d511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:50:03.128836 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 81/159] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:50:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 09:50:03.130684 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287ed515-3eba-43c5-9546-f7e98b49d511 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:03.166776 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb72cc1-e8cf-4972-950e-6ebdf1713580 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:03.202296 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe52c8a5-d5f1-4cac-9a4d-b590979643cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:03.202841 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe52c8a5-d5f1-4cac-9a4d-b590979643cb None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:03.203110 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe52c8a5-d5f1-4cac-9a4d-b590979643cb None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:03.203376 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe52c8a5-d5f1-4cac-9a4d-b590979643cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:03.204121 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe52c8a5-d5f1-4cac-9a4d-b590979643cb None admin] RBAC: Adding query filter params (role.id=eb04edc46b3742d7a0f0ead26f68bc22, scope.project.id=b812d355220c4d00b5c4835f163074aa, user.id=68006355826841798d09dd7cab67ec78) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:03.204427 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe52c8a5-d5f1-4cac-9a4d-b590979643cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:03.205959 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe52c8a5-d5f1-4cac-9a4d-b590979643cb None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:03.212369 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 79/160] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 10 09:50:03 2022] GET /identity/v3/role_assignments?user.id=68006355826841798d09dd7cab67ec78&scope.project.id=b812d355220c4d00b5c4835f163074aa&role.id=eb04edc46b3742d7a0f0ead26f68bc22 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:03.213706 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c422c0-bc38-441d-98a4-b939a77399a7 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:03.214202 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c422c0-bc38-441d-98a4-b939a77399a7 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:03.214478 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c422c0-bc38-441d-98a4-b939a77399a7 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:03.220212 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 80/161] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:50:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:50:03.220212 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c422c0-bc38-441d-98a4-b939a77399a7 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:03.261338 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287ed515-3eba-43c5-9546-f7e98b49d511 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:03.283328 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:03.299318 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:03.317511 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25256fb7-1b8a-4844-8a99-b287a504c090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:03.318183 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25256fb7-1b8a-4844-8a99-b287a504c090 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:03.318464 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25256fb7-1b8a-4844-8a99-b287a504c090 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:03.318731 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25256fb7-1b8a-4844-8a99-b287a504c090 None admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:03.319421 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25256fb7-1b8a-4844-8a99-b287a504c090 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:03.320138 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25256fb7-1b8a-4844-8a99-b287a504c090 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:03.322003 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25256fb7-1b8a-4844-8a99-b287a504c090 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:03.332633 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 82/162] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Aug 10 09:50:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:03.337922 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25256fb7-1b8a-4844-8a99-b287a504c090 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:03.377780 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c422c0-bc38-441d-98a4-b939a77399a7 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:03.416713 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1167ae-a17e-4595-924e-a510802f1aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:03.417387 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1167ae-a17e-4595-924e-a510802f1aea None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:03.417669 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1167ae-a17e-4595-924e-a510802f1aea None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:03.417940 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1167ae-a17e-4595-924e-a510802f1aea None admin] PATH_INFO: `/v3/domains/default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:03.419043 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1167ae-a17e-4595-924e-a510802f1aea None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:03.420506 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1167ae-a17e-4595-924e-a510802f1aea None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:03.423214 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 81/163] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 10 09:50:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:03.424386 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc28043-a51c-4703-bb12-58c61625ecd7 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:03.424681 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc28043-a51c-4703-bb12-58c61625ecd7 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:03.424953 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc28043-a51c-4703-bb12-58c61625ecd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:03.443932 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-8fc28043-a51c-4703-bb12-58c61625ecd7 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:50:03.445607 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-8fc28043-a51c-4703-bb12-58c61625ecd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:50:03.464647 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25256fb7-1b8a-4844-8a99-b287a504c090 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:03.498327 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2652c5-889e-43d2-ab2b-11ef6b4b5ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:03.498954 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2652c5-889e-43d2-ab2b-11ef6b4b5ed6 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:03.499229 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2652c5-889e-43d2-ab2b-11ef6b4b5ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:03.499494 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2652c5-889e-43d2-ab2b-11ef6b4b5ed6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:03.509672 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2652c5-889e-43d2-ab2b-11ef6b4b5ed6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 09:50:03.512194 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 82/164] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:50:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 09:50:03.513033 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc28043-a51c-4703-bb12-58c61625ecd7 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:03.515861 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-4b2652c5-889e-43d2-ab2b-11ef6b4b5ed6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 09:50:03.515861 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:50:03.515861 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:50:03.515861 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:50:03.515861 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:50:03.515861 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:50:03.515861 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:50:03.515861 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:50:03.515861 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:50:03.515861 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:50:03.515861 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:50:03.515861 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:50:03.515861 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 09:50:03.515861 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 09:50:03.515861 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 09:50:03.515861 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 09:50:03.516814 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 09:50:03.516814 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 09:50:03.516814 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 09:50:03.516814 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 09:50:03.516814 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:50:03.516814 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:50:03.516814 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:50:03.516814 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:50:03.516814 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:50:03.516814 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:50:03.516814 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:50:03.516814 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:50:03.516814 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:50:03.516814 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:50:03.516814 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:50:03.516814 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:50:03.517856 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:50:03.517856 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:50:03.517856 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:50:03.517856 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:50:03.517856 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 09:50:03.517856 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 09:50:03.517856 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 09:50:03.517856 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 09:50:03.517856 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 09:50:03.517856 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 09:50:03.517856 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 09:50:03.517856 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:50:03.517856 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 83/165] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 10 09:50:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:50:03.517856 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2652c5-889e-43d2-ab2b-11ef6b4b5ed6 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:03.563570 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:03.568841 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:03.616202 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2652c5-889e-43d2-ab2b-11ef6b4b5ed6 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:03.620265 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc28043-a51c-4703-bb12-58c61625ecd7 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:03.648726 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20e9922-447e-490f-8ac3-dbc16f2b23c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:03.649333 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20e9922-447e-490f-8ac3-dbc16f2b23c3 None admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:03.649609 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20e9922-447e-490f-8ac3-dbc16f2b23c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:03.649876 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20e9922-447e-490f-8ac3-dbc16f2b23c3 None admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:03.650517 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20e9922-447e-490f-8ac3-dbc16f2b23c3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:03.651971 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20e9922-447e-490f-8ac3-dbc16f2b23c3 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:03.652187 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a2043b-b660-479b-8898-9fddf9bc70c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:03.652816 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a2043b-b660-479b-8898-9fddf9bc70c0 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:03.653119 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a2043b-b660-479b-8898-9fddf9bc70c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:03.653395 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a2043b-b660-479b-8898-9fddf9bc70c0 None admin] PATH_INFO: `/v3/users/3c0f486722054cd5a2f88cca1e4ab1de` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:03.654513 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a2043b-b660-479b-8898-9fddf9bc70c0 None admin] RBAC: Authorizing `identity:get_user(user_id=3c0f486722054cd5a2f88cca1e4ab1de)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:03.655940 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a2043b-b660-479b-8898-9fddf9bc70c0 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:03.662081 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 83/166] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 10 09:50:03 2022] GET /identity/v3/users/3c0f486722054cd5a2f88cca1e4ab1de => generated 289 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:03.662081 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a2043b-b660-479b-8898-9fddf9bc70c0 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:03.679923 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 84/167] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Aug 10 09:50:03 2022] POST /identity/v3/users => generated 283 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 09:50:03.688173 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20e9922-447e-490f-8ac3-dbc16f2b23c3 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:03.784035 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a2043b-b660-479b-8898-9fddf9bc70c0 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:03.797570 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:03.798890 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:03.800912 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20e9922-447e-490f-8ac3-dbc16f2b23c3 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:03.827424 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24342a3c-9809-4e0c-942c-153ce65abdc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:03.828044 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24342a3c-9809-4e0c-942c-153ce65abdc5 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:03.828427 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24342a3c-9809-4e0c-942c-153ce65abdc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:03.828699 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24342a3c-9809-4e0c-942c-153ce65abdc5 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:03.830072 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24342a3c-9809-4e0c-942c-153ce65abdc5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:03.830072 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24342a3c-9809-4e0c-942c-153ce65abdc5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:03.831193 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24342a3c-9809-4e0c-942c-153ce65abdc5 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:03.841287 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 84/168] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Aug 10 09:50:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:03.841459 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f4f30b-ccf8-404f-b597-17888526e34c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:03.841784 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f4f30b-ccf8-404f-b597-17888526e34c None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:03.842063 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f4f30b-ccf8-404f-b597-17888526e34c None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:03.843054 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f4f30b-ccf8-404f-b597-17888526e34c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:03.846419 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24342a3c-9809-4e0c-942c-153ce65abdc5 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:03.857651 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f4f30b-ccf8-404f-b597-17888526e34c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 09:50:03.862796 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-77f4f30b-ccf8-404f-b597-17888526e34c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 09:50:03.862796 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:50:03.862796 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:50:03.862796 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:50:03.862796 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:50:03.862796 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:50:03.862796 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:50:03.862796 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:50:03.862796 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:50:03.862796 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:50:03.862796 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:50:03.862796 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:50:03.862796 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 09:50:03.862796 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 09:50:03.862796 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 09:50:03.862796 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 09:50:03.863655 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 09:50:03.863655 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 09:50:03.863655 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 09:50:03.863655 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 09:50:03.863655 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:50:03.863655 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:50:03.863655 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:50:03.863655 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:50:03.863655 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:50:03.863655 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:50:03.863655 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:50:03.863655 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:50:03.863655 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:50:03.863655 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:50:03.863655 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:50:03.863655 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:50:03.864881 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:50:03.864881 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:50:03.864881 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:50:03.864881 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:50:03.864881 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 09:50:03.864881 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 09:50:03.864881 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 09:50:03.864881 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 09:50:03.864881 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 09:50:03.864881 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 09:50:03.864881 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 09:50:03.864881 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:50:03.864881 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 85/169] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Aug 10 09:50:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:50:03.864881 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f4f30b-ccf8-404f-b597-17888526e34c None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:03.969007 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24342a3c-9809-4e0c-942c-153ce65abdc5 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:03.991516 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f4f30b-ccf8-404f-b597-17888526e34c None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:04.007066 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22001b95-bec3-471c-8d72-d046b88eb97f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:04.007715 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22001b95-bec3-471c-8d72-d046b88eb97f None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:04.008067 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22001b95-bec3-471c-8d72-d046b88eb97f None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:04.008337 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22001b95-bec3-471c-8d72-d046b88eb97f None admin] PATH_INFO: `/v3/projects/b812d355220c4d00b5c4835f163074aa` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:04.010482 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22001b95-bec3-471c-8d72-d046b88eb97f None admin] RBAC: Authorizing `identity:get_project(project_id=b812d355220c4d00b5c4835f163074aa)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:04.011959 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22001b95-bec3-471c-8d72-d046b88eb97f None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:04.013837 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 85/170] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 10 09:50:03 2022] GET /identity/v3/projects/b812d355220c4d00b5c4835f163074aa => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:04.015473 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22001b95-bec3-471c-8d72-d046b88eb97f None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:04.036890 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b993065-e5c3-4402-bf6f-71cf70379ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:04.037496 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b993065-e5c3-4402-bf6f-71cf70379ed9 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:04.037778 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b993065-e5c3-4402-bf6f-71cf70379ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:04.038041 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b993065-e5c3-4402-bf6f-71cf70379ed9 None admin] PATH_INFO: `/v3/users/09ce8c0b6d584400af33d8c86a3b8bba` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:04.039973 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b993065-e5c3-4402-bf6f-71cf70379ed9 None admin] RBAC: Authorizing `identity:get_user(user_id=09ce8c0b6d584400af33d8c86a3b8bba)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:04.042080 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b993065-e5c3-4402-bf6f-71cf70379ed9 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:04.044194 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 86/171] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 10 09:50:03 2022] GET /identity/v3/users/09ce8c0b6d584400af33d8c86a3b8bba => generated 275 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:04.045356 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b993065-e5c3-4402-bf6f-71cf70379ed9 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:04.061288 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:04.087790 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:04.132693 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22001b95-bec3-471c-8d72-d046b88eb97f None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:04.177336 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286d2b22-265a-42e6-8271-05e3827dcfd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:04.177970 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286d2b22-265a-42e6-8271-05e3827dcfd2 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:04.178394 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286d2b22-265a-42e6-8271-05e3827dcfd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:04.178669 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286d2b22-265a-42e6-8271-05e3827dcfd2 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:04.179492 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286d2b22-265a-42e6-8271-05e3827dcfd2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:04.179856 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286d2b22-265a-42e6-8271-05e3827dcfd2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:04.181796 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286d2b22-265a-42e6-8271-05e3827dcfd2 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:04.184032 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b993065-e5c3-4402-bf6f-71cf70379ed9 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:04.192051 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 86/172] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 10 09:50:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:04.193567 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286d2b22-265a-42e6-8271-05e3827dcfd2 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:04.222967 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1536029b-623d-43f7-b510-fd0f834dd4ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:04.223631 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1536029b-623d-43f7-b510-fd0f834dd4ad None admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:04.223909 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1536029b-623d-43f7-b510-fd0f834dd4ad None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:04.224181 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1536029b-623d-43f7-b510-fd0f834dd4ad None admin] PATH_INFO: `/v3/projects/b812d355220c4d00b5c4835f163074aa/users/3c0f486722054cd5a2f88cca1e4ab1de/roles/362321830b5e4df5a2864d0852f5b7c4` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:04.226124 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1536029b-623d-43f7-b510-fd0f834dd4ad None admin] RBAC: Authorizing `identity:create_grant(project_id=b812d355220c4d00b5c4835f163074aa, user_id=3c0f486722054cd5a2f88cca1e4ab1de, role_id=362321830b5e4df5a2864d0852f5b7c4)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:04.227643 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1536029b-623d-43f7-b510-fd0f834dd4ad None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:04.245578 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 87/173] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Aug 10 09:50:04 2022] PUT /identity/v3/projects/b812d355220c4d00b5c4835f163074aa/users/3c0f486722054cd5a2f88cca1e4ab1de/roles/362321830b5e4df5a2864d0852f5b7c4 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 09:50:04.246487 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1536029b-623d-43f7-b510-fd0f834dd4ad None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:04.357415 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:04.359101 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286d2b22-265a-42e6-8271-05e3827dcfd2 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:04.364639 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:04.377610 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1536029b-623d-43f7-b510-fd0f834dd4ad None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:04.416926 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a614b530-5a05-44bd-9a68-5ff0bf6a2829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:04.417862 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a614b530-5a05-44bd-9a68-5ff0bf6a2829 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:04.418415 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a614b530-5a05-44bd-9a68-5ff0bf6a2829 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:04.418843 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a614b530-5a05-44bd-9a68-5ff0bf6a2829 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:04.435161 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c037ec84-c50a-4611-af7e-e477ea4affb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:04.435812 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c037ec84-c50a-4611-af7e-e477ea4affb5 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:04.436092 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c037ec84-c50a-4611-af7e-e477ea4affb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:04.436368 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c037ec84-c50a-4611-af7e-e477ea4affb5 None admin] PATH_INFO: `/v3/users/09ce8c0b6d584400af33d8c86a3b8bba` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:04.441940 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c037ec84-c50a-4611-af7e-e477ea4affb5 None admin] RBAC: Authorizing `identity:get_user(user_id=09ce8c0b6d584400af33d8c86a3b8bba)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:04.443473 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c037ec84-c50a-4611-af7e-e477ea4affb5 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:04.445929 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 88/174] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 10 09:50:04 2022] GET /identity/v3/users/09ce8c0b6d584400af33d8c86a3b8bba => generated 275 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:04.451297 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c037ec84-c50a-4611-af7e-e477ea4affb5 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:04.544682 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a614b530-5a05-44bd-9a68-5ff0bf6a2829 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:04.546495 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a614b530-5a05-44bd-9a68-5ff0bf6a2829 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:04.609323 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c037ec84-c50a-4611-af7e-e477ea4affb5 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:04.662826 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338298c9-a541-492c-b687-987aa46a7f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:04.663448 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338298c9-a541-492c-b687-987aa46a7f1a None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:04.663725 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338298c9-a541-492c-b687-987aa46a7f1a None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:04.664035 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338298c9-a541-492c-b687-987aa46a7f1a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:04.703459 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:04.778195 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338298c9-a541-492c-b687-987aa46a7f1a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:04.779699 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338298c9-a541-492c-b687-987aa46a7f1a None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:04.785200 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 87/175] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 10 09:50:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 592 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 09:50:04.790889 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a614b530-5a05-44bd-9a68-5ff0bf6a2829 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:04.793925 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:04.937664 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a614b530-5a05-44bd-9a68-5ff0bf6a2829 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:04.959060 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 89/176] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 10 09:50:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 10 09:50:04.964487 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338298c9-a541-492c-b687-987aa46a7f1a None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:04.971716 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ee855d-f7ae-44af-8b6b-59868d96739c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:04.972360 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ee855d-f7ae-44af-8b6b-59868d96739c None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:04.972635 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ee855d-f7ae-44af-8b6b-59868d96739c None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:04.972903 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ee855d-f7ae-44af-8b6b-59868d96739c None admin] PATH_INFO: `/v3/projects/0ec9f428129e464b94bde0ecb73fe27d` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:04.974080 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ee855d-f7ae-44af-8b6b-59868d96739c None admin] RBAC: Authorizing `identity:get_project(project_id=0ec9f428129e464b94bde0ecb73fe27d)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:04.975501 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ee855d-f7ae-44af-8b6b-59868d96739c None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:04.977206 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 88/177] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 10 09:50:04 2022] GET /identity/v3/projects/0ec9f428129e464b94bde0ecb73fe27d => generated 312 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:04.986888 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ee855d-f7ae-44af-8b6b-59868d96739c None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:05.066610 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:05.087396 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:05.110714 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ee855d-f7ae-44af-8b6b-59868d96739c None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:05.147773 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1630c65-a6a8-42fa-9890-3fe23c301d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:05.148416 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1630c65-a6a8-42fa-9890-3fe23c301d21 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:05.148783 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1630c65-a6a8-42fa-9890-3fe23c301d21 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:05.149055 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1630c65-a6a8-42fa-9890-3fe23c301d21 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:05.149870 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1630c65-a6a8-42fa-9890-3fe23c301d21 None admin] RBAC: Adding query filter params (role.id=8daabcb6b7394e39b06a3453e33e32db, scope.project.id=0ec9f428129e464b94bde0ecb73fe27d, user.id=09ce8c0b6d584400af33d8c86a3b8bba) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:05.150220 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1630c65-a6a8-42fa-9890-3fe23c301d21 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:05.151733 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1630c65-a6a8-42fa-9890-3fe23c301d21 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:05.157704 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 89/178] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 10 09:50:04 2022] GET /identity/v3/role_assignments?user.id=09ce8c0b6d584400af33d8c86a3b8bba&scope.project.id=0ec9f428129e464b94bde0ecb73fe27d&role.id=8daabcb6b7394e39b06a3453e33e32db => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 09:50:05.185660 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338298c9-a541-492c-b687-987aa46a7f1a None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:05.251526 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07014bba-2c5f-4dfa-9533-9565ec76beba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:05.252179 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07014bba-2c5f-4dfa-9533-9565ec76beba None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:05.252455 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07014bba-2c5f-4dfa-9533-9565ec76beba None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:05.252723 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07014bba-2c5f-4dfa-9533-9565ec76beba None admin] PATH_INFO: `/v3/projects/b812d355220c4d00b5c4835f163074aa` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:05.253966 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07014bba-2c5f-4dfa-9533-9565ec76beba None admin] RBAC: Authorizing `identity:get_project(project_id=b812d355220c4d00b5c4835f163074aa)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:05.255469 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07014bba-2c5f-4dfa-9533-9565ec76beba None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:05.257396 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 90/179] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 10 09:50:04 2022] GET /identity/v3/projects/b812d355220c4d00b5c4835f163074aa => generated 298 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 09:50:05.263431 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1630c65-a6a8-42fa-9890-3fe23c301d21 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:05.400950 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1630c65-a6a8-42fa-9890-3fe23c301d21 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:05.446863 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fb60ed-c16c-48fb-9f4c-60ff45c43b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:05.447490 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fb60ed-c16c-48fb-9f4c-60ff45c43b6c None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:05.447765 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fb60ed-c16c-48fb-9f4c-60ff45c43b6c None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:05.448034 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fb60ed-c16c-48fb-9f4c-60ff45c43b6c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:05.448769 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fb60ed-c16c-48fb-9f4c-60ff45c43b6c None admin] RBAC: Adding query filter params (role.id=5d80017a50774daba0c1fee326754295, scope.project.id=b812d355220c4d00b5c4835f163074aa, user.id=09ce8c0b6d584400af33d8c86a3b8bba) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:05.449101 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fb60ed-c16c-48fb-9f4c-60ff45c43b6c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:05.450542 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fb60ed-c16c-48fb-9f4c-60ff45c43b6c None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:05.453537 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:05.457411 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 90/180] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 10 09:50:05 2022] GET /identity/v3/role_assignments?user.id=09ce8c0b6d584400af33d8c86a3b8bba&scope.project.id=b812d355220c4d00b5c4835f163074aa&role.id=5d80017a50774daba0c1fee326754295 => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:06.081184 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96d4aaa-45ac-44f8-940a-3d959034998d None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:06.081550 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96d4aaa-45ac-44f8-940a-3d959034998d None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:06.081841 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96d4aaa-45ac-44f8-940a-3d959034998d None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:06.084387 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 91/181] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:50:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:50:06.089190 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3304a66-b053-463a-960b-84c289061381 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:06.089660 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3304a66-b053-463a-960b-84c289061381 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:06.089760 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3304a66-b053-463a-960b-84c289061381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:06.108314 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-f3304a66-b053-463a-960b-84c289061381 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:50:06.109524 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-f3304a66-b053-463a-960b-84c289061381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:50:06.176215 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 91/182] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:50:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 09:50:06.198890 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96d4aaa-45ac-44f8-940a-3d959034998d None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:06.302712 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96d4aaa-45ac-44f8-940a-3d959034998d None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:06.329429 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:06.336995 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e562f030-98e7-402e-9a7c-a9f700f225a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:06.337597 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e562f030-98e7-402e-9a7c-a9f700f225a6 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:06.337876 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e562f030-98e7-402e-9a7c-a9f700f225a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:06.338142 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e562f030-98e7-402e-9a7c-a9f700f225a6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:06.348586 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e562f030-98e7-402e-9a7c-a9f700f225a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 09:50:06.353367 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-e562f030-98e7-402e-9a7c-a9f700f225a6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 09:50:06.353367 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:50:06.353367 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:50:06.353367 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:50:06.353367 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:50:06.353367 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:50:06.353367 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:50:06.353367 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:50:06.353367 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:50:06.353367 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:50:06.353367 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:50:06.353367 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:50:06.353367 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 09:50:06.353367 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 09:50:06.353367 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 09:50:06.353367 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 09:50:06.355401 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 09:50:06.355401 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 09:50:06.355401 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 09:50:06.355401 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 09:50:06.355401 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:50:06.355401 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:50:06.355401 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:50:06.355401 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:50:06.355401 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:50:06.355401 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:50:06.355401 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:50:06.355401 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:50:06.355401 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:50:06.355401 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:50:06.355401 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:50:06.355401 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:50:06.357354 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:50:06.357354 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:50:06.357354 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:50:06.357354 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:50:06.357354 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 09:50:06.357354 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 09:50:06.357354 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 09:50:06.357354 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 09:50:06.357354 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 09:50:06.357354 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 09:50:06.357354 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 09:50:06.357354 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:50:06.357354 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 92/183] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Aug 10 09:50:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:50:06.362494 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3304a66-b053-463a-960b-84c289061381 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:06.462154 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3304a66-b053-463a-960b-84c289061381 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:06.493434 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:06.496871 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ecf855-0d18-4a7a-94bf-a8ca1cae0550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:06.497631 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ecf855-0d18-4a7a-94bf-a8ca1cae0550 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:06.500502 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ecf855-0d18-4a7a-94bf-a8ca1cae0550 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:06.500502 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ecf855-0d18-4a7a-94bf-a8ca1cae0550 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:06.500502 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ecf855-0d18-4a7a-94bf-a8ca1cae0550 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:06.500502 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ecf855-0d18-4a7a-94bf-a8ca1cae0550 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:06.501086 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ecf855-0d18-4a7a-94bf-a8ca1cae0550 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:06.510122 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7441962a-ec16-4ad4-b8a0-65312858e853 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:06.510390 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 92/184] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 10 09:50:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:06.510545 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7441962a-ec16-4ad4-b8a0-65312858e853 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:06.510692 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7441962a-ec16-4ad4-b8a0-65312858e853 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:06.512047 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 93/185] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:50:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 09:50:06.520598 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7441962a-ec16-4ad4-b8a0-65312858e853 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:06.520875 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cc415c-c27f-4867-af44-38dfecf94c38 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:06.520875 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cc415c-c27f-4867-af44-38dfecf94c38 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:06.520875 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cc415c-c27f-4867-af44-38dfecf94c38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:06.539184 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-63cc415c-c27f-4867-af44-38dfecf94c38 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:50:06.540756 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-63cc415c-c27f-4867-af44-38dfecf94c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:50:06.614124 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 93/186] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:50:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 09:50:06.636080 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7441962a-ec16-4ad4-b8a0-65312858e853 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:06.639436 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cc415c-c27f-4867-af44-38dfecf94c38 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:06.676907 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a00dcb-3798-4d5a-88ca-e787fe25e8b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:06.677396 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a00dcb-3798-4d5a-88ca-e787fe25e8b6 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:06.677569 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a00dcb-3798-4d5a-88ca-e787fe25e8b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:06.679110 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a00dcb-3798-4d5a-88ca-e787fe25e8b6 None admin] PATH_INFO: `/v3/users/a66f47631ce44cb99877644834d1c2f2` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:06.693242 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a00dcb-3798-4d5a-88ca-e787fe25e8b6 None admin] RBAC: Authorizing `identity:get_user(user_id=a66f47631ce44cb99877644834d1c2f2)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:06.695466 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a00dcb-3798-4d5a-88ca-e787fe25e8b6 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:06.697496 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 94/187] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 10 09:50:06 2022] GET /identity/v3/users/a66f47631ce44cb99877644834d1c2f2 => generated 283 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 09:50:06.702790 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a00dcb-3798-4d5a-88ca-e787fe25e8b6 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:06.745114 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:06.764047 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cc415c-c27f-4867-af44-38dfecf94c38 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:06.789578 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:06.802476 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a00dcb-3798-4d5a-88ca-e787fe25e8b6 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:06.803714 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38a9e9e-0975-40c6-af0c-c802c62040fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:06.804770 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38a9e9e-0975-40c6-af0c-c802c62040fb None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:06.805304 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38a9e9e-0975-40c6-af0c-c802c62040fb None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:06.805786 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38a9e9e-0975-40c6-af0c-c802c62040fb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:06.817799 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38a9e9e-0975-40c6-af0c-c802c62040fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 09:50:06.823690 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-a38a9e9e-0975-40c6-af0c-c802c62040fb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 09:50:06.823690 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:50:06.823690 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:50:06.823690 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:50:06.823690 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:50:06.823690 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:50:06.823690 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:50:06.823690 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:50:06.823690 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:50:06.823690 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:50:06.823690 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:50:06.823690 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:50:06.823690 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 09:50:06.823690 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 09:50:06.823690 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 09:50:06.823690 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 09:50:06.824546 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 09:50:06.824546 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 09:50:06.824546 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 09:50:06.824546 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 09:50:06.824546 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:50:06.824546 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:50:06.824546 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:50:06.824546 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:50:06.824546 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:50:06.824546 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:50:06.824546 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:50:06.824546 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:50:06.824546 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:50:06.824546 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:50:06.824546 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:50:06.824546 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:50:06.825359 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:50:06.825359 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:50:06.825359 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:50:06.825359 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:50:06.825359 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 09:50:06.825359 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 09:50:06.825359 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 09:50:06.825359 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 09:50:06.825359 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 09:50:06.825359 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 09:50:06.825359 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 09:50:06.825359 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:50:06.827757 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 94/188] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Aug 10 09:50:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:50:06.833823 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38a9e9e-0975-40c6-af0c-c802c62040fb None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:06.838135 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550a3cfd-2581-4a45-9e9f-89528ae91f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:06.839375 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a3cfd-2581-4a45-9e9f-89528ae91f5f None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:06.839375 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a3cfd-2581-4a45-9e9f-89528ae91f5f None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:06.839375 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a3cfd-2581-4a45-9e9f-89528ae91f5f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:06.907737 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550a3cfd-2581-4a45-9e9f-89528ae91f5f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:06.909154 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550a3cfd-2581-4a45-9e9f-89528ae91f5f None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:06.941694 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38a9e9e-0975-40c6-af0c-c802c62040fb None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:06.957846 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:06.989691 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f019640-1270-40a7-9af4-351f2fb4f234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:06.990300 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f019640-1270-40a7-9af4-351f2fb4f234 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:06.990578 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f019640-1270-40a7-9af4-351f2fb4f234 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:06.990849 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f019640-1270-40a7-9af4-351f2fb4f234 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:06.991518 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f019640-1270-40a7-9af4-351f2fb4f234 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:06.991820 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f019640-1270-40a7-9af4-351f2fb4f234 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:06.993281 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f019640-1270-40a7-9af4-351f2fb4f234 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:07.000980 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 95/189] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 10 09:50:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 09:50:07.002150 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bec1dc-bc2c-4ad7-a1e5-f5965aa450ce None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:07.002431 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bec1dc-bc2c-4ad7-a1e5-f5965aa450ce None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:07.002722 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bec1dc-bc2c-4ad7-a1e5-f5965aa450ce None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:07.004051 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 96/190] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:50:07 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:50:07.004898 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407e9b30-f9d7-4fbd-8506-36d12c9b9cc4 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:07.005295 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407e9b30-f9d7-4fbd-8506-36d12c9b9cc4 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:07.005566 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407e9b30-f9d7-4fbd-8506-36d12c9b9cc4 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:07.006758 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 97/191] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:50:07 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:50:07.007440 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407e9b30-f9d7-4fbd-8506-36d12c9b9cc4 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:07.022385 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 95/192] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 10 09:50:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 10 09:50:07.023914 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5540273-f735-4be1-b9a3-f3bd2b13c007 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:07.024198 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5540273-f735-4be1-b9a3-f3bd2b13c007 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:07.024466 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5540273-f735-4be1-b9a3-f3bd2b13c007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:07.042350 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-a5540273-f735-4be1-b9a3-f3bd2b13c007 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:50:07.043533 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-a5540273-f735-4be1-b9a3-f3bd2b13c007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:50:07.058125 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:07.110084 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 96/193] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:50:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 09:50:07.111295 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f41af9a-047c-4c46-9894-2b532b210603 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:07.111569 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f41af9a-047c-4c46-9894-2b532b210603 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:07.111824 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f41af9a-047c-4c46-9894-2b532b210603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:07.115720 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407e9b30-f9d7-4fbd-8506-36d12c9b9cc4 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:07.130607 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-4f41af9a-047c-4c46-9894-2b532b210603 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:50:07.132399 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-4f41af9a-047c-4c46-9894-2b532b210603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:50:07.151809 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bd49d6-78d9-4ce6-b7b9-abc18a69651e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:07.152439 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bd49d6-78d9-4ce6-b7b9-abc18a69651e None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:07.152719 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bd49d6-78d9-4ce6-b7b9-abc18a69651e None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:07.152991 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bd49d6-78d9-4ce6-b7b9-abc18a69651e None admin] PATH_INFO: `/v3/users/a66f47631ce44cb99877644834d1c2f2` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:07.154152 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bd49d6-78d9-4ce6-b7b9-abc18a69651e None admin] RBAC: Authorizing `identity:get_user(user_id=a66f47631ce44cb99877644834d1c2f2)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:07.155601 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bd49d6-78d9-4ce6-b7b9-abc18a69651e None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:07.157237 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 98/194] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 10 09:50:07 2022] GET /identity/v3/users/a66f47631ce44cb99877644834d1c2f2 => generated 283 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:07.158050 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bd49d6-78d9-4ce6-b7b9-abc18a69651e None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:07.197779 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 97/195] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:50:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 09:50:07.201748 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f41af9a-047c-4c46-9894-2b532b210603 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:07.203331 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:07.269479 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bd49d6-78d9-4ce6-b7b9-abc18a69651e None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:07.282402 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:07.302660 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4272ffe6-ea48-4a3e-8d94-ec467845bda7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:07.303289 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4272ffe6-ea48-4a3e-8d94-ec467845bda7 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:07.303573 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4272ffe6-ea48-4a3e-8d94-ec467845bda7 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:07.303853 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4272ffe6-ea48-4a3e-8d94-ec467845bda7 None admin] PATH_INFO: `/v3/projects/7eb704c35a604e009f0597bf2e2a2684` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:07.305019 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4272ffe6-ea48-4a3e-8d94-ec467845bda7 None admin] RBAC: Authorizing `identity:get_project(project_id=7eb704c35a604e009f0597bf2e2a2684)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:07.306528 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4272ffe6-ea48-4a3e-8d94-ec467845bda7 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:07.308185 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 99/196] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 10 09:50:07 2022] GET /identity/v3/projects/7eb704c35a604e009f0597bf2e2a2684 => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:07.308946 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4272ffe6-ea48-4a3e-8d94-ec467845bda7 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:07.322691 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f41af9a-047c-4c46-9894-2b532b210603 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:07.359489 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e638e14-7bfb-4954-a3cd-8d3ba21abdbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:07.360116 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e638e14-7bfb-4954-a3cd-8d3ba21abdbc None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:07.360391 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e638e14-7bfb-4954-a3cd-8d3ba21abdbc None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:07.360683 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e638e14-7bfb-4954-a3cd-8d3ba21abdbc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:07.361812 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e638e14-7bfb-4954-a3cd-8d3ba21abdbc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:07.363267 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e638e14-7bfb-4954-a3cd-8d3ba21abdbc None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:07.365094 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 98/197] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 10 09:50:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:07.365871 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e638e14-7bfb-4954-a3cd-8d3ba21abdbc None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:07.413655 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4272ffe6-ea48-4a3e-8d94-ec467845bda7 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:07.432845 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:07.446651 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9e72da-d70c-407c-a86d-7e4d71fc61fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:07.447285 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9e72da-d70c-407c-a86d-7e4d71fc61fd None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:07.447563 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9e72da-d70c-407c-a86d-7e4d71fc61fd None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:07.447843 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9e72da-d70c-407c-a86d-7e4d71fc61fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:07.463908 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e638e14-7bfb-4954-a3cd-8d3ba21abdbc None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:07.494512 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:07.497754 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500a3d77-4bdf-4a1a-9b66-124571beaac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:07.498418 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500a3d77-4bdf-4a1a-9b66-124571beaac0 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:07.498695 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500a3d77-4bdf-4a1a-9b66-124571beaac0 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:07.499024 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500a3d77-4bdf-4a1a-9b66-124571beaac0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:07.509270 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500a3d77-4bdf-4a1a-9b66-124571beaac0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 09:50:07.513540 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9e72da-d70c-407c-a86d-7e4d71fc61fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:07.514334 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-500a3d77-4bdf-4a1a-9b66-124571beaac0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 09:50:07.514334 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:50:07.514334 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:50:07.514334 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:50:07.514334 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:50:07.514334 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:50:07.514334 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:50:07.514334 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:50:07.514334 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:50:07.514334 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:50:07.514334 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:50:07.514334 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:50:07.514334 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 09:50:07.514334 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 09:50:07.514334 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 09:50:07.514334 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 09:50:07.515208 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 09:50:07.515208 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 09:50:07.515208 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 09:50:07.515208 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 09:50:07.515208 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:50:07.515208 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:50:07.515208 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:50:07.515208 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:50:07.515208 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:50:07.515208 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:50:07.515208 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:50:07.515208 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:50:07.515208 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:50:07.515208 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:50:07.515208 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:50:07.515208 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:50:07.515980 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:50:07.515980 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:50:07.515980 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:50:07.515980 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:50:07.515980 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 09:50:07.515980 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 09:50:07.515980 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 09:50:07.515980 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 09:50:07.515980 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 09:50:07.515980 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 09:50:07.515980 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 09:50:07.515980 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:50:07.516563 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9e72da-d70c-407c-a86d-7e4d71fc61fd None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:07.516629 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 99/198] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 10 09:50:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:50:07.516629 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500a3d77-4bdf-4a1a-9b66-124571beaac0 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:07.614479 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500a3d77-4bdf-4a1a-9b66-124571beaac0 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:07.621174 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 100/199] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 10 09:50:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 09:50:07.621174 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9e72da-d70c-407c-a86d-7e4d71fc61fd None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:07.649089 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:07.656840 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5a42c5-3843-41d7-a2bf-6363b1511444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:07.657478 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5a42c5-3843-41d7-a2bf-6363b1511444 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:07.657754 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5a42c5-3843-41d7-a2bf-6363b1511444 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:07.658068 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5a42c5-3843-41d7-a2bf-6363b1511444 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:07.659453 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5a42c5-3843-41d7-a2bf-6363b1511444 None admin] RBAC: Adding query filter params (role.id=eb04edc46b3742d7a0f0ead26f68bc22, scope.project.id=7eb704c35a604e009f0597bf2e2a2684, user.id=a66f47631ce44cb99877644834d1c2f2) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:07.659453 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5a42c5-3843-41d7-a2bf-6363b1511444 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:07.660511 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5a42c5-3843-41d7-a2bf-6363b1511444 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:07.666108 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 100/200] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 10 09:50:07 2022] GET /identity/v3/role_assignments?user.id=a66f47631ce44cb99877644834d1c2f2&scope.project.id=7eb704c35a604e009f0597bf2e2a2684&role.id=eb04edc46b3742d7a0f0ead26f68bc22 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:07.666835 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5a42c5-3843-41d7-a2bf-6363b1511444 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:07.715316 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:07.738510 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9e72da-d70c-407c-a86d-7e4d71fc61fd None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:07.778292 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e744c9-e0d2-4e50-b396-1a2387408d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:07.779363 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e744c9-e0d2-4e50-b396-1a2387408d6c None admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:07.779649 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e744c9-e0d2-4e50-b396-1a2387408d6c None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:07.780067 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e744c9-e0d2-4e50-b396-1a2387408d6c None admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:07.780749 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e744c9-e0d2-4e50-b396-1a2387408d6c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:07.782366 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e744c9-e0d2-4e50-b396-1a2387408d6c None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:07.785326 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5a42c5-3843-41d7-a2bf-6363b1511444 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:07.806925 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 101/201] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Aug 10 09:50:07 2022] POST /identity/v3/users => generated 297 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 09:50:07.808031 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e744c9-e0d2-4e50-b396-1a2387408d6c None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:07.849027 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba163d93-85eb-4ea4-868c-38e7d92cbccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:07.849724 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba163d93-85eb-4ea4-868c-38e7d92cbccd None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:07.850004 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba163d93-85eb-4ea4-868c-38e7d92cbccd None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:07.850270 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba163d93-85eb-4ea4-868c-38e7d92cbccd None admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:07.850954 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba163d93-85eb-4ea4-868c-38e7d92cbccd None admin] RBAC: Adding query filter params (name=reader) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:07.851256 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba163d93-85eb-4ea4-868c-38e7d92cbccd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:07.852741 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba163d93-85eb-4ea4-868c-38e7d92cbccd None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:07.872871 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 101/202] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Aug 10 09:50:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:07.881912 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba163d93-85eb-4ea4-868c-38e7d92cbccd None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:07.983462 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e744c9-e0d2-4e50-b396-1a2387408d6c None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:07.985577 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:08.039733 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e56fa0c-af0f-4387-ab1a-78c64a159fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:08.040436 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e56fa0c-af0f-4387-ab1a-78c64a159fb0 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:08.040613 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e56fa0c-af0f-4387-ab1a-78c64a159fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:08.040916 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e56fa0c-af0f-4387-ab1a-78c64a159fb0 None admin] PATH_INFO: `/v3/projects/7eb704c35a604e009f0597bf2e2a2684` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:08.042630 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e56fa0c-af0f-4387-ab1a-78c64a159fb0 None admin] RBAC: Authorizing `identity:get_project(project_id=7eb704c35a604e009f0597bf2e2a2684)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:08.044087 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e56fa0c-af0f-4387-ab1a-78c64a159fb0 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:08.045804 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 102/203] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 10 09:50:07 2022] GET /identity/v3/projects/7eb704c35a604e009f0597bf2e2a2684 => generated 302 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:08.048047 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba163d93-85eb-4ea4-868c-38e7d92cbccd None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:08.052404 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e56fa0c-af0f-4387-ab1a-78c64a159fb0 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:08.055994 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:08.101707 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacda9e0-3831-42b1-8ee2-6c5e46d83496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:08.102356 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacda9e0-3831-42b1-8ee2-6c5e46d83496 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:08.102636 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacda9e0-3831-42b1-8ee2-6c5e46d83496 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:08.102907 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacda9e0-3831-42b1-8ee2-6c5e46d83496 None admin] PATH_INFO: `/v3/users/3c0f486722054cd5a2f88cca1e4ab1de` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:08.104051 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacda9e0-3831-42b1-8ee2-6c5e46d83496 None admin] RBAC: Authorizing `identity:get_user(user_id=3c0f486722054cd5a2f88cca1e4ab1de)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:08.105554 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacda9e0-3831-42b1-8ee2-6c5e46d83496 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:08.108128 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 102/204] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 10 09:50:07 2022] GET /identity/v3/users/3c0f486722054cd5a2f88cca1e4ab1de => generated 289 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 09:50:08.114486 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacda9e0-3831-42b1-8ee2-6c5e46d83496 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:08.187662 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e56fa0c-af0f-4387-ab1a-78c64a159fb0 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:08.229917 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacda9e0-3831-42b1-8ee2-6c5e46d83496 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:08.240358 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8060cc3-01b4-43d4-8178-63edfad3b66a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:08.240892 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8060cc3-01b4-43d4-8178-63edfad3b66a None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:08.241206 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8060cc3-01b4-43d4-8178-63edfad3b66a None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:08.241481 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8060cc3-01b4-43d4-8178-63edfad3b66a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:08.242395 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8060cc3-01b4-43d4-8178-63edfad3b66a None admin] RBAC: Adding query filter params (role.id=5d80017a50774daba0c1fee326754295, scope.project.id=7eb704c35a604e009f0597bf2e2a2684, user.id=a66f47631ce44cb99877644834d1c2f2) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:08.242706 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8060cc3-01b4-43d4-8178-63edfad3b66a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:08.244189 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8060cc3-01b4-43d4-8178-63edfad3b66a None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:08.250584 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 103/205] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 10 09:50:08 2022] GET /identity/v3/role_assignments?user.id=a66f47631ce44cb99877644834d1c2f2&scope.project.id=7eb704c35a604e009f0597bf2e2a2684&role.id=5d80017a50774daba0c1fee326754295 => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 09:50:08.256563 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:08.272135 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ef4986-ab9c-4f8b-a193-30851a4df890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:08.272741 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ef4986-ab9c-4f8b-a193-30851a4df890 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:08.273020 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ef4986-ab9c-4f8b-a193-30851a4df890 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:08.273389 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ef4986-ab9c-4f8b-a193-30851a4df890 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:08.351489 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ef4986-ab9c-4f8b-a193-30851a4df890 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:08.353097 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ef4986-ab9c-4f8b-a193-30851a4df890 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:08.461967 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 103/206] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 10 09:50:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 10 09:50:08.467421 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8060cc3-01b4-43d4-8178-63edfad3b66a None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:08.537086 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:08.581886 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8060cc3-01b4-43d4-8178-63edfad3b66a None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:08.626719 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2f09e8-40e1-4d86-b93b-890fcc84db39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:08.627366 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2f09e8-40e1-4d86-b93b-890fcc84db39 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:08.627645 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2f09e8-40e1-4d86-b93b-890fcc84db39 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:08.627920 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2f09e8-40e1-4d86-b93b-890fcc84db39 None admin] PATH_INFO: `/v3/projects/b812d355220c4d00b5c4835f163074aa` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:08.629085 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2f09e8-40e1-4d86-b93b-890fcc84db39 None admin] RBAC: Authorizing `identity:get_project(project_id=b812d355220c4d00b5c4835f163074aa)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:08.630621 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2f09e8-40e1-4d86-b93b-890fcc84db39 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:08.632329 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 104/207] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 10 09:50:08 2022] GET /identity/v3/projects/b812d355220c4d00b5c4835f163074aa => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:08.638259 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ef4986-ab9c-4f8b-a193-30851a4df890 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:08.671590 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:08.753418 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ef4986-ab9c-4f8b-a193-30851a4df890 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:08.787751 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cce3c92-f1e6-4602-8ef3-ae53abd910ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:08.788273 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cce3c92-f1e6-4602-8ef3-ae53abd910ab None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:08.788546 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cce3c92-f1e6-4602-8ef3-ae53abd910ab None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:08.788812 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cce3c92-f1e6-4602-8ef3-ae53abd910ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:08.789710 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cce3c92-f1e6-4602-8ef3-ae53abd910ab None admin] RBAC: Adding query filter params (role.id=362321830b5e4df5a2864d0852f5b7c4, scope.project.id=b812d355220c4d00b5c4835f163074aa, user.id=3c0f486722054cd5a2f88cca1e4ab1de) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:08.790014 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cce3c92-f1e6-4602-8ef3-ae53abd910ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:08.791450 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cce3c92-f1e6-4602-8ef3-ae53abd910ab None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:08.797767 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 104/208] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 10 09:50:08 2022] GET /identity/v3/role_assignments?user.id=3c0f486722054cd5a2f88cca1e4ab1de&scope.project.id=b812d355220c4d00b5c4835f163074aa&role.id=362321830b5e4df5a2864d0852f5b7c4 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:09.982439 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d343c6-257a-488b-a3c2-384fc072874c None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:09.982976 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d343c6-257a-488b-a3c2-384fc072874c None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:09.982976 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d343c6-257a-488b-a3c2-384fc072874c None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:09.984598 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 105/209] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:50:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:50:09.989827 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ba9365-e1c3-4f84-8b7d-e99715abadc2 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:09.990229 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ba9365-e1c3-4f84-8b7d-e99715abadc2 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:09.990381 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ba9365-e1c3-4f84-8b7d-e99715abadc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:10.008644 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-52ba9365-e1c3-4f84-8b7d-e99715abadc2 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:50:10.009876 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-52ba9365-e1c3-4f84-8b7d-e99715abadc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:50:10.077978 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 105/210] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:50:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 09:50:10.099810 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d343c6-257a-488b-a3c2-384fc072874c None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:10.117504 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c1be41-98cd-446d-8d02-7df4ccd85c84 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:10.117810 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c1be41-98cd-446d-8d02-7df4ccd85c84 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:10.118052 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c1be41-98cd-446d-8d02-7df4ccd85c84 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:10.119645 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 106/211] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:50:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:50:10.124784 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b0d780-46de-4fee-a331-0f9101690732 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:10.125098 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b0d780-46de-4fee-a331-0f9101690732 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:10.125373 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b0d780-46de-4fee-a331-0f9101690732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:10.144056 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-f7b0d780-46de-4fee-a331-0f9101690732 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:50:10.145274 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-f7b0d780-46de-4fee-a331-0f9101690732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:50:10.159293 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:10.219177 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d343c6-257a-488b-a3c2-384fc072874c None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:10.226858 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 107/212] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:50:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 09:50:10.249354 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b0d780-46de-4fee-a331-0f9101690732 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:10.257511 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f07e10-4fa9-42a8-9e24-e6d5d8338228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:10.258195 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f07e10-4fa9-42a8-9e24-e6d5d8338228 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:10.258475 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f07e10-4fa9-42a8-9e24-e6d5d8338228 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:10.258745 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f07e10-4fa9-42a8-9e24-e6d5d8338228 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:10.261799 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:10.271310 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f07e10-4fa9-42a8-9e24-e6d5d8338228 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 09:50:10.276410 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-f9f07e10-4fa9-42a8-9e24-e6d5d8338228 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 09:50:10.276410 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:50:10.276410 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:50:10.276410 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:50:10.276410 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:50:10.276410 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:50:10.276410 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:50:10.276410 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:50:10.276410 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:50:10.276410 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:50:10.276410 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:50:10.276410 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:50:10.276410 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 09:50:10.276410 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 09:50:10.276410 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 09:50:10.276410 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 09:50:10.277373 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 09:50:10.277373 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 09:50:10.277373 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 09:50:10.277373 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 09:50:10.277373 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:50:10.277373 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:50:10.277373 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:50:10.277373 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:50:10.277373 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:50:10.277373 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:50:10.277373 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:50:10.277373 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:50:10.277373 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:50:10.277373 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:50:10.277373 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:50:10.277373 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:50:10.278146 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:50:10.278146 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:50:10.278146 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:50:10.278146 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:50:10.278146 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 09:50:10.278146 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 09:50:10.278146 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 09:50:10.278146 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 09:50:10.278146 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 09:50:10.278146 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 09:50:10.278146 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 09:50:10.278146 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:50:10.278146 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 106/213] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Aug 10 09:50:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:50:10.283710 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f07e10-4fa9-42a8-9e24-e6d5d8338228 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:10.355380 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b0d780-46de-4fee-a331-0f9101690732 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:10.389762 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc10f5a-66e3-487c-9ab7-17561c6c9998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:10.390398 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc10f5a-66e3-487c-9ab7-17561c6c9998 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:10.390665 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc10f5a-66e3-487c-9ab7-17561c6c9998 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:10.390933 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc10f5a-66e3-487c-9ab7-17561c6c9998 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:10.392176 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f07e10-4fa9-42a8-9e24-e6d5d8338228 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:10.401306 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc10f5a-66e3-487c-9ab7-17561c6c9998 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 09:50:10.405940 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-3bc10f5a-66e3-487c-9ab7-17561c6c9998 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 09:50:10.405940 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:50:10.405940 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:50:10.405940 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:50:10.405940 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:50:10.405940 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:50:10.405940 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:50:10.405940 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:50:10.405940 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:50:10.405940 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:50:10.405940 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:50:10.405940 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:50:10.405940 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 09:50:10.405940 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 09:50:10.405940 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 09:50:10.405940 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 09:50:10.406815 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 09:50:10.406815 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 09:50:10.406815 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 09:50:10.406815 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 09:50:10.406815 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:50:10.406815 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:50:10.406815 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:50:10.406815 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:50:10.406815 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:50:10.406815 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:50:10.406815 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:50:10.406815 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:50:10.406815 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:50:10.406815 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:50:10.406815 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:50:10.406815 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:50:10.407574 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:50:10.407574 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:50:10.407574 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:50:10.407574 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:50:10.407574 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 09:50:10.407574 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 09:50:10.407574 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 09:50:10.407574 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 09:50:10.407574 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 09:50:10.407574 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 09:50:10.407574 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 09:50:10.407574 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:50:10.412687 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 108/214] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 10 09:50:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 09:50:10.414140 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3a4032-8ba9-47b6-a672-ba06a56db86a None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:10.414140 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3a4032-8ba9-47b6-a672-ba06a56db86a None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:10.414429 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3a4032-8ba9-47b6-a672-ba06a56db86a None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:10.417181 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 109/215] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:50:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:50:10.417181 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3a4032-8ba9-47b6-a672-ba06a56db86a None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:10.428820 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:10.435819 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82bef27-b8d2-48fb-836f-f831b12ead41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:10.436539 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82bef27-b8d2-48fb-836f-f831b12ead41 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:10.436885 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82bef27-b8d2-48fb-836f-f831b12ead41 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:10.437328 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82bef27-b8d2-48fb-836f-f831b12ead41 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:10.438168 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82bef27-b8d2-48fb-836f-f831b12ead41 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:10.438542 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82bef27-b8d2-48fb-836f-f831b12ead41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:10.439990 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82bef27-b8d2-48fb-836f-f831b12ead41 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:10.449740 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 107/216] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 10 09:50:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:10.450898 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a458f87-ab3f-455f-8ba4-04d0cf84e929 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:10.451243 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a458f87-ab3f-455f-8ba4-04d0cf84e929 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:10.451556 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a458f87-ab3f-455f-8ba4-04d0cf84e929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:10.470311 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-5a458f87-ab3f-455f-8ba4-04d0cf84e929 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:50:10.471498 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-5a458f87-ab3f-455f-8ba4-04d0cf84e929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:50:10.520456 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3a4032-8ba9-47b6-a672-ba06a56db86a None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:10.525723 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:10.539345 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 108/217] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:50:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 09:50:10.540158 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a458f87-ab3f-455f-8ba4-04d0cf84e929 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:10.558481 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c02839-b9fd-41e8-b1a4-4ec6455dbf3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:10.559278 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c02839-b9fd-41e8-b1a4-4ec6455dbf3a None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:10.559694 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c02839-b9fd-41e8-b1a4-4ec6455dbf3a None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:10.560122 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c02839-b9fd-41e8-b1a4-4ec6455dbf3a None admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:10.561454 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c02839-b9fd-41e8-b1a4-4ec6455dbf3a None admin] RBAC: Adding query filter params (name=member) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:10.562216 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c02839-b9fd-41e8-b1a4-4ec6455dbf3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:10.564197 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c02839-b9fd-41e8-b1a4-4ec6455dbf3a None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:10.577683 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 110/218] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Aug 10 09:50:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:10.577683 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4c7ac8-df29-433e-9ce1-01fc5f721757 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:10.577683 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4c7ac8-df29-433e-9ce1-01fc5f721757 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:10.577683 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4c7ac8-df29-433e-9ce1-01fc5f721757 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:10.577683 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 111/219] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:50:10 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:50:10.577683 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4c7ac8-df29-433e-9ce1-01fc5f721757 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:10.638031 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a458f87-ab3f-455f-8ba4-04d0cf84e929 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:10.647423 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:10.671601 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d676b47f-dfca-457d-9982-82832b7ebae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:10.672304 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d676b47f-dfca-457d-9982-82832b7ebae1 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:10.672561 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d676b47f-dfca-457d-9982-82832b7ebae1 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:10.672901 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d676b47f-dfca-457d-9982-82832b7ebae1 None admin] PATH_INFO: `/v3/users/a66f47631ce44cb99877644834d1c2f2` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:10.675970 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d676b47f-dfca-457d-9982-82832b7ebae1 None admin] RBAC: Authorizing `identity:get_user(user_id=a66f47631ce44cb99877644834d1c2f2)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:10.675970 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d676b47f-dfca-457d-9982-82832b7ebae1 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:10.677153 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 109/220] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 10 09:50:10 2022] GET /identity/v3/users/a66f47631ce44cb99877644834d1c2f2 => generated 283 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:10.680379 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4c7ac8-df29-433e-9ce1-01fc5f721757 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:10.682414 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d676b47f-dfca-457d-9982-82832b7ebae1 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:10.714874 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d555de-1fc3-4f3c-b50f-eef189981019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:10.715470 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d555de-1fc3-4f3c-b50f-eef189981019 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:10.715750 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d555de-1fc3-4f3c-b50f-eef189981019 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:10.716020 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d555de-1fc3-4f3c-b50f-eef189981019 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:10.717161 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d555de-1fc3-4f3c-b50f-eef189981019 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:10.718630 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d555de-1fc3-4f3c-b50f-eef189981019 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:10.720199 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 112/221] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 10 09:50:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:10.721300 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80401a8d-fc7c-44b0-9169-22123eaaed49 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:10.721580 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80401a8d-fc7c-44b0-9169-22123eaaed49 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:10.721852 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80401a8d-fc7c-44b0-9169-22123eaaed49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:10.738630 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-80401a8d-fc7c-44b0-9169-22123eaaed49 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:50:10.739801 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-80401a8d-fc7c-44b0-9169-22123eaaed49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:50:10.741613 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:10.783490 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d676b47f-dfca-457d-9982-82832b7ebae1 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:10.804548 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 113/222] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:50:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 09:50:10.805570 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80401a8d-fc7c-44b0-9169-22123eaaed49 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:10.817929 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6b3884-9658-4370-8c46-75cb45fc20a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:10.818748 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6b3884-9658-4370-8c46-75cb45fc20a8 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:10.819255 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6b3884-9658-4370-8c46-75cb45fc20a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:10.820029 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6b3884-9658-4370-8c46-75cb45fc20a8 None admin] PATH_INFO: `/v3/users/6d35762fc43940b6b2177d5c177a3152` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:10.836082 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6b3884-9658-4370-8c46-75cb45fc20a8 None admin] RBAC: Authorizing `identity:get_user(user_id=6d35762fc43940b6b2177d5c177a3152)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:10.837584 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6b3884-9658-4370-8c46-75cb45fc20a8 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:10.839230 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 110/223] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 10 09:50:10 2022] GET /identity/v3/users/6d35762fc43940b6b2177d5c177a3152 => generated 297 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:10.839973 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6b3884-9658-4370-8c46-75cb45fc20a8 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:10.874799 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:10.909994 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80401a8d-fc7c-44b0-9169-22123eaaed49 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:10.937694 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6b3884-9658-4370-8c46-75cb45fc20a8 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:10.942691 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e000465a-cf8c-4476-aa22-3c528a00d92f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:10.943321 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e000465a-cf8c-4476-aa22-3c528a00d92f None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:10.943599 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e000465a-cf8c-4476-aa22-3c528a00d92f None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:10.943869 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e000465a-cf8c-4476-aa22-3c528a00d92f None admin] PATH_INFO: `/v3/projects/7eb704c35a604e009f0597bf2e2a2684` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:10.945399 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e000465a-cf8c-4476-aa22-3c528a00d92f None admin] RBAC: Authorizing `identity:get_project(project_id=7eb704c35a604e009f0597bf2e2a2684)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:10.946862 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e000465a-cf8c-4476-aa22-3c528a00d92f None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:10.948659 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 114/224] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 10 09:50:10 2022] GET /identity/v3/projects/7eb704c35a604e009f0597bf2e2a2684 => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:10.949349 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e000465a-cf8c-4476-aa22-3c528a00d92f None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:10.956325 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:10.977563 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cbe37e-2c83-4772-ab83-6f00cc7de92a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:10.978194 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cbe37e-2c83-4772-ab83-6f00cc7de92a None admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:10.978475 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cbe37e-2c83-4772-ab83-6f00cc7de92a None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:10.978742 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cbe37e-2c83-4772-ab83-6f00cc7de92a None admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:10.979390 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cbe37e-2c83-4772-ab83-6f00cc7de92a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:10.980837 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cbe37e-2c83-4772-ab83-6f00cc7de92a None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:11.001504 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 111/225] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Aug 10 09:50:10 2022] POST /identity/v3/users => generated 297 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 09:50:11.003155 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cbe37e-2c83-4772-ab83-6f00cc7de92a None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:11.060047 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e000465a-cf8c-4476-aa22-3c528a00d92f None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:11.097798 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e22e9c-2f15-45f4-8021-da17e5bb29f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:11.098443 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e22e9c-2f15-45f4-8021-da17e5bb29f9 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:11.098724 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e22e9c-2f15-45f4-8021-da17e5bb29f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:11.098996 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e22e9c-2f15-45f4-8021-da17e5bb29f9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:11.102021 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:11.112361 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e22e9c-2f15-45f4-8021-da17e5bb29f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 09:50:11.116429 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cbe37e-2c83-4772-ab83-6f00cc7de92a None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:11.117822 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-a6e22e9c-2f15-45f4-8021-da17e5bb29f9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 09:50:11.117822 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:50:11.117822 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:50:11.117822 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:50:11.117822 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:50:11.117822 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:50:11.117822 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:50:11.117822 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:50:11.117822 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:50:11.117822 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:50:11.117822 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:50:11.117822 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:50:11.117822 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 09:50:11.117822 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 09:50:11.117822 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 09:50:11.117822 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 09:50:11.118771 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 09:50:11.118771 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 09:50:11.118771 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 09:50:11.118771 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 09:50:11.118771 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:50:11.118771 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:50:11.118771 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:50:11.118771 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:50:11.118771 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:50:11.118771 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:50:11.118771 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:50:11.118771 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:50:11.118771 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:50:11.118771 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:50:11.118771 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:50:11.118771 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:50:11.119540 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:50:11.119540 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:50:11.119540 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:50:11.119540 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:50:11.119540 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 09:50:11.119540 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 09:50:11.119540 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 09:50:11.119540 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 09:50:11.119540 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 09:50:11.119540 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 09:50:11.119540 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 09:50:11.119540 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:50:11.119540 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 115/226] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Aug 10 09:50:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:50:11.120174 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e22e9c-2f15-45f4-8021-da17e5bb29f9 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:11.162753 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22661a61-f97e-424e-8f11-828d6233a814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:11.163371 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22661a61-f97e-424e-8f11-828d6233a814 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:11.163649 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22661a61-f97e-424e-8f11-828d6233a814 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:11.163969 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22661a61-f97e-424e-8f11-828d6233a814 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:11.215794 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:11.237765 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e22e9c-2f15-45f4-8021-da17e5bb29f9 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:11.254132 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22661a61-f97e-424e-8f11-828d6233a814 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:11.255669 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22661a61-f97e-424e-8f11-828d6233a814 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:11.283648 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42714ebe-8a5a-482f-8033-2dbd3a9aecd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:11.284322 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42714ebe-8a5a-482f-8033-2dbd3a9aecd6 None admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:11.284603 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42714ebe-8a5a-482f-8033-2dbd3a9aecd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:11.284879 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42714ebe-8a5a-482f-8033-2dbd3a9aecd6 None admin] PATH_INFO: `/v3/projects/7eb704c35a604e009f0597bf2e2a2684/users/a66f47631ce44cb99877644834d1c2f2/roles/eb04edc46b3742d7a0f0ead26f68bc22` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:11.286856 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42714ebe-8a5a-482f-8033-2dbd3a9aecd6 None admin] RBAC: Authorizing `identity:create_grant(project_id=7eb704c35a604e009f0597bf2e2a2684, user_id=a66f47631ce44cb99877644834d1c2f2, role_id=eb04edc46b3742d7a0f0ead26f68bc22)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:11.288351 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42714ebe-8a5a-482f-8033-2dbd3a9aecd6 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:11.303405 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 116/227] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Aug 10 09:50:11 2022] PUT /identity/v3/projects/7eb704c35a604e009f0597bf2e2a2684/users/a66f47631ce44cb99877644834d1c2f2/roles/eb04edc46b3742d7a0f0ead26f68bc22 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 09:50:11.304238 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42714ebe-8a5a-482f-8033-2dbd3a9aecd6 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:11.376789 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:11.404575 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 112/228] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 10 09:50:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 09:50:11.410067 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22661a61-f97e-424e-8f11-828d6233a814 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:11.432692 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42714ebe-8a5a-482f-8033-2dbd3a9aecd6 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:11.501850 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c94ff0-e252-487c-b8a6-1deddbd7e684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:11.502490 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c94ff0-e252-487c-b8a6-1deddbd7e684 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:11.502910 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c94ff0-e252-487c-b8a6-1deddbd7e684 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:11.503184 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c94ff0-e252-487c-b8a6-1deddbd7e684 None admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:11.504366 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c94ff0-e252-487c-b8a6-1deddbd7e684 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:11.504669 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c94ff0-e252-487c-b8a6-1deddbd7e684 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:11.506436 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c94ff0-e252-487c-b8a6-1deddbd7e684 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:11.506622 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:11.518612 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 117/229] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 10 09:50:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:11.523583 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c94ff0-e252-487c-b8a6-1deddbd7e684 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:11.547741 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22661a61-f97e-424e-8f11-828d6233a814 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:11.599173 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acac45c-3c87-4f1c-a315-43e4d7c2ca58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:11.599813 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acac45c-3c87-4f1c-a315-43e4d7c2ca58 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:11.600086 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acac45c-3c87-4f1c-a315-43e4d7c2ca58 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:11.600353 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acac45c-3c87-4f1c-a315-43e4d7c2ca58 None admin] PATH_INFO: `/v3/projects/7eb704c35a604e009f0597bf2e2a2684` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:11.602416 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acac45c-3c87-4f1c-a315-43e4d7c2ca58 None admin] RBAC: Authorizing `identity:get_project(project_id=7eb704c35a604e009f0597bf2e2a2684)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:11.605045 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acac45c-3c87-4f1c-a315-43e4d7c2ca58 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:11.606911 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 113/230] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 10 09:50:11 2022] GET /identity/v3/projects/7eb704c35a604e009f0597bf2e2a2684 => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 09:50:11.613886 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acac45c-3c87-4f1c-a315-43e4d7c2ca58 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:11.678241 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c94ff0-e252-487c-b8a6-1deddbd7e684 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:11.730532 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:11.757642 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acac45c-3c87-4f1c-a315-43e4d7c2ca58 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:11.781774 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d06b7f-8dfb-4049-ad8f-b853d611d13d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:11.782423 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d06b7f-8dfb-4049-ad8f-b853d611d13d None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:11.782695 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d06b7f-8dfb-4049-ad8f-b853d611d13d None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:11.782963 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d06b7f-8dfb-4049-ad8f-b853d611d13d None admin] PATH_INFO: `/v3/users/a66f47631ce44cb99877644834d1c2f2` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:11.789869 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d06b7f-8dfb-4049-ad8f-b853d611d13d None admin] RBAC: Authorizing `identity:get_user(user_id=a66f47631ce44cb99877644834d1c2f2)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:11.791366 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d06b7f-8dfb-4049-ad8f-b853d611d13d None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:11.793344 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 118/231] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 10 09:50:11 2022] GET /identity/v3/users/a66f47631ce44cb99877644834d1c2f2 => generated 283 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 09:50:11.799519 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db27c02-a73b-4a3d-8792-8bb6f7b01a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:11.800162 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db27c02-a73b-4a3d-8792-8bb6f7b01a39 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:11.800441 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db27c02-a73b-4a3d-8792-8bb6f7b01a39 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:11.800717 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db27c02-a73b-4a3d-8792-8bb6f7b01a39 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:11.801497 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db27c02-a73b-4a3d-8792-8bb6f7b01a39 None admin] RBAC: Adding query filter params (role.id=8daabcb6b7394e39b06a3453e33e32db, scope.project.id=7eb704c35a604e009f0597bf2e2a2684, user.id=6d35762fc43940b6b2177d5c177a3152) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:11.801811 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db27c02-a73b-4a3d-8792-8bb6f7b01a39 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:11.803267 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db27c02-a73b-4a3d-8792-8bb6f7b01a39 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:11.810121 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 114/232] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 10 09:50:11 2022] GET /identity/v3/role_assignments?user.id=6d35762fc43940b6b2177d5c177a3152&scope.project.id=7eb704c35a604e009f0597bf2e2a2684&role.id=8daabcb6b7394e39b06a3453e33e32db => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:11.810822 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d06b7f-8dfb-4049-ad8f-b853d611d13d None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:11.981490 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d06b7f-8dfb-4049-ad8f-b853d611d13d None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:12.026875 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8674bfd3-705a-45df-95ef-cf0dba7832a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:12.027524 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8674bfd3-705a-45df-95ef-cf0dba7832a9 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:12.027804 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8674bfd3-705a-45df-95ef-cf0dba7832a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:12.028076 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8674bfd3-705a-45df-95ef-cf0dba7832a9 None admin] PATH_INFO: `/v3/projects/7eb704c35a604e009f0597bf2e2a2684` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:12.029480 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8674bfd3-705a-45df-95ef-cf0dba7832a9 None admin] RBAC: Authorizing `identity:get_project(project_id=7eb704c35a604e009f0597bf2e2a2684)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:12.030960 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8674bfd3-705a-45df-95ef-cf0dba7832a9 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:12.032615 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 119/233] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 10 09:50:11 2022] GET /identity/v3/projects/7eb704c35a604e009f0597bf2e2a2684 => generated 302 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:12.038620 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db27c02-a73b-4a3d-8792-8bb6f7b01a39 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:12.041819 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:12.143479 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db27c02-a73b-4a3d-8792-8bb6f7b01a39 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:12.183675 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6324cbaf-d2e4-4c33-8bd1-1d3ffb01d37b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:12.184347 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6324cbaf-d2e4-4c33-8bd1-1d3ffb01d37b None admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:12.184626 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6324cbaf-d2e4-4c33-8bd1-1d3ffb01d37b None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:12.184897 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6324cbaf-d2e4-4c33-8bd1-1d3ffb01d37b None admin] PATH_INFO: `/v3/projects/7eb704c35a604e009f0597bf2e2a2684/users/a66f47631ce44cb99877644834d1c2f2/roles/5d80017a50774daba0c1fee326754295` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:12.187122 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6324cbaf-d2e4-4c33-8bd1-1d3ffb01d37b None admin] RBAC: Authorizing `identity:create_grant(project_id=7eb704c35a604e009f0597bf2e2a2684, user_id=a66f47631ce44cb99877644834d1c2f2, role_id=5d80017a50774daba0c1fee326754295)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:12.188591 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6324cbaf-d2e4-4c33-8bd1-1d3ffb01d37b None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:12.212582 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 115/234] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Aug 10 09:50:12 2022] PUT /identity/v3/projects/7eb704c35a604e009f0597bf2e2a2684/users/a66f47631ce44cb99877644834d1c2f2/roles/5d80017a50774daba0c1fee326754295 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 09:50:13.236612 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15eab43-c92a-408a-9f53-f89d6a853baf None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:13.237180 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15eab43-c92a-408a-9f53-f89d6a853baf None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:13.237180 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15eab43-c92a-408a-9f53-f89d6a853baf None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:13.238806 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 120/235] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:50:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:50:13.244238 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59ba8e7-2bd2-4a2e-ae84-f79e0692f5cf None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:13.244700 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59ba8e7-2bd2-4a2e-ae84-f79e0692f5cf None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:13.244774 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59ba8e7-2bd2-4a2e-ae84-f79e0692f5cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:13.271201 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-d59ba8e7-2bd2-4a2e-ae84-f79e0692f5cf None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:50:13.272738 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-d59ba8e7-2bd2-4a2e-ae84-f79e0692f5cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:50:13.344193 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:13.361386 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 116/236] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:50:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 09:50:13.378726 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15eab43-c92a-408a-9f53-f89d6a853baf None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:13.454806 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:13.456377 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2d8185-020e-4749-ab8e-3e1070c14cf1 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:13.456679 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2d8185-020e-4749-ab8e-3e1070c14cf1 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:13.457037 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2d8185-020e-4749-ab8e-3e1070c14cf1 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:13.458777 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 117/237] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:50:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:50:13.464366 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995bab06-f271-4685-9913-dc064e39d8b5 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:13.464646 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995bab06-f271-4685-9913-dc064e39d8b5 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:13.464921 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995bab06-f271-4685-9913-dc064e39d8b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:13.490125 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-995bab06-f271-4685-9913-dc064e39d8b5 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:50:13.491238 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-995bab06-f271-4685-9913-dc064e39d8b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:50:13.538028 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15eab43-c92a-408a-9f53-f89d6a853baf None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:13.599418 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ce16cf-da4f-4129-ad0a-5f50dbf52f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:13.601747 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ce16cf-da4f-4129-ad0a-5f50dbf52f57 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:13.602039 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ce16cf-da4f-4129-ad0a-5f50dbf52f57 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:13.602310 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ce16cf-da4f-4129-ad0a-5f50dbf52f57 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:13.618486 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 118/238] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:50:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 09:50:13.629309 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ce16cf-da4f-4129-ad0a-5f50dbf52f57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 09:50:13.634265 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-f1ce16cf-da4f-4129-ad0a-5f50dbf52f57 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 09:50:13.634265 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:50:13.634265 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:50:13.634265 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:50:13.634265 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:50:13.634265 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:50:13.634265 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:50:13.634265 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:50:13.634265 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:50:13.634265 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:50:13.634265 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:50:13.634265 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:50:13.634265 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 09:50:13.634265 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 09:50:13.634265 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 09:50:13.634265 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 09:50:13.635112 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 09:50:13.635112 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 09:50:13.635112 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 09:50:13.635112 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 09:50:13.635112 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:50:13.635112 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:50:13.635112 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:50:13.635112 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:50:13.635112 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:50:13.635112 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:50:13.635112 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:50:13.635112 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:50:13.635112 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:50:13.635112 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:50:13.635112 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:50:13.635112 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:50:13.635886 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:50:13.635886 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:50:13.635886 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:50:13.635886 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:50:13.635886 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 09:50:13.635886 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 09:50:13.635886 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 09:50:13.635886 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 09:50:13.635886 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 09:50:13.635886 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 09:50:13.635886 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 09:50:13.635886 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:50:13.635886 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 121/239] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 10 09:50:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:50:13.641781 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995bab06-f271-4685-9913-dc064e39d8b5 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:13.708646 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ce16cf-da4f-4129-ad0a-5f50dbf52f57 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:13.805391 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995bab06-f271-4685-9913-dc064e39d8b5 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:13.835164 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:13.847078 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b90e71d-2d02-497f-bdf8-9aa34bf5d007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:13.847904 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b90e71d-2d02-497f-bdf8-9aa34bf5d007 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:13.848144 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b90e71d-2d02-497f-bdf8-9aa34bf5d007 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:13.848429 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b90e71d-2d02-497f-bdf8-9aa34bf5d007 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:13.849133 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b90e71d-2d02-497f-bdf8-9aa34bf5d007 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:13.849444 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b90e71d-2d02-497f-bdf8-9aa34bf5d007 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:13.850836 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b90e71d-2d02-497f-bdf8-9aa34bf5d007 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:13.859716 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 119/240] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Aug 10 09:50:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:13.860669 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d47d5-f0eb-407b-a70e-d6e425f1e7c0 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:13.860957 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d47d5-f0eb-407b-a70e-d6e425f1e7c0 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:13.865313 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d47d5-f0eb-407b-a70e-d6e425f1e7c0 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:13.866777 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 120/241] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:50:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:50:13.871142 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ce16cf-da4f-4129-ad0a-5f50dbf52f57 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:13.872253 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7d47d5-f0eb-407b-a70e-d6e425f1e7c0 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:13.890649 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:13.914646 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009457d7-2098-4892-8e35-6038265c125b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:13.915745 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009457d7-2098-4892-8e35-6038265c125b None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:13.916220 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009457d7-2098-4892-8e35-6038265c125b None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:13.916716 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009457d7-2098-4892-8e35-6038265c125b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:13.918265 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009457d7-2098-4892-8e35-6038265c125b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:13.920122 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009457d7-2098-4892-8e35-6038265c125b None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:13.922463 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 122/242] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 10 09:50:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:13.924084 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c9ce02-0589-4952-badd-7d6ae2674ec9 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:13.924562 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c9ce02-0589-4952-badd-7d6ae2674ec9 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:13.925182 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c9ce02-0589-4952-badd-7d6ae2674ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:13.944262 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-07c9ce02-0589-4952-badd-7d6ae2674ec9 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:50:13.946432 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-07c9ce02-0589-4952-badd-7d6ae2674ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:50:13.981787 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7d47d5-f0eb-407b-a70e-d6e425f1e7c0 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:14.023912 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 123/243] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:50:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 09:50:14.024812 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c9ce02-0589-4952-badd-7d6ae2674ec9 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:14.027780 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ca8644-1c72-4960-8f12-762f86f86fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:14.028481 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ca8644-1c72-4960-8f12-762f86f86fc9 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:14.028771 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ca8644-1c72-4960-8f12-762f86f86fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:14.029044 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ca8644-1c72-4960-8f12-762f86f86fc9 None admin] PATH_INFO: `/v3/users/ca1994432a5d4429b929c5ed2c042906` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:14.045321 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ca8644-1c72-4960-8f12-762f86f86fc9 None admin] RBAC: Authorizing `identity:get_user(user_id=ca1994432a5d4429b929c5ed2c042906)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:14.046888 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ca8644-1c72-4960-8f12-762f86f86fc9 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:14.048691 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 121/244] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 10 09:50:13 2022] GET /identity/v3/users/ca1994432a5d4429b929c5ed2c042906 => generated 297 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:14.060407 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ca8644-1c72-4960-8f12-762f86f86fc9 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:14.113851 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:14.149862 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c9ce02-0589-4952-badd-7d6ae2674ec9 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:14.166405 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:14.185855 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ca8644-1c72-4960-8f12-762f86f86fc9 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:14.196739 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2735fbe-78bd-44d1-81ef-cf5c2755ba3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:14.197579 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2735fbe-78bd-44d1-81ef-cf5c2755ba3a None admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:14.198006 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2735fbe-78bd-44d1-81ef-cf5c2755ba3a None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:14.198341 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2735fbe-78bd-44d1-81ef-cf5c2755ba3a None admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:14.199048 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2735fbe-78bd-44d1-81ef-cf5c2755ba3a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:14.200730 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2735fbe-78bd-44d1-81ef-cf5c2755ba3a None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:14.222643 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc17712f-89d3-4373-a628-152dc49cb526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:14.223293 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc17712f-89d3-4373-a628-152dc49cb526 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:14.223612 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc17712f-89d3-4373-a628-152dc49cb526 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:14.223891 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc17712f-89d3-4373-a628-152dc49cb526 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:14.225347 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 124/245] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Aug 10 09:50:14 2022] POST /identity/v3/users => generated 293 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 09:50:14.226640 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2735fbe-78bd-44d1-81ef-cf5c2755ba3a None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:14.256080 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc17712f-89d3-4373-a628-152dc49cb526 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 09:50:14.266368 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-cc17712f-89d3-4373-a628-152dc49cb526 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 09:50:14.266368 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:50:14.266368 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:50:14.266368 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:50:14.266368 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:50:14.266368 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:50:14.266368 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:50:14.266368 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:50:14.266368 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:50:14.266368 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:50:14.266368 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:50:14.266368 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:50:14.266368 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 09:50:14.266368 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 09:50:14.266368 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 09:50:14.266368 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 09:50:14.267340 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 09:50:14.267340 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 09:50:14.267340 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 09:50:14.267340 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 09:50:14.267340 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:50:14.267340 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:50:14.267340 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:50:14.267340 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:50:14.267340 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:50:14.267340 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:50:14.267340 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:50:14.267340 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:50:14.267340 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:50:14.267340 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:50:14.267340 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:50:14.267340 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:50:14.268248 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:50:14.268248 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:50:14.268248 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:50:14.268248 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:50:14.268248 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 09:50:14.268248 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 09:50:14.268248 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 09:50:14.268248 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 09:50:14.268248 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 09:50:14.268248 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 09:50:14.268248 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 09:50:14.268248 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:50:14.268248 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 122/246] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Aug 10 09:50:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 09:50:14.275419 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc17712f-89d3-4373-a628-152dc49cb526 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:14.450569 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2735fbe-78bd-44d1-81ef-cf5c2755ba3a None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:14.466246 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc17712f-89d3-4373-a628-152dc49cb526 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:14.468787 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:14.499568 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26e1080-9a5a-4f8e-9ad8-c340e98479d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:14.500581 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26e1080-9a5a-4f8e-9ad8-c340e98479d0 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:14.501008 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26e1080-9a5a-4f8e-9ad8-c340e98479d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:14.501445 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26e1080-9a5a-4f8e-9ad8-c340e98479d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:14.514621 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf89452-0a87-428f-b8cf-d259e712690c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:14.515609 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf89452-0a87-428f-b8cf-d259e712690c None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:14.519277 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf89452-0a87-428f-b8cf-d259e712690c None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:14.519718 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf89452-0a87-428f-b8cf-d259e712690c None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:14.520689 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf89452-0a87-428f-b8cf-d259e712690c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:14.520998 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf89452-0a87-428f-b8cf-d259e712690c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:14.522471 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf89452-0a87-428f-b8cf-d259e712690c None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:14.534779 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 123/247] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 10 09:50:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:14.543298 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf89452-0a87-428f-b8cf-d259e712690c None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:14.559205 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:14.603859 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26e1080-9a5a-4f8e-9ad8-c340e98479d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:14.605701 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26e1080-9a5a-4f8e-9ad8-c340e98479d0 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:14.671134 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf89452-0a87-428f-b8cf-d259e712690c None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:14.721396 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fe3c19-2d9d-43e1-a745-7c1fd980bae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:14.722294 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe3c19-2d9d-43e1-a745-7c1fd980bae8 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:14.722719 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe3c19-2d9d-43e1-a745-7c1fd980bae8 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:14.723128 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe3c19-2d9d-43e1-a745-7c1fd980bae8 None admin] PATH_INFO: `/v3/users/a66f47631ce44cb99877644834d1c2f2` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:14.724416 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fe3c19-2d9d-43e1-a745-7c1fd980bae8 None admin] RBAC: Authorizing `identity:get_user(user_id=a66f47631ce44cb99877644834d1c2f2)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:14.726131 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fe3c19-2d9d-43e1-a745-7c1fd980bae8 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:14.728088 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 124/248] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 10 09:50:14 2022] GET /identity/v3/users/a66f47631ce44cb99877644834d1c2f2 => generated 283 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:14.729248 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af614e4e-2703-4018-9eea-04a72eee31f2 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:14.729528 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af614e4e-2703-4018-9eea-04a72eee31f2 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:14.729809 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af614e4e-2703-4018-9eea-04a72eee31f2 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:14.731015 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 125/249] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:50:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:50:14.735656 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af614e4e-2703-4018-9eea-04a72eee31f2 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:14.736793 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 125/250] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 10 09:50:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 09:50:14.738273 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644b6605-45b4-4a24-852a-d454035c4987 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:14.738730 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644b6605-45b4-4a24-852a-d454035c4987 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:14.739164 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644b6605-45b4-4a24-852a-d454035c4987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:14.758315 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-644b6605-45b4-4a24-852a-d454035c4987 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:50:14.759818 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-644b6605-45b4-4a24-852a-d454035c4987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:50:14.770455 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:14.843330 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:14.852102 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 126/251] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:50:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 09:50:14.853032 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644b6605-45b4-4a24-852a-d454035c4987 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:14.861743 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af614e4e-2703-4018-9eea-04a72eee31f2 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:14.911448 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f148ca-c732-4d2f-b3ee-da873f3d33db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:14.912059 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f148ca-c732-4d2f-b3ee-da873f3d33db None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:14.912342 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f148ca-c732-4d2f-b3ee-da873f3d33db None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:14.912609 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f148ca-c732-4d2f-b3ee-da873f3d33db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:14.966280 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644b6605-45b4-4a24-852a-d454035c4987 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:14.997480 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f148ca-c732-4d2f-b3ee-da873f3d33db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:14.999561 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f148ca-c732-4d2f-b3ee-da873f3d33db None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:15.004146 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b112752-367e-4c44-bf59-14edc5b07d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:15.004995 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b112752-367e-4c44-bf59-14edc5b07d92 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:15.005431 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b112752-367e-4c44-bf59-14edc5b07d92 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:15.005839 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b112752-367e-4c44-bf59-14edc5b07d92 None admin] PATH_INFO: `/v3/projects/7eb704c35a604e009f0597bf2e2a2684` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:15.007087 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b112752-367e-4c44-bf59-14edc5b07d92 None admin] RBAC: Authorizing `identity:get_project(project_id=7eb704c35a604e009f0597bf2e2a2684)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:15.008914 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b112752-367e-4c44-bf59-14edc5b07d92 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:15.011295 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 127/252] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 10 09:50:14 2022] GET /identity/v3/projects/7eb704c35a604e009f0597bf2e2a2684 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:15.012360 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b112752-367e-4c44-bf59-14edc5b07d92 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:15.033483 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:15.093761 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:15.120357 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 126/253] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 10 09:50:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 09:50:15.121828 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ba74b-847a-4e6c-ab78-b80677f47805 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:15.122121 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ba74b-847a-4e6c-ab78-b80677f47805 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:15.122397 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ba74b-847a-4e6c-ab78-b80677f47805 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:15.128507 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 127/254] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:50:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:50:15.129333 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148ba74b-847a-4e6c-ab78-b80677f47805 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:15.135697 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b112752-367e-4c44-bf59-14edc5b07d92 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:15.172401 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42564b7c-dbe2-4d6f-afa5-b7da24234d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:15.173603 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42564b7c-dbe2-4d6f-afa5-b7da24234d25 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:15.174077 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42564b7c-dbe2-4d6f-afa5-b7da24234d25 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:15.175282 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42564b7c-dbe2-4d6f-afa5-b7da24234d25 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:15.188292 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42564b7c-dbe2-4d6f-afa5-b7da24234d25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 09:50:15.195521 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-42564b7c-dbe2-4d6f-afa5-b7da24234d25 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 09:50:15.195521 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:50:15.195521 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:50:15.195521 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:50:15.195521 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:50:15.195521 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:50:15.195521 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:50:15.195521 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:50:15.195521 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:50:15.195521 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:50:15.195521 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:50:15.195521 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:50:15.195521 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 09:50:15.195521 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 09:50:15.195521 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 09:50:15.195521 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 09:50:15.196362 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 09:50:15.196362 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 09:50:15.196362 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 09:50:15.196362 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 09:50:15.196362 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:50:15.196362 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:50:15.196362 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:50:15.196362 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:50:15.196362 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:50:15.196362 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:50:15.196362 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:50:15.196362 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:50:15.196362 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:50:15.196362 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:50:15.196362 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:50:15.196362 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:50:15.197168 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:50:15.197168 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:50:15.197168 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:50:15.197168 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:50:15.197168 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 09:50:15.197168 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 09:50:15.197168 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 09:50:15.197168 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 09:50:15.197168 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 09:50:15.197168 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 09:50:15.197168 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 09:50:15.197168 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:50:15.199328 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 128/255] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 10 09:50:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:50:15.200045 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42564b7c-dbe2-4d6f-afa5-b7da24234d25 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:15.265548 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148ba74b-847a-4e6c-ab78-b80677f47805 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:15.300033 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:15.306292 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7736227b-cd0f-4b66-be63-bb427941adf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:15.307017 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7736227b-cd0f-4b66-be63-bb427941adf0 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:15.307394 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7736227b-cd0f-4b66-be63-bb427941adf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:15.307764 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7736227b-cd0f-4b66-be63-bb427941adf0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:15.308596 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7736227b-cd0f-4b66-be63-bb427941adf0 None admin] RBAC: Adding query filter params (role.id=362321830b5e4df5a2864d0852f5b7c4, scope.project.id=7eb704c35a604e009f0597bf2e2a2684, user.id=ca1994432a5d4429b929c5ed2c042906) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:15.309006 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7736227b-cd0f-4b66-be63-bb427941adf0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:15.310655 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7736227b-cd0f-4b66-be63-bb427941adf0 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:15.316747 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 128/256] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 10 09:50:15 2022] GET /identity/v3/role_assignments?user.id=ca1994432a5d4429b929c5ed2c042906&scope.project.id=7eb704c35a604e009f0597bf2e2a2684&role.id=362321830b5e4df5a2864d0852f5b7c4 => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:15.318099 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4ca6c6-33db-4ed1-a67c-cfd172d32bea None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:15.318542 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4ca6c6-33db-4ed1-a67c-cfd172d32bea None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:15.318913 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4ca6c6-33db-4ed1-a67c-cfd172d32bea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:15.321196 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42564b7c-dbe2-4d6f-afa5-b7da24234d25 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:15.348834 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-5f4ca6c6-33db-4ed1-a67c-cfd172d32bea None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:50:15.350228 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-5f4ca6c6-33db-4ed1-a67c-cfd172d32bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:50:15.376477 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:15.393647 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ba46a5-c402-45ba-a3e7-c830a7fe90b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:15.395698 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba46a5-c402-45ba-a3e7-c830a7fe90b1 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:15.395995 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba46a5-c402-45ba-a3e7-c830a7fe90b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:15.396270 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba46a5-c402-45ba-a3e7-c830a7fe90b1 None admin] PATH_INFO: `/v3/projects/7eb704c35a604e009f0597bf2e2a2684` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:15.398612 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ba46a5-c402-45ba-a3e7-c830a7fe90b1 None admin] RBAC: Authorizing `identity:get_project(project_id=7eb704c35a604e009f0597bf2e2a2684)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:15.400129 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ba46a5-c402-45ba-a3e7-c830a7fe90b1 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:15.408286 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 129/257] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 10 09:50:15 2022] GET /identity/v3/projects/7eb704c35a604e009f0597bf2e2a2684 => generated 302 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:15.408989 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ba46a5-c402-45ba-a3e7-c830a7fe90b1 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:15.508905 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 129/258] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:50:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 09:50:15.509804 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4ca6c6-33db-4ed1-a67c-cfd172d32bea None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:15.580257 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ba46a5-c402-45ba-a3e7-c830a7fe90b1 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:15.614454 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd89a4b-986e-471b-a691-d7ad9c6f7c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:15.615066 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd89a4b-986e-471b-a691-d7ad9c6f7c22 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:15.615345 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd89a4b-986e-471b-a691-d7ad9c6f7c22 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:15.615615 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd89a4b-986e-471b-a691-d7ad9c6f7c22 None admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:15.616342 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd89a4b-986e-471b-a691-d7ad9c6f7c22 None admin] RBAC: Adding query filter params (name=member) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:15.616648 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd89a4b-986e-471b-a691-d7ad9c6f7c22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:15.618143 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd89a4b-986e-471b-a691-d7ad9c6f7c22 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:15.626803 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 130/259] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Aug 10 09:50:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:15.627215 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4ca6c6-33db-4ed1-a67c-cfd172d32bea None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:15.627599 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd89a4b-986e-471b-a691-d7ad9c6f7c22 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:15.659219 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:15.683066 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae336e2-1ad7-4667-84ac-d068860d30ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:15.683807 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae336e2-1ad7-4667-84ac-d068860d30ce None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:15.684136 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae336e2-1ad7-4667-84ac-d068860d30ce None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:15.684417 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae336e2-1ad7-4667-84ac-d068860d30ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:15.685245 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae336e2-1ad7-4667-84ac-d068860d30ce None admin] RBAC: Adding query filter params (role.id=eb04edc46b3742d7a0f0ead26f68bc22, scope.project.id=7eb704c35a604e009f0597bf2e2a2684, user.id=a66f47631ce44cb99877644834d1c2f2) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:15.685489 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae336e2-1ad7-4667-84ac-d068860d30ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:15.685970 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:15.693090 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae336e2-1ad7-4667-84ac-d068860d30ce None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:15.702555 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 130/260] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 10 09:50:15 2022] GET /identity/v3/role_assignments?user.id=a66f47631ce44cb99877644834d1c2f2&scope.project.id=7eb704c35a604e009f0597bf2e2a2684&role.id=eb04edc46b3742d7a0f0ead26f68bc22 => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:15.703482 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae336e2-1ad7-4667-84ac-d068860d30ce None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:15.735792 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd89a4b-986e-471b-a691-d7ad9c6f7c22 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:15.774936 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2e5789-2473-4d8a-a2f2-13075c7fc2cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:15.775642 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2e5789-2473-4d8a-a2f2-13075c7fc2cc None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:15.775926 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2e5789-2473-4d8a-a2f2-13075c7fc2cc None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:15.776196 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2e5789-2473-4d8a-a2f2-13075c7fc2cc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:15.788961 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2e5789-2473-4d8a-a2f2-13075c7fc2cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 09:50:15.794461 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-5b2e5789-2473-4d8a-a2f2-13075c7fc2cc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 09:50:15.794461 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:50:15.794461 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:50:15.794461 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:50:15.794461 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:50:15.794461 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:50:15.794461 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:50:15.794461 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:50:15.794461 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:50:15.794461 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:50:15.794461 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:50:15.794461 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:50:15.794461 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 09:50:15.794461 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 09:50:15.794461 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 09:50:15.794461 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 09:50:15.795408 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 09:50:15.795408 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 09:50:15.795408 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 09:50:15.795408 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 09:50:15.795408 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:50:15.795408 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:50:15.795408 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:50:15.795408 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:50:15.795408 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:50:15.795408 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:50:15.795408 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:50:15.795408 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:50:15.795408 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:50:15.795408 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:50:15.795408 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:50:15.795408 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:50:15.796176 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:50:15.796176 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:50:15.796176 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:50:15.796176 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:50:15.796176 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 09:50:15.796176 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 09:50:15.796176 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 09:50:15.796176 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 09:50:15.796176 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 09:50:15.796176 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 09:50:15.796176 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 09:50:15.796176 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:50:15.796176 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 131/261] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Aug 10 09:50:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:50:15.804104 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2e5789-2473-4d8a-a2f2-13075c7fc2cc None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:15.917399 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2e5789-2473-4d8a-a2f2-13075c7fc2cc None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:15.935228 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:15.949110 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae336e2-1ad7-4667-84ac-d068860d30ce None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:15.957176 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8220fb-7440-437c-958f-aa6d66853daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:15.957972 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8220fb-7440-437c-958f-aa6d66853daf None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:15.958457 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8220fb-7440-437c-958f-aa6d66853daf None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:15.958824 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8220fb-7440-437c-958f-aa6d66853daf None admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:15.959586 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8220fb-7440-437c-958f-aa6d66853daf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:15.959957 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8220fb-7440-437c-958f-aa6d66853daf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:15.965104 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8220fb-7440-437c-958f-aa6d66853daf None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:15.971172 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 132/262] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 10 09:50:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 09:50:15.976963 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8220fb-7440-437c-958f-aa6d66853daf None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:16.015746 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ece393-7e92-4ee0-bf82-3c03ecdfc923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:16.016734 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ece393-7e92-4ee0-bf82-3c03ecdfc923 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:16.017215 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ece393-7e92-4ee0-bf82-3c03ecdfc923 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:16.017655 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ece393-7e92-4ee0-bf82-3c03ecdfc923 None admin] PATH_INFO: `/v3/users/6d35762fc43940b6b2177d5c177a3152` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:16.018974 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ece393-7e92-4ee0-bf82-3c03ecdfc923 None admin] RBAC: Authorizing `identity:get_user(user_id=6d35762fc43940b6b2177d5c177a3152)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:16.020697 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ece393-7e92-4ee0-bf82-3c03ecdfc923 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:16.022898 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 131/263] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 10 09:50:15 2022] GET /identity/v3/users/6d35762fc43940b6b2177d5c177a3152 => generated 297 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:16.028218 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ece393-7e92-4ee0-bf82-3c03ecdfc923 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:16.088996 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8220fb-7440-437c-958f-aa6d66853daf None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:16.121326 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:16.126620 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a54e31-2f49-448d-95d0-e48be9beb856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:16.127270 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a54e31-2f49-448d-95d0-e48be9beb856 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:16.127610 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a54e31-2f49-448d-95d0-e48be9beb856 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:16.127884 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a54e31-2f49-448d-95d0-e48be9beb856 None admin] PATH_INFO: `/v3/users/a66f47631ce44cb99877644834d1c2f2` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:16.129082 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a54e31-2f49-448d-95d0-e48be9beb856 None admin] RBAC: Authorizing `identity:get_user(user_id=a66f47631ce44cb99877644834d1c2f2)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:16.130578 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a54e31-2f49-448d-95d0-e48be9beb856 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:16.133043 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 133/264] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 10 09:50:15 2022] GET /identity/v3/users/a66f47631ce44cb99877644834d1c2f2 => generated 283 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 09:50:16.138830 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a54e31-2f49-448d-95d0-e48be9beb856 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:16.186877 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ece393-7e92-4ee0-bf82-3c03ecdfc923 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:16.189441 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:16.242938 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3668f6e4-1ce2-4834-a653-d1f4e2396e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:16.243580 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3668f6e4-1ce2-4834-a653-d1f4e2396e21 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:16.243862 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3668f6e4-1ce2-4834-a653-d1f4e2396e21 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:16.244137 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3668f6e4-1ce2-4834-a653-d1f4e2396e21 None admin] PATH_INFO: `/v3/projects/7eb704c35a604e009f0597bf2e2a2684` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:16.246185 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a54e31-2f49-448d-95d0-e48be9beb856 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:16.249779 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3668f6e4-1ce2-4834-a653-d1f4e2396e21 None admin] RBAC: Authorizing `identity:get_project(project_id=7eb704c35a604e009f0597bf2e2a2684)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:16.251270 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3668f6e4-1ce2-4834-a653-d1f4e2396e21 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:16.253274 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 132/265] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 10 09:50:16 2022] GET /identity/v3/projects/7eb704c35a604e009f0597bf2e2a2684 => generated 302 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:16.259062 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3668f6e4-1ce2-4834-a653-d1f4e2396e21 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:16.283636 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f568798c-20e4-4cb5-811f-3e54198e0d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:16.284357 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f568798c-20e4-4cb5-811f-3e54198e0d2d None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:16.284732 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f568798c-20e4-4cb5-811f-3e54198e0d2d None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:16.285056 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f568798c-20e4-4cb5-811f-3e54198e0d2d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:16.359959 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f568798c-20e4-4cb5-811f-3e54198e0d2d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:16.362156 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f568798c-20e4-4cb5-811f-3e54198e0d2d None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:16.407794 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3668f6e4-1ce2-4834-a653-d1f4e2396e21 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:16.429521 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:16.468655 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 134/266] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 10 09:50:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 10 09:50:16.474776 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f568798c-20e4-4cb5-811f-3e54198e0d2d None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:16.490691 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:16.513795 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f418b8ea-e2fa-4020-a46d-be3075b6c98e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:16.514485 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f418b8ea-e2fa-4020-a46d-be3075b6c98e None admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:16.514774 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f418b8ea-e2fa-4020-a46d-be3075b6c98e None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:16.515052 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f418b8ea-e2fa-4020-a46d-be3075b6c98e None admin] PATH_INFO: `/v3/projects/7eb704c35a604e009f0597bf2e2a2684/users/6d35762fc43940b6b2177d5c177a3152/roles/8daabcb6b7394e39b06a3453e33e32db` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:16.518193 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f418b8ea-e2fa-4020-a46d-be3075b6c98e None admin] RBAC: Authorizing `identity:create_grant(project_id=7eb704c35a604e009f0597bf2e2a2684, user_id=6d35762fc43940b6b2177d5c177a3152, role_id=8daabcb6b7394e39b06a3453e33e32db)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:16.519663 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f418b8ea-e2fa-4020-a46d-be3075b6c98e None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:16.547202 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 133/267] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Aug 10 09:50:16 2022] PUT /identity/v3/projects/7eb704c35a604e009f0597bf2e2a2684/users/6d35762fc43940b6b2177d5c177a3152/roles/8daabcb6b7394e39b06a3453e33e32db => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 09:50:16.585372 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f568798c-20e4-4cb5-811f-3e54198e0d2d None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:16.624068 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b5ada5-1b6c-48c9-b6ba-06fa9657a7bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:16.624765 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b5ada5-1b6c-48c9-b6ba-06fa9657a7bc None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:16.625050 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b5ada5-1b6c-48c9-b6ba-06fa9657a7bc None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:16.625345 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b5ada5-1b6c-48c9-b6ba-06fa9657a7bc None admin] PATH_INFO: `/v3/projects/7eb704c35a604e009f0597bf2e2a2684` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:16.626510 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b5ada5-1b6c-48c9-b6ba-06fa9657a7bc None admin] RBAC: Authorizing `identity:get_project(project_id=7eb704c35a604e009f0597bf2e2a2684)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:16.628051 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b5ada5-1b6c-48c9-b6ba-06fa9657a7bc None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:16.629738 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 135/268] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 10 09:50:16 2022] GET /identity/v3/projects/7eb704c35a604e009f0597bf2e2a2684 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:16.636075 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f418b8ea-e2fa-4020-a46d-be3075b6c98e None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:16.787614 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f418b8ea-e2fa-4020-a46d-be3075b6c98e None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:16.826557 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dfface-16d6-4640-980a-342fd58cfa69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:16.827185 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dfface-16d6-4640-980a-342fd58cfa69 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:16.827565 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dfface-16d6-4640-980a-342fd58cfa69 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:16.827845 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dfface-16d6-4640-980a-342fd58cfa69 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:16.828635 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dfface-16d6-4640-980a-342fd58cfa69 None admin] RBAC: Adding query filter params (role.id=5d80017a50774daba0c1fee326754295, scope.project.id=7eb704c35a604e009f0597bf2e2a2684, user.id=a66f47631ce44cb99877644834d1c2f2) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:16.828953 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dfface-16d6-4640-980a-342fd58cfa69 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:16.830460 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dfface-16d6-4640-980a-342fd58cfa69 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:16.836924 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 134/269] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 10 09:50:16 2022] GET /identity/v3/role_assignments?user.id=a66f47631ce44cb99877644834d1c2f2&scope.project.id=7eb704c35a604e009f0597bf2e2a2684&role.id=5d80017a50774daba0c1fee326754295 => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:17.046010 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95deffab-e2eb-4dcc-8c95-87cdae3d8f9d None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:17.046199 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95deffab-e2eb-4dcc-8c95-87cdae3d8f9d None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:17.046464 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95deffab-e2eb-4dcc-8c95-87cdae3d8f9d None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:17.051445 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 136/270] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:50:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:50:17.056284 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f27ee1d-bc65-47c3-97b1-a6d71e94caf3 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:17.056707 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f27ee1d-bc65-47c3-97b1-a6d71e94caf3 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:17.057145 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f27ee1d-bc65-47c3-97b1-a6d71e94caf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:17.081116 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-7f27ee1d-bc65-47c3-97b1-a6d71e94caf3 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:50:17.082294 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-7f27ee1d-bc65-47c3-97b1-a6d71e94caf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:50:17.140115 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:17.168357 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 135/271] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:50:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 09:50:17.195624 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95deffab-e2eb-4dcc-8c95-87cdae3d8f9d None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:17.218130 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:17.238191 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52703dce-9366-4004-bfd8-1a36ae80e337 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:17.238524 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52703dce-9366-4004-bfd8-1a36ae80e337 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:17.238744 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52703dce-9366-4004-bfd8-1a36ae80e337 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:17.240130 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 136/272] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:50:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:50:17.245748 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50858dd-66bd-48b6-8955-f8ff177eec02 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:17.246246 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50858dd-66bd-48b6-8955-f8ff177eec02 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:17.246685 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50858dd-66bd-48b6-8955-f8ff177eec02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:17.269789 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-b50858dd-66bd-48b6-8955-f8ff177eec02 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:50:17.271331 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-b50858dd-66bd-48b6-8955-f8ff177eec02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:50:17.327912 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95deffab-e2eb-4dcc-8c95-87cdae3d8f9d None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:17.360532 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 137/273] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:50:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 09:50:17.375231 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9546b11-a281-4d9e-9263-50b90b5b53c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:17.376198 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9546b11-a281-4d9e-9263-50b90b5b53c4 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:17.376673 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9546b11-a281-4d9e-9263-50b90b5b53c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:17.377215 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9546b11-a281-4d9e-9263-50b90b5b53c4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:17.378822 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50858dd-66bd-48b6-8955-f8ff177eec02 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:17.379183 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9546b11-a281-4d9e-9263-50b90b5b53c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:17.381302 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9546b11-a281-4d9e-9263-50b90b5b53c4 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:17.384268 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 137/274] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 10 09:50:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:17.393105 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9546b11-a281-4d9e-9263-50b90b5b53c4 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:17.489954 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50858dd-66bd-48b6-8955-f8ff177eec02 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:17.491268 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:17.503993 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:17.517253 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9546b11-a281-4d9e-9263-50b90b5b53c4 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:17.530656 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a89c76-8514-469d-9edb-28ac7713d6fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:17.531597 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a89c76-8514-469d-9edb-28ac7713d6fb None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:17.532039 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a89c76-8514-469d-9edb-28ac7713d6fb None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:17.532442 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a89c76-8514-469d-9edb-28ac7713d6fb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:17.543486 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a89c76-8514-469d-9edb-28ac7713d6fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 09:50:17.548759 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-77a89c76-8514-469d-9edb-28ac7713d6fb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 09:50:17.548759 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:50:17.548759 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:50:17.548759 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:50:17.548759 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:50:17.548759 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:50:17.548759 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:50:17.548759 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:50:17.548759 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:50:17.548759 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:50:17.548759 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:50:17.548759 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:50:17.548759 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 09:50:17.548759 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 09:50:17.548759 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 09:50:17.548759 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 09:50:17.549723 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 09:50:17.549723 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 09:50:17.549723 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 09:50:17.549723 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 09:50:17.549723 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:50:17.549723 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:50:17.549723 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:50:17.549723 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:50:17.549723 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:50:17.549723 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:50:17.549723 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:50:17.549723 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:50:17.549723 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:50:17.549723 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:50:17.549723 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:50:17.549723 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:50:17.550493 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:50:17.550493 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:50:17.550493 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:50:17.550493 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:50:17.550493 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 09:50:17.550493 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 09:50:17.550493 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 09:50:17.550493 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 09:50:17.550493 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 09:50:17.550493 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 09:50:17.550493 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 09:50:17.550493 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:50:17.553294 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 138/275] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 10 09:50:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 09:50:17.558883 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a89c76-8514-469d-9edb-28ac7713d6fb None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:17.564066 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20f784a-7e58-4b6a-b8e1-850838a29a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:17.564891 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20f784a-7e58-4b6a-b8e1-850838a29a5b None admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:17.565375 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20f784a-7e58-4b6a-b8e1-850838a29a5b None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:17.565806 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20f784a-7e58-4b6a-b8e1-850838a29a5b None admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:17.566627 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20f784a-7e58-4b6a-b8e1-850838a29a5b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:17.568249 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20f784a-7e58-4b6a-b8e1-850838a29a5b None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:17.597915 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 138/276] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Aug 10 09:50:17 2022] POST /identity/v3/users => generated 293 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 09:50:17.679260 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a89c76-8514-469d-9edb-28ac7713d6fb None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:17.718517 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5790b2-9bd9-4acf-8d06-ae3221632305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:17.719143 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5790b2-9bd9-4acf-8d06-ae3221632305 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:17.719418 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5790b2-9bd9-4acf-8d06-ae3221632305 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:17.719684 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5790b2-9bd9-4acf-8d06-ae3221632305 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:17.720417 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5790b2-9bd9-4acf-8d06-ae3221632305 None admin] RBAC: Adding query filter params (name=member) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:17.720722 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5790b2-9bd9-4acf-8d06-ae3221632305 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:17.722184 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5790b2-9bd9-4acf-8d06-ae3221632305 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:17.732100 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 139/277] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Aug 10 09:50:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 09:50:17.737716 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20f784a-7e58-4b6a-b8e1-850838a29a5b None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:17.742738 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b5524-3564-4ef0-8e14-e7a601a37ed1 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:17.743020 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b5524-3564-4ef0-8e14-e7a601a37ed1 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:17.743295 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b5524-3564-4ef0-8e14-e7a601a37ed1 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:17.744940 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 140/278] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:50:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:50:17.750392 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd20d145-ce68-40ba-890a-b952d42b0b6d None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:17.750687 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd20d145-ce68-40ba-890a-b952d42b0b6d None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:17.750944 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd20d145-ce68-40ba-890a-b952d42b0b6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:17.769621 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-dd20d145-ce68-40ba-890a-b952d42b0b6d None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:50:17.770845 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-dd20d145-ce68-40ba-890a-b952d42b0b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:50:17.800083 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:17.845631 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 141/279] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:50:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 09:50:17.861090 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20f784a-7e58-4b6a-b8e1-850838a29a5b None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:17.868098 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd20d145-ce68-40ba-890a-b952d42b0b6d None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:17.903483 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136b2bb2-82f9-46ad-9db2-1659ca6d6166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:17.904418 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136b2bb2-82f9-46ad-9db2-1659ca6d6166 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:17.904940 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136b2bb2-82f9-46ad-9db2-1659ca6d6166 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:17.905244 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136b2bb2-82f9-46ad-9db2-1659ca6d6166 None admin] PATH_INFO: `/v3/users/83241da0d7334a3ebc4a57d74e569692` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:17.915300 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:17.923780 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136b2bb2-82f9-46ad-9db2-1659ca6d6166 None admin] RBAC: Authorizing `identity:get_user(user_id=83241da0d7334a3ebc4a57d74e569692)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:17.927249 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136b2bb2-82f9-46ad-9db2-1659ca6d6166 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:17.930151 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 139/280] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 10 09:50:17 2022] GET /identity/v3/users/83241da0d7334a3ebc4a57d74e569692 => generated 293 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 09:50:17.936251 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136b2bb2-82f9-46ad-9db2-1659ca6d6166 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:18.005949 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd20d145-ce68-40ba-890a-b952d42b0b6d None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:18.053039 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b40acf-ede2-42b8-945f-256f82da2e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:18.053952 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b40acf-ede2-42b8-945f-256f82da2e14 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:18.054677 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b40acf-ede2-42b8-945f-256f82da2e14 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:18.054972 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b40acf-ede2-42b8-945f-256f82da2e14 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:18.057320 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136b2bb2-82f9-46ad-9db2-1659ca6d6166 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:18.068358 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b40acf-ede2-42b8-945f-256f82da2e14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 09:50:18.075296 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-b1b40acf-ede2-42b8-945f-256f82da2e14 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 09:50:18.075296 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:50:18.075296 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:50:18.075296 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:50:18.075296 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:50:18.075296 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:50:18.075296 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:50:18.075296 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:50:18.075296 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:50:18.075296 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:50:18.075296 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:50:18.075296 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:50:18.075296 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 09:50:18.075296 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 09:50:18.075296 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 09:50:18.075296 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 09:50:18.076177 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 09:50:18.076177 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 09:50:18.076177 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 09:50:18.076177 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 09:50:18.076177 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:50:18.076177 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:50:18.076177 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:50:18.076177 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:50:18.076177 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:50:18.076177 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:50:18.076177 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:50:18.076177 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:50:18.076177 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:50:18.076177 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:50:18.076177 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:50:18.076177 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:50:18.076957 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:50:18.076957 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:50:18.076957 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:50:18.076957 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:50:18.076957 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 09:50:18.076957 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 09:50:18.076957 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 09:50:18.076957 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 09:50:18.076957 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 09:50:18.076957 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 09:50:18.076957 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 09:50:18.076957 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:50:18.077584 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 142/281] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 10 09:50:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 09:50:18.083797 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b40acf-ede2-42b8-945f-256f82da2e14 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:18.101400 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77249a57-3764-4335-9e63-1cae1f217761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:18.102070 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77249a57-3764-4335-9e63-1cae1f217761 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:18.102403 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77249a57-3764-4335-9e63-1cae1f217761 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:18.102717 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77249a57-3764-4335-9e63-1cae1f217761 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:18.103552 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77249a57-3764-4335-9e63-1cae1f217761 None admin] RBAC: Adding query filter params (role.id=8daabcb6b7394e39b06a3453e33e32db, user.id=83241da0d7334a3ebc4a57d74e569692, scope.system=all) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:18.103866 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77249a57-3764-4335-9e63-1cae1f217761 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:18.105574 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77249a57-3764-4335-9e63-1cae1f217761 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:18.112372 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 140/282] 10.222.0.27 () {56 vars in 1308 bytes} [Wed Aug 10 09:50:17 2022] GET /identity/v3/role_assignments?user.id=83241da0d7334a3ebc4a57d74e569692&scope.system=all&role.id=8daabcb6b7394e39b06a3453e33e32db => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 09:50:18.117523 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:18.203447 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b40acf-ede2-42b8-945f-256f82da2e14 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:18.246963 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39e2cf8-679e-41c0-87f5-466ab0911deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:18.247994 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39e2cf8-679e-41c0-87f5-466ab0911deb None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:18.248575 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39e2cf8-679e-41c0-87f5-466ab0911deb None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:18.249051 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39e2cf8-679e-41c0-87f5-466ab0911deb None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:18.249975 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39e2cf8-679e-41c0-87f5-466ab0911deb None admin] RBAC: Adding query filter params (name=reader) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:18.250490 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39e2cf8-679e-41c0-87f5-466ab0911deb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:18.252113 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39e2cf8-679e-41c0-87f5-466ab0911deb None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:18.265606 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 143/283] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Aug 10 09:50:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 09:50:18.271708 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77249a57-3764-4335-9e63-1cae1f217761 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:18.341606 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:18.385571 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77249a57-3764-4335-9e63-1cae1f217761 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:18.430879 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5171a8-c7ec-458d-999b-e0a0a3e3fbe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:18.431520 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5171a8-c7ec-458d-999b-e0a0a3e3fbe5 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:18.431802 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5171a8-c7ec-458d-999b-e0a0a3e3fbe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:18.432076 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5171a8-c7ec-458d-999b-e0a0a3e3fbe5 None admin] PATH_INFO: `/v3/users/ca1994432a5d4429b929c5ed2c042906` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:18.433255 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5171a8-c7ec-458d-999b-e0a0a3e3fbe5 None admin] RBAC: Authorizing `identity:get_user(user_id=ca1994432a5d4429b929c5ed2c042906)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:18.434740 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5171a8-c7ec-458d-999b-e0a0a3e3fbe5 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:18.436553 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 141/284] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 10 09:50:18 2022] GET /identity/v3/users/ca1994432a5d4429b929c5ed2c042906 => generated 297 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:18.442253 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39e2cf8-679e-41c0-87f5-466ab0911deb None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:18.608223 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:18.625427 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39e2cf8-679e-41c0-87f5-466ab0911deb None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:18.659352 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c08b954-9fdd-4013-9f69-4c771e046c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:18.660315 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c08b954-9fdd-4013-9f69-4c771e046c21 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:18.660826 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c08b954-9fdd-4013-9f69-4c771e046c21 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:18.661389 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c08b954-9fdd-4013-9f69-4c771e046c21 None admin] PATH_INFO: `/v3/projects/7eb704c35a604e009f0597bf2e2a2684` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:18.662727 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c08b954-9fdd-4013-9f69-4c771e046c21 None admin] RBAC: Authorizing `identity:get_project(project_id=7eb704c35a604e009f0597bf2e2a2684)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:18.664418 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c08b954-9fdd-4013-9f69-4c771e046c21 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:18.666306 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 144/285] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 10 09:50:18 2022] GET /identity/v3/projects/7eb704c35a604e009f0597bf2e2a2684 => generated 302 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:18.672325 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5171a8-c7ec-458d-999b-e0a0a3e3fbe5 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:18.810179 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5171a8-c7ec-458d-999b-e0a0a3e3fbe5 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:18.843693 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:18.855094 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6d9efb-829b-4374-a9a7-b8d481977146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:18.855813 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d9efb-829b-4374-a9a7-b8d481977146 None admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:18.856099 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d9efb-829b-4374-a9a7-b8d481977146 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:18.856366 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d9efb-829b-4374-a9a7-b8d481977146 None admin] PATH_INFO: `/v3/projects/7eb704c35a604e009f0597bf2e2a2684/users/ca1994432a5d4429b929c5ed2c042906/roles/362321830b5e4df5a2864d0852f5b7c4` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:18.858313 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6d9efb-829b-4374-a9a7-b8d481977146 None admin] RBAC: Authorizing `identity:create_grant(project_id=7eb704c35a604e009f0597bf2e2a2684, user_id=ca1994432a5d4429b929c5ed2c042906, role_id=362321830b5e4df5a2864d0852f5b7c4)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:18.859779 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6d9efb-829b-4374-a9a7-b8d481977146 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:18.882668 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 142/286] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Aug 10 09:50:18 2022] PUT /identity/v3/projects/7eb704c35a604e009f0597bf2e2a2684/users/ca1994432a5d4429b929c5ed2c042906/roles/362321830b5e4df5a2864d0852f5b7c4 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 09:50:18.975094 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c1034d-77a4-466e-a5e7-29c93b6295b1 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:18.975441 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c1034d-77a4-466e-a5e7-29c93b6295b1 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:18.975645 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c1034d-77a4-466e-a5e7-29c93b6295b1 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:18.977397 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 145/287] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:50:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:50:18.982865 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3b524c-5441-46f4-925b-74c5afccf997 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:18.983184 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3b524c-5441-46f4-925b-74c5afccf997 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:18.983417 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3b524c-5441-46f4-925b-74c5afccf997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:19.010272 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-df3b524c-5441-46f4-925b-74c5afccf997 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:50:19.011527 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-df3b524c-5441-46f4-925b-74c5afccf997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:50:19.093605 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 143/288] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:50:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 09:50:19.116603 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c1034d-77a4-466e-a5e7-29c93b6295b1 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:19.233880 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c1034d-77a4-466e-a5e7-29c93b6295b1 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:19.288048 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cce13f7-bb8d-4d27-941c-9f17daf8dc82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:19.289167 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cce13f7-bb8d-4d27-941c-9f17daf8dc82 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:19.289663 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cce13f7-bb8d-4d27-941c-9f17daf8dc82 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:19.290284 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cce13f7-bb8d-4d27-941c-9f17daf8dc82 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:19.307279 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cce13f7-bb8d-4d27-941c-9f17daf8dc82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 09:50:19.312843 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-9cce13f7-bb8d-4d27-941c-9f17daf8dc82 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 09:50:19.312843 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:50:19.312843 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:50:19.312843 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:50:19.312843 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:50:19.312843 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:50:19.312843 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:50:19.312843 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:50:19.312843 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:50:19.312843 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:50:19.312843 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:50:19.312843 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:50:19.312843 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 09:50:19.312843 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 09:50:19.312843 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 09:50:19.312843 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 09:50:19.313723 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 09:50:19.313723 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 09:50:19.313723 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 09:50:19.313723 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 09:50:19.313723 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:50:19.313723 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:50:19.313723 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:50:19.313723 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:50:19.313723 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:50:19.313723 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:50:19.313723 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:50:19.313723 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:50:19.313723 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:50:19.313723 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:50:19.313723 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:50:19.313723 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:50:19.314525 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:50:19.314525 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:50:19.314525 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:50:19.314525 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:50:19.314525 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 09:50:19.314525 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 09:50:19.314525 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 09:50:19.314525 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 09:50:19.314525 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 09:50:19.314525 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 09:50:19.314525 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 09:50:19.314525 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:50:19.317103 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 146/289] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 10 09:50:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:50:19.323905 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3b524c-5441-46f4-925b-74c5afccf997 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:19.422583 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3b524c-5441-46f4-925b-74c5afccf997 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:19.445092 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:19.467074 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13066cdb-3b5b-48ee-a198-048b826e63a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:19.468004 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13066cdb-3b5b-48ee-a198-048b826e63a9 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:19.468500 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13066cdb-3b5b-48ee-a198-048b826e63a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:19.469008 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13066cdb-3b5b-48ee-a198-048b826e63a9 None admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:19.469892 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13066cdb-3b5b-48ee-a198-048b826e63a9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:19.470384 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13066cdb-3b5b-48ee-a198-048b826e63a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:19.471949 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13066cdb-3b5b-48ee-a198-048b826e63a9 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:19.483473 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 144/290] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Aug 10 09:50:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:19.489454 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cce13f7-bb8d-4d27-941c-9f17daf8dc82 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:19.505174 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:19.628723 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cce13f7-bb8d-4d27-941c-9f17daf8dc82 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:19.678184 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e636e26e-7bea-4585-8c5d-6b2348726c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:19.679371 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e636e26e-7bea-4585-8c5d-6b2348726c3c None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:19.679371 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e636e26e-7bea-4585-8c5d-6b2348726c3c None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:19.679504 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e636e26e-7bea-4585-8c5d-6b2348726c3c None admin] PATH_INFO: `/v3/users/6d35762fc43940b6b2177d5c177a3152` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:19.685764 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e636e26e-7bea-4585-8c5d-6b2348726c3c None admin] RBAC: Authorizing `identity:get_user(user_id=6d35762fc43940b6b2177d5c177a3152)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:19.687232 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e636e26e-7bea-4585-8c5d-6b2348726c3c None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:19.689184 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 147/291] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 10 09:50:19 2022] GET /identity/v3/users/6d35762fc43940b6b2177d5c177a3152 => generated 297 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:19.695266 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13066cdb-3b5b-48ee-a198-048b826e63a9 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:19.823503 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13066cdb-3b5b-48ee-a198-048b826e63a9 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:19.870580 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0932a4-cfc7-4886-8ec2-cbf149b49afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:19.871571 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0932a4-cfc7-4886-8ec2-cbf149b49afc None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:19.872127 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0932a4-cfc7-4886-8ec2-cbf149b49afc None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:19.872643 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0932a4-cfc7-4886-8ec2-cbf149b49afc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:19.936056 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:19.956795 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0932a4-cfc7-4886-8ec2-cbf149b49afc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:19.958312 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0932a4-cfc7-4886-8ec2-cbf149b49afc None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:20.081539 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 145/292] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 10 09:50:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 09:50:20.087363 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e636e26e-7bea-4585-8c5d-6b2348726c3c None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:20.171760 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:20.194634 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e636e26e-7bea-4585-8c5d-6b2348726c3c None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:20.236121 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5137e5-d970-48d8-bc8f-c6665e9f5b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:20.236753 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5137e5-d970-48d8-bc8f-c6665e9f5b32 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:20.237034 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5137e5-d970-48d8-bc8f-c6665e9f5b32 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:20.237331 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5137e5-d970-48d8-bc8f-c6665e9f5b32 None admin] PATH_INFO: `/v3/projects/7eb704c35a604e009f0597bf2e2a2684` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:20.238514 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5137e5-d970-48d8-bc8f-c6665e9f5b32 None admin] RBAC: Authorizing `identity:get_project(project_id=7eb704c35a604e009f0597bf2e2a2684)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:20.240010 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5137e5-d970-48d8-bc8f-c6665e9f5b32 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:20.242134 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 148/293] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 10 09:50:20 2022] GET /identity/v3/projects/7eb704c35a604e009f0597bf2e2a2684 => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:20.250187 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0932a4-cfc7-4886-8ec2-cbf149b49afc None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:20.365529 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:20.392512 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0932a4-cfc7-4886-8ec2-cbf149b49afc None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:20.438202 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a153951-d6ae-4500-82fa-8b18ea7490b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:20.438813 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a153951-d6ae-4500-82fa-8b18ea7490b0 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:20.439093 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a153951-d6ae-4500-82fa-8b18ea7490b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:20.439368 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a153951-d6ae-4500-82fa-8b18ea7490b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:20.440103 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a153951-d6ae-4500-82fa-8b18ea7490b0 None admin] RBAC: Adding query filter params (role.id=8daabcb6b7394e39b06a3453e33e32db, scope.project.id=7eb704c35a604e009f0597bf2e2a2684, user.id=6d35762fc43940b6b2177d5c177a3152) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:20.440414 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a153951-d6ae-4500-82fa-8b18ea7490b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:20.441889 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a153951-d6ae-4500-82fa-8b18ea7490b0 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:20.453888 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 146/294] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 10 09:50:20 2022] GET /identity/v3/role_assignments?user.id=6d35762fc43940b6b2177d5c177a3152&scope.project.id=7eb704c35a604e009f0597bf2e2a2684&role.id=8daabcb6b7394e39b06a3453e33e32db => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:20.626303 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22552bf0-d2df-4836-8ae3-4c47727d6554 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:20.626594 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22552bf0-d2df-4836-8ae3-4c47727d6554 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:20.626834 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22552bf0-d2df-4836-8ae3-4c47727d6554 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:20.628435 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 149/295] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:50:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:50:20.634120 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0679c78f-65dd-4042-8432-3d870bed5e3d None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:20.634410 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0679c78f-65dd-4042-8432-3d870bed5e3d None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:20.634686 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0679c78f-65dd-4042-8432-3d870bed5e3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:20.654150 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd690da9-7874-4b8e-88a8-8a99680cfcd8 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:20.654660 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd690da9-7874-4b8e-88a8-8a99680cfcd8 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:20.654757 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-0679c78f-65dd-4042-8432-3d870bed5e3d None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:50:20.654831 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd690da9-7874-4b8e-88a8-8a99680cfcd8 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:20.655793 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-0679c78f-65dd-4042-8432-3d870bed5e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:50:20.656293 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 150/296] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:50:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:50:20.661346 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e19b53-4e69-4801-81fb-433dcb16a475 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:20.661629 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e19b53-4e69-4801-81fb-433dcb16a475 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:20.661908 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e19b53-4e69-4801-81fb-433dcb16a475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:20.690512 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-26e19b53-4e69-4801-81fb-433dcb16a475 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:50:20.692019 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-26e19b53-4e69-4801-81fb-433dcb16a475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:50:20.736600 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 147/297] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:50:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 09:50:20.738610 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21919cac-df16-41cd-9f0e-5bf415e7ebb1 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:20.739390 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21919cac-df16-41cd-9f0e-5bf415e7ebb1 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:20.740031 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21919cac-df16-41cd-9f0e-5bf415e7ebb1 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:20.742175 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 148/298] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:50:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:50:20.747511 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56247e2-c076-46e0-9e44-44cd28d42cfe None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:20.748054 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56247e2-c076-46e0-9e44-44cd28d42cfe None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:20.748682 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56247e2-c076-46e0-9e44-44cd28d42cfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:20.769312 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-c56247e2-c076-46e0-9e44-44cd28d42cfe None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:50:20.777089 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-c56247e2-c076-46e0-9e44-44cd28d42cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:50:20.777246 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 151/299] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:50:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 09:50:20.777246 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e19b53-4e69-4801-81fb-433dcb16a475 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:20.851106 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 149/300] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:50:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 09:50:20.852248 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56247e2-c076-46e0-9e44-44cd28d42cfe None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:20.856089 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:20.887616 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:20.911231 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e19b53-4e69-4801-81fb-433dcb16a475 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:20.947081 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff140267-7ad0-4e99-b82e-4f4873bf406f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:20.947724 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff140267-7ad0-4e99-b82e-4f4873bf406f None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:20.948009 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff140267-7ad0-4e99-b82e-4f4873bf406f None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:20.948279 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff140267-7ad0-4e99-b82e-4f4873bf406f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:20.949419 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff140267-7ad0-4e99-b82e-4f4873bf406f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:20.950879 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff140267-7ad0-4e99-b82e-4f4873bf406f None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:20.952466 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 152/301] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 10 09:50:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:20.953245 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff140267-7ad0-4e99-b82e-4f4873bf406f None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:20.965973 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56247e2-c076-46e0-9e44-44cd28d42cfe None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:20.999934 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cff152-3bed-448f-991b-70b6aaabc9c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:21.000719 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cff152-3bed-448f-991b-70b6aaabc9c8 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:21.001000 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cff152-3bed-448f-991b-70b6aaabc9c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:21.001297 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cff152-3bed-448f-991b-70b6aaabc9c8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:21.012474 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cff152-3bed-448f-991b-70b6aaabc9c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 09:50:21.017677 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-f1cff152-3bed-448f-991b-70b6aaabc9c8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 09:50:21.017677 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:50:21.017677 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:50:21.017677 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:50:21.017677 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:50:21.017677 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:50:21.017677 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:50:21.017677 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:50:21.017677 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:50:21.017677 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:50:21.017677 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:50:21.017677 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:50:21.017677 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 09:50:21.017677 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 09:50:21.017677 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 09:50:21.017677 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 09:50:21.018554 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 09:50:21.018554 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 09:50:21.018554 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 09:50:21.018554 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 09:50:21.018554 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:50:21.018554 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:50:21.018554 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:50:21.018554 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:50:21.018554 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:50:21.018554 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:50:21.018554 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:50:21.018554 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:50:21.018554 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:50:21.018554 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:50:21.018554 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:50:21.018554 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:50:21.019325 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:50:21.019325 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:50:21.019325 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:50:21.019325 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:50:21.019325 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 09:50:21.019325 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 09:50:21.019325 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 09:50:21.019325 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 09:50:21.019325 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 09:50:21.019325 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 09:50:21.019325 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 09:50:21.019325 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:50:21.019325 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 150/302] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 10 09:50:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:50:21.019950 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cff152-3bed-448f-991b-70b6aaabc9c8 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:21.062453 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff140267-7ad0-4e99-b82e-4f4873bf406f None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:21.088577 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:21.096906 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0f8b02-9233-4d79-a064-01c0e7b78610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:21.097841 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0f8b02-9233-4d79-a064-01c0e7b78610 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:21.098174 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0f8b02-9233-4d79-a064-01c0e7b78610 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:21.098511 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0f8b02-9233-4d79-a064-01c0e7b78610 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:21.108724 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0f8b02-9233-4d79-a064-01c0e7b78610 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 09:50:21.113331 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-9a0f8b02-9233-4d79-a064-01c0e7b78610 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 09:50:21.113331 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:50:21.113331 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:50:21.113331 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:50:21.113331 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:50:21.113331 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:50:21.113331 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:50:21.113331 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:50:21.113331 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:50:21.113331 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:50:21.113331 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:50:21.113331 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:50:21.113331 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 09:50:21.113331 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 09:50:21.113331 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 09:50:21.113331 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 09:50:21.114190 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 09:50:21.114190 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 09:50:21.114190 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 09:50:21.114190 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 09:50:21.114190 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:50:21.114190 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:50:21.114190 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:50:21.114190 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:50:21.114190 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:50:21.114190 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:50:21.114190 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:50:21.114190 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:50:21.114190 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:50:21.114190 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:50:21.114190 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:50:21.114190 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:50:21.120464 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:50:21.120464 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:50:21.120464 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:50:21.120464 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:50:21.120464 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 09:50:21.120464 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 09:50:21.120464 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 09:50:21.120464 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 09:50:21.120464 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 09:50:21.120464 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 09:50:21.120464 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 09:50:21.120464 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:50:21.120464 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 153/303] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 10 09:50:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:50:21.120464 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0f8b02-9233-4d79-a064-01c0e7b78610 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:21.128673 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:21.133746 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cff152-3bed-448f-991b-70b6aaabc9c8 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:21.172786 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84d44f5-2390-4dfb-9f8a-b4b03ccfb600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:21.173350 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84d44f5-2390-4dfb-9f8a-b4b03ccfb600 None admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:21.173628 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84d44f5-2390-4dfb-9f8a-b4b03ccfb600 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:21.174402 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84d44f5-2390-4dfb-9f8a-b4b03ccfb600 None admin] PATH_INFO: `/v3/groups` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:21.175041 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84d44f5-2390-4dfb-9f8a-b4b03ccfb600 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:21.176625 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84d44f5-2390-4dfb-9f8a-b4b03ccfb600 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:21.205094 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 151/304] 10.222.0.27 () {60 vars in 1134 bytes} [Wed Aug 10 09:50:21 2022] POST /identity/v3/groups => generated 229 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 09:50:21.205094 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84d44f5-2390-4dfb-9f8a-b4b03ccfb600 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:21.224569 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0f8b02-9233-4d79-a064-01c0e7b78610 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:21.268851 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0531306b-8550-44f4-b9d0-bdd71c3ed68c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:21.269513 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0531306b-8550-44f4-b9d0-bdd71c3ed68c None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:21.269793 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0531306b-8550-44f4-b9d0-bdd71c3ed68c None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:21.270064 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0531306b-8550-44f4-b9d0-bdd71c3ed68c None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:21.270748 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0531306b-8550-44f4-b9d0-bdd71c3ed68c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:21.271055 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0531306b-8550-44f4-b9d0-bdd71c3ed68c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:21.272483 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0531306b-8550-44f4-b9d0-bdd71c3ed68c None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:21.282137 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 154/305] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Aug 10 09:50:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:21.288240 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dfba6f-b9a3-4c2d-98de-68af9698fe29 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:21.288526 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dfba6f-b9a3-4c2d-98de-68af9698fe29 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:21.288912 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dfba6f-b9a3-4c2d-98de-68af9698fe29 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:21.290874 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 155/306] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:50:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:50:21.291728 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dfba6f-b9a3-4c2d-98de-68af9698fe29 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:21.330633 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84d44f5-2390-4dfb-9f8a-b4b03ccfb600 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:21.357327 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:21.371270 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:21.371449 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6457b4-8ffd-495f-a3ab-e8f30a747a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:21.372605 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6457b4-8ffd-495f-a3ab-e8f30a747a3e None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:21.372605 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6457b4-8ffd-495f-a3ab-e8f30a747a3e None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:21.372891 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6457b4-8ffd-495f-a3ab-e8f30a747a3e None admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:21.373569 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6457b4-8ffd-495f-a3ab-e8f30a747a3e None admin] RBAC: Adding query filter params (name=member) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:21.373909 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6457b4-8ffd-495f-a3ab-e8f30a747a3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:21.375476 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6457b4-8ffd-495f-a3ab-e8f30a747a3e None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:21.386018 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 152/307] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Aug 10 09:50:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:21.388131 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceea6fde-1c66-4ec9-8d59-eb3457863428 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:21.388131 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceea6fde-1c66-4ec9-8d59-eb3457863428 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:21.388131 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceea6fde-1c66-4ec9-8d59-eb3457863428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:21.409458 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-ceea6fde-1c66-4ec9-8d59-eb3457863428 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:50:21.410738 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-ceea6fde-1c66-4ec9-8d59-eb3457863428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:50:21.423000 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dfba6f-b9a3-4c2d-98de-68af9698fe29 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:21.467181 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa31462-68c2-4883-8889-94dd85544218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:21.468098 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa31462-68c2-4883-8889-94dd85544218 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:21.468514 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa31462-68c2-4883-8889-94dd85544218 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:21.468920 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa31462-68c2-4883-8889-94dd85544218 None admin] PATH_INFO: `/v3/users/b4dbd24882b04d0a835bfcdf7ddd0703` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:21.486217 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa31462-68c2-4883-8889-94dd85544218 None admin] RBAC: Authorizing `identity:get_user(user_id=b4dbd24882b04d0a835bfcdf7ddd0703)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:21.488506 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa31462-68c2-4883-8889-94dd85544218 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:21.495340 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 153/308] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:50:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 09:50:21.495340 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceea6fde-1c66-4ec9-8d59-eb3457863428 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:21.497245 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 156/309] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 10 09:50:21 2022] GET /identity/v3/users/b4dbd24882b04d0a835bfcdf7ddd0703 => generated 293 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:21.498187 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa31462-68c2-4883-8889-94dd85544218 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:21.605465 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa31462-68c2-4883-8889-94dd85544218 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:21.631254 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceea6fde-1c66-4ec9-8d59-eb3457863428 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:21.631908 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:21.641184 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b525c9-0e99-4ffe-9b29-c3ab117379ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:21.641789 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b525c9-0e99-4ffe-9b29-c3ab117379ce None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:21.642060 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b525c9-0e99-4ffe-9b29-c3ab117379ce None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:21.642320 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b525c9-0e99-4ffe-9b29-c3ab117379ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:21.643045 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b525c9-0e99-4ffe-9b29-c3ab117379ce None admin] RBAC: Adding query filter params (role.id=362321830b5e4df5a2864d0852f5b7c4, user.id=b4dbd24882b04d0a835bfcdf7ddd0703, scope.system=all) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:21.643350 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b525c9-0e99-4ffe-9b29-c3ab117379ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:21.644806 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b525c9-0e99-4ffe-9b29-c3ab117379ce None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:21.650349 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 157/310] 10.222.0.27 () {56 vars in 1308 bytes} [Wed Aug 10 09:50:21 2022] GET /identity/v3/role_assignments?user.id=b4dbd24882b04d0a835bfcdf7ddd0703&scope.system=all&role.id=362321830b5e4df5a2864d0852f5b7c4 => generated 226 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:21.651202 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b525c9-0e99-4ffe-9b29-c3ab117379ce None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:21.667141 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:21.690249 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bee7b8-ceea-48ec-9339-a8c4b95560d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:21.690915 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bee7b8-ceea-48ec-9339-a8c4b95560d5 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:21.691200 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bee7b8-ceea-48ec-9339-a8c4b95560d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:21.691484 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bee7b8-ceea-48ec-9339-a8c4b95560d5 None admin] PATH_INFO: `/v3/users/83241da0d7334a3ebc4a57d74e569692` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:21.692698 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bee7b8-ceea-48ec-9339-a8c4b95560d5 None admin] RBAC: Authorizing `identity:get_user(user_id=83241da0d7334a3ebc4a57d74e569692)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:21.695374 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bee7b8-ceea-48ec-9339-a8c4b95560d5 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:21.697392 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 154/311] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 10 09:50:21 2022] GET /identity/v3/users/83241da0d7334a3ebc4a57d74e569692 => generated 293 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:21.704200 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bee7b8-ceea-48ec-9339-a8c4b95560d5 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:21.781060 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b525c9-0e99-4ffe-9b29-c3ab117379ce None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:21.828470 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c05cfa-b327-49cc-838d-5bfb2035a77c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:21.829973 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c05cfa-b327-49cc-838d-5bfb2035a77c None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:21.830252 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c05cfa-b327-49cc-838d-5bfb2035a77c None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:21.830522 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c05cfa-b327-49cc-838d-5bfb2035a77c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:21.845940 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bee7b8-ceea-48ec-9339-a8c4b95560d5 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:21.846894 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c05cfa-b327-49cc-838d-5bfb2035a77c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 09:50:21.852911 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-a8c05cfa-b327-49cc-838d-5bfb2035a77c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 09:50:21.852911 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:50:21.852911 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:50:21.852911 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:50:21.852911 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:50:21.852911 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:50:21.852911 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:50:21.852911 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:50:21.852911 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:50:21.852911 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:50:21.852911 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:50:21.852911 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:50:21.852911 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 09:50:21.852911 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 09:50:21.852911 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 09:50:21.852911 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 09:50:21.853796 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 09:50:21.853796 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 09:50:21.853796 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 09:50:21.853796 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 09:50:21.853796 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:50:21.853796 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:50:21.853796 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:50:21.853796 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:50:21.853796 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:50:21.853796 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:50:21.853796 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:50:21.853796 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:50:21.853796 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:50:21.853796 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:50:21.853796 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:50:21.853796 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:50:21.854561 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:50:21.854561 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:50:21.854561 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:50:21.854561 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:50:21.854561 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 09:50:21.854561 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 09:50:21.854561 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 09:50:21.854561 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 09:50:21.854561 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 09:50:21.854561 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 09:50:21.854561 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 09:50:21.854561 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:50:21.857926 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 158/312] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 10 09:50:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:50:21.863569 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c05cfa-b327-49cc-838d-5bfb2035a77c None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:21.887874 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596668dc-848b-4dc2-8b6b-1113484df441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:21.888912 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596668dc-848b-4dc2-8b6b-1113484df441 None admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:21.889460 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596668dc-848b-4dc2-8b6b-1113484df441 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:21.889939 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596668dc-848b-4dc2-8b6b-1113484df441 None admin] PATH_INFO: `/v3/system/users/83241da0d7334a3ebc4a57d74e569692/roles/8daabcb6b7394e39b06a3453e33e32db` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:21.891596 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596668dc-848b-4dc2-8b6b-1113484df441 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=83241da0d7334a3ebc4a57d74e569692, role_id=8daabcb6b7394e39b06a3453e33e32db)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:21.893333 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596668dc-848b-4dc2-8b6b-1113484df441 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:21.905233 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 155/313] 10.222.0.27 () {58 vars in 1334 bytes} [Wed Aug 10 09:50:21 2022] PUT /identity/v3/system/users/83241da0d7334a3ebc4a57d74e569692/roles/8daabcb6b7394e39b06a3453e33e32db => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 09:50:21.927988 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:21.989593 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c05cfa-b327-49cc-838d-5bfb2035a77c None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:22.032121 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25420f2b-2ade-4806-8e05-bd5e81400f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:22.032745 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25420f2b-2ade-4806-8e05-bd5e81400f34 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:22.033022 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25420f2b-2ade-4806-8e05-bd5e81400f34 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:22.033326 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25420f2b-2ade-4806-8e05-bd5e81400f34 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:22.034013 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25420f2b-2ade-4806-8e05-bd5e81400f34 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:22.034313 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25420f2b-2ade-4806-8e05-bd5e81400f34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:22.035746 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25420f2b-2ade-4806-8e05-bd5e81400f34 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:22.045972 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 159/314] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Aug 10 09:50:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 09:50:22.051589 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596668dc-848b-4dc2-8b6b-1113484df441 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:22.105860 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:22.164777 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596668dc-848b-4dc2-8b6b-1113484df441 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:22.198902 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aa01f9-5f58-4c4c-a1be-641de93023f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:22.199583 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aa01f9-5f58-4c4c-a1be-641de93023f4 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:22.199862 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aa01f9-5f58-4c4c-a1be-641de93023f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:22.200133 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aa01f9-5f58-4c4c-a1be-641de93023f4 None admin] PATH_INFO: `/v3/users/ca1994432a5d4429b929c5ed2c042906` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:22.201277 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42aa01f9-5f58-4c4c-a1be-641de93023f4 None admin] RBAC: Authorizing `identity:get_user(user_id=ca1994432a5d4429b929c5ed2c042906)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:22.202804 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42aa01f9-5f58-4c4c-a1be-641de93023f4 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:22.204760 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 156/315] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 10 09:50:22 2022] GET /identity/v3/users/ca1994432a5d4429b929c5ed2c042906 => generated 297 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:22.210262 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25420f2b-2ade-4806-8e05-bd5e81400f34 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:22.313745 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25420f2b-2ade-4806-8e05-bd5e81400f34 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:22.327494 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:22.348494 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b19c329-1139-41e8-a578-1c4797f97d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:22.349314 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b19c329-1139-41e8-a578-1c4797f97d2d None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:22.349694 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b19c329-1139-41e8-a578-1c4797f97d2d None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:22.350062 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b19c329-1139-41e8-a578-1c4797f97d2d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:22.422646 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b19c329-1139-41e8-a578-1c4797f97d2d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:22.424278 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b19c329-1139-41e8-a578-1c4797f97d2d None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:22.525211 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 160/316] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 10 09:50:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 09:50:22.530742 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aa01f9-5f58-4c4c-a1be-641de93023f4 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:22.630051 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aa01f9-5f58-4c4c-a1be-641de93023f4 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:22.646542 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:22.664533 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6a0d4e-ded1-4e1e-9b7b-4a2fa182a8b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:22.665200 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a0d4e-ded1-4e1e-9b7b-4a2fa182a8b6 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:22.665481 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a0d4e-ded1-4e1e-9b7b-4a2fa182a8b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:22.665751 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a0d4e-ded1-4e1e-9b7b-4a2fa182a8b6 None admin] PATH_INFO: `/v3/projects/7eb704c35a604e009f0597bf2e2a2684` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:22.666937 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6a0d4e-ded1-4e1e-9b7b-4a2fa182a8b6 None admin] RBAC: Authorizing `identity:get_project(project_id=7eb704c35a604e009f0597bf2e2a2684)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:22.668394 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6a0d4e-ded1-4e1e-9b7b-4a2fa182a8b6 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:22.670244 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 157/317] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 10 09:50:22 2022] GET /identity/v3/projects/7eb704c35a604e009f0597bf2e2a2684 => generated 302 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:22.675998 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b19c329-1139-41e8-a578-1c4797f97d2d None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:22.691088 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:22.780310 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b19c329-1139-41e8-a578-1c4797f97d2d None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:22.815829 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e71a0e-e85f-403e-9906-6e23e757144b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:22.816508 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e71a0e-e85f-403e-9906-6e23e757144b None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:22.816751 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e71a0e-e85f-403e-9906-6e23e757144b None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:22.816966 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e71a0e-e85f-403e-9906-6e23e757144b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:22.817732 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e71a0e-e85f-403e-9906-6e23e757144b None admin] RBAC: Adding query filter params (role.id=362321830b5e4df5a2864d0852f5b7c4, scope.project.id=7eb704c35a604e009f0597bf2e2a2684, user.id=ca1994432a5d4429b929c5ed2c042906) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:22.818038 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e71a0e-e85f-403e-9906-6e23e757144b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:22.819957 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e71a0e-e85f-403e-9906-6e23e757144b None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:22.826596 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 161/318] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 10 09:50:22 2022] GET /identity/v3/role_assignments?user.id=ca1994432a5d4429b929c5ed2c042906&scope.project.id=7eb704c35a604e009f0597bf2e2a2684&role.id=362321830b5e4df5a2864d0852f5b7c4 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:23.274852 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a3b360-5991-4fad-bd64-2acdab384b96 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:23.275400 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a3b360-5991-4fad-bd64-2acdab384b96 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:23.275400 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a3b360-5991-4fad-bd64-2acdab384b96 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:23.276887 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 158/319] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:50:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:50:23.282037 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0fe3d4-ef5b-4482-afb7-673981e6e1f5 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:23.282321 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0fe3d4-ef5b-4482-afb7-673981e6e1f5 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:23.282587 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0fe3d4-ef5b-4482-afb7-673981e6e1f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:23.300783 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-7f0fe3d4-ef5b-4482-afb7-673981e6e1f5 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:50:23.302065 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-7f0fe3d4-ef5b-4482-afb7-673981e6e1f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:50:23.369744 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 162/320] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:50:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 09:50:23.391253 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a3b360-5991-4fad-bd64-2acdab384b96 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:23.494297 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a3b360-5991-4fad-bd64-2acdab384b96 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:23.534661 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402a551f-8987-449c-b414-1da266568d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:23.535464 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402a551f-8987-449c-b414-1da266568d51 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:23.535870 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402a551f-8987-449c-b414-1da266568d51 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:23.536327 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402a551f-8987-449c-b414-1da266568d51 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:23.538066 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402a551f-8987-449c-b414-1da266568d51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:23.540641 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402a551f-8987-449c-b414-1da266568d51 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:23.543536 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 159/321] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 10 09:50:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:23.550095 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0fe3d4-ef5b-4482-afb7-673981e6e1f5 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:23.559734 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:23.657085 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0fe3d4-ef5b-4482-afb7-673981e6e1f5 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:23.700780 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c927166f-2e39-4b30-a26d-2e81e9a1bf52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:23.701434 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c927166f-2e39-4b30-a26d-2e81e9a1bf52 None admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:23.701716 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c927166f-2e39-4b30-a26d-2e81e9a1bf52 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:23.701981 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c927166f-2e39-4b30-a26d-2e81e9a1bf52 None admin] PATH_INFO: `/v3/groups` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:23.702629 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c927166f-2e39-4b30-a26d-2e81e9a1bf52 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:23.704074 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c927166f-2e39-4b30-a26d-2e81e9a1bf52 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:23.722868 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 163/322] 10.222.0.27 () {60 vars in 1134 bytes} [Wed Aug 10 09:50:23 2022] POST /identity/v3/groups => generated 226 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 09:50:23.728093 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627fd56a-4240-494e-bf20-1a2300446cc8 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:23.728093 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627fd56a-4240-494e-bf20-1a2300446cc8 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:23.728093 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627fd56a-4240-494e-bf20-1a2300446cc8 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:23.728093 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 160/323] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:50:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 09:50:23.733361 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6ac38e-0ac3-4b62-b0a5-67774c2cd611 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:23.733655 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6ac38e-0ac3-4b62-b0a5-67774c2cd611 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:23.733917 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6ac38e-0ac3-4b62-b0a5-67774c2cd611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:23.753956 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-ca6ac38e-0ac3-4b62-b0a5-67774c2cd611 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:50:23.755182 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-ca6ac38e-0ac3-4b62-b0a5-67774c2cd611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:50:23.809145 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:23.832170 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 161/324] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:50:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 09:50:23.854407 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c927166f-2e39-4b30-a26d-2e81e9a1bf52 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:23.929943 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:23.952169 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9703d3dc-9f97-4f90-b6b4-299c9dd9df66 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:23.952571 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9703d3dc-9f97-4f90-b6b4-299c9dd9df66 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:23.952855 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9703d3dc-9f97-4f90-b6b4-299c9dd9df66 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:23.954363 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 162/325] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:50:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 09:50:23.959341 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c8263-d41b-42b6-9329-41b0e47038e0 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:23.959619 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c8263-d41b-42b6-9329-41b0e47038e0 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:23.959892 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c8263-d41b-42b6-9329-41b0e47038e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:23.968415 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c927166f-2e39-4b30-a26d-2e81e9a1bf52 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:23.984364 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-890c8263-d41b-42b6-9329-41b0e47038e0 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:50:23.986362 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-890c8263-d41b-42b6-9329-41b0e47038e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:50:24.005091 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504ddea3-f49c-436d-9c61-508dc327222a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:24.005735 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504ddea3-f49c-436d-9c61-508dc327222a None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:24.006014 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504ddea3-f49c-436d-9c61-508dc327222a None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:24.006275 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504ddea3-f49c-436d-9c61-508dc327222a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:24.020140 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504ddea3-f49c-436d-9c61-508dc327222a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 09:50:24.025559 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-504ddea3-f49c-436d-9c61-508dc327222a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 09:50:24.025559 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:50:24.025559 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:50:24.025559 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:50:24.025559 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:50:24.025559 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:50:24.025559 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:50:24.025559 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:50:24.025559 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:50:24.025559 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:50:24.025559 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:50:24.025559 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:50:24.025559 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 09:50:24.025559 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 09:50:24.025559 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 09:50:24.025559 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 09:50:24.026471 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 09:50:24.026471 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 09:50:24.026471 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 09:50:24.026471 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 09:50:24.026471 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:50:24.026471 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:50:24.026471 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:50:24.026471 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:50:24.026471 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:50:24.026471 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:50:24.026471 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:50:24.026471 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:50:24.026471 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:50:24.026471 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:50:24.026471 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:50:24.026471 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:50:24.027253 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:50:24.027253 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:50:24.027253 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:50:24.027253 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:50:24.027253 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 09:50:24.027253 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 09:50:24.027253 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 09:50:24.027253 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 09:50:24.027253 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 09:50:24.027253 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 09:50:24.027253 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 09:50:24.027253 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:50:24.027253 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 164/326] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 10 09:50:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:50:24.032602 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504ddea3-f49c-436d-9c61-508dc327222a None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:24.076256 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 163/327] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:50:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 09:50:24.098330 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890c8263-d41b-42b6-9329-41b0e47038e0 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:24.155742 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504ddea3-f49c-436d-9c61-508dc327222a None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:24.187554 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:24.198872 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf960622-51a5-401d-86b8-c9de669485b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:24.199295 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf960622-51a5-401d-86b8-c9de669485b7 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:24.199573 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf960622-51a5-401d-86b8-c9de669485b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:24.199838 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf960622-51a5-401d-86b8-c9de669485b7 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:24.200513 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf960622-51a5-401d-86b8-c9de669485b7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:24.200812 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf960622-51a5-401d-86b8-c9de669485b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:24.202230 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf960622-51a5-401d-86b8-c9de669485b7 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:24.211181 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 165/328] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Aug 10 09:50:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 09:50:24.219098 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf960622-51a5-401d-86b8-c9de669485b7 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:24.231667 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890c8263-d41b-42b6-9329-41b0e47038e0 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:24.251233 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:24.276266 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b67374e-822e-4581-bf5c-53f985247e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:24.276966 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b67374e-822e-4581-bf5c-53f985247e69 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:24.277201 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b67374e-822e-4581-bf5c-53f985247e69 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:24.277480 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b67374e-822e-4581-bf5c-53f985247e69 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:24.289164 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b67374e-822e-4581-bf5c-53f985247e69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 09:50:24.294765 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-3b67374e-822e-4581-bf5c-53f985247e69 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 09:50:24.294765 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:50:24.294765 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:50:24.294765 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:50:24.294765 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:50:24.294765 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:50:24.294765 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:50:24.294765 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:50:24.294765 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:50:24.294765 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:50:24.294765 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:50:24.294765 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:50:24.294765 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 09:50:24.294765 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 09:50:24.294765 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 09:50:24.294765 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 09:50:24.295652 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 09:50:24.295652 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 09:50:24.295652 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 09:50:24.295652 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 09:50:24.295652 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:50:24.295652 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:50:24.295652 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:50:24.295652 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:50:24.295652 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:50:24.295652 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:50:24.295652 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:50:24.295652 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:50:24.295652 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:50:24.295652 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:50:24.295652 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:50:24.295652 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:50:24.296436 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:50:24.296436 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:50:24.296436 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:50:24.296436 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:50:24.296436 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 09:50:24.296436 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 09:50:24.296436 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 09:50:24.296436 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 09:50:24.296436 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 09:50:24.296436 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 09:50:24.296436 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 09:50:24.296436 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:50:24.296436 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 164/329] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 10 09:50:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:50:24.302085 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b67374e-822e-4581-bf5c-53f985247e69 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:24.349970 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf960622-51a5-401d-86b8-c9de669485b7 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:24.386161 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4113dbc4-c491-40dc-b87f-a45c9ffdcae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:24.387042 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4113dbc4-c491-40dc-b87f-a45c9ffdcae0 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:24.387458 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4113dbc4-c491-40dc-b87f-a45c9ffdcae0 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:24.387979 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4113dbc4-c491-40dc-b87f-a45c9ffdcae0 None admin] PATH_INFO: `/v3/users/b4dbd24882b04d0a835bfcdf7ddd0703` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:24.390352 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4113dbc4-c491-40dc-b87f-a45c9ffdcae0 None admin] RBAC: Authorizing `identity:get_user(user_id=b4dbd24882b04d0a835bfcdf7ddd0703)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:24.392064 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4113dbc4-c491-40dc-b87f-a45c9ffdcae0 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:24.394251 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 166/330] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 10 09:50:24 2022] GET /identity/v3/users/b4dbd24882b04d0a835bfcdf7ddd0703 => generated 293 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:24.402963 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4113dbc4-c491-40dc-b87f-a45c9ffdcae0 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:24.423875 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b67374e-822e-4581-bf5c-53f985247e69 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:24.462920 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bb2b94-556d-4f3e-85ff-cbec458985c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:24.463597 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bb2b94-556d-4f3e-85ff-cbec458985c7 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:24.469442 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bb2b94-556d-4f3e-85ff-cbec458985c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:24.469442 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bb2b94-556d-4f3e-85ff-cbec458985c7 None admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:24.469442 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bb2b94-556d-4f3e-85ff-cbec458985c7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:24.469442 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bb2b94-556d-4f3e-85ff-cbec458985c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:24.469442 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bb2b94-556d-4f3e-85ff-cbec458985c7 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:24.475666 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 165/331] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Aug 10 09:50:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 09:50:24.481394 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bb2b94-556d-4f3e-85ff-cbec458985c7 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:24.484728 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:24.522666 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:24.534241 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4113dbc4-c491-40dc-b87f-a45c9ffdcae0 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:24.587972 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1778e696-dae9-49fa-8afd-8cb9fae0e992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:24.589022 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1778e696-dae9-49fa-8afd-8cb9fae0e992 None admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:24.589333 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1778e696-dae9-49fa-8afd-8cb9fae0e992 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:24.589603 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1778e696-dae9-49fa-8afd-8cb9fae0e992 None admin] PATH_INFO: `/v3/system/users/b4dbd24882b04d0a835bfcdf7ddd0703/roles/362321830b5e4df5a2864d0852f5b7c4` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:24.591047 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1778e696-dae9-49fa-8afd-8cb9fae0e992 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=b4dbd24882b04d0a835bfcdf7ddd0703, role_id=362321830b5e4df5a2864d0852f5b7c4)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:24.592442 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1778e696-dae9-49fa-8afd-8cb9fae0e992 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:24.604962 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 167/332] 10.222.0.27 () {58 vars in 1334 bytes} [Wed Aug 10 09:50:24 2022] PUT /identity/v3/system/users/b4dbd24882b04d0a835bfcdf7ddd0703/roles/362321830b5e4df5a2864d0852f5b7c4 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 09:50:24.622647 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bb2b94-556d-4f3e-85ff-cbec458985c7 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:24.674654 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adb8468-5c38-4bf5-8ab8-86de0c7c836f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:24.675657 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb8468-5c38-4bf5-8ab8-86de0c7c836f None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:24.676136 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb8468-5c38-4bf5-8ab8-86de0c7c836f None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:24.676602 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb8468-5c38-4bf5-8ab8-86de0c7c836f None admin] PATH_INFO: `/v3/users/83241da0d7334a3ebc4a57d74e569692` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:24.678048 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adb8468-5c38-4bf5-8ab8-86de0c7c836f None admin] RBAC: Authorizing `identity:get_user(user_id=83241da0d7334a3ebc4a57d74e569692)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:24.682507 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adb8468-5c38-4bf5-8ab8-86de0c7c836f None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:24.682507 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 166/333] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 10 09:50:24 2022] GET /identity/v3/users/83241da0d7334a3ebc4a57d74e569692 => generated 293 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 09:50:24.690288 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1778e696-dae9-49fa-8afd-8cb9fae0e992 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:24.836835 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1778e696-dae9-49fa-8afd-8cb9fae0e992 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:24.861129 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:24.877715 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da798be-d485-4bfa-9d73-bdcb58c09120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:24.878322 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da798be-d485-4bfa-9d73-bdcb58c09120 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:24.879801 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da798be-d485-4bfa-9d73-bdcb58c09120 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:24.880089 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da798be-d485-4bfa-9d73-bdcb58c09120 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:24.880827 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da798be-d485-4bfa-9d73-bdcb58c09120 None admin] RBAC: Adding query filter params (role.id=8daabcb6b7394e39b06a3453e33e32db, user.id=83241da0d7334a3ebc4a57d74e569692, scope.system=all) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:24.881164 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da798be-d485-4bfa-9d73-bdcb58c09120 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:24.882691 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da798be-d485-4bfa-9d73-bdcb58c09120 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:24.895245 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 168/334] 10.222.0.27 () {56 vars in 1308 bytes} [Wed Aug 10 09:50:24 2022] GET /identity/v3/role_assignments?user.id=83241da0d7334a3ebc4a57d74e569692&scope.system=all&role.id=8daabcb6b7394e39b06a3453e33e32db => generated 510 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:26.363180 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef26ff-8530-4520-8f9d-f21e3fb14f31 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:26.363712 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef26ff-8530-4520-8f9d-f21e3fb14f31 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:26.363712 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef26ff-8530-4520-8f9d-f21e3fb14f31 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:26.365431 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 167/335] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:50:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:50:26.371023 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9d2f00-431a-4ae8-b469-daeadadefcf8 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:26.371474 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9d2f00-431a-4ae8-b469-daeadadefcf8 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:26.371654 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9d2f00-431a-4ae8-b469-daeadadefcf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:26.394205 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-fb9d2f00-431a-4ae8-b469-daeadadefcf8 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:50:26.395407 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-fb9d2f00-431a-4ae8-b469-daeadadefcf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:50:26.453028 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0d84eb-0b13-43e5-b1e3-7ff49ec89d85 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:26.453376 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0d84eb-0b13-43e5-b1e3-7ff49ec89d85 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:26.453600 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0d84eb-0b13-43e5-b1e3-7ff49ec89d85 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:26.455188 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 168/336] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:50:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:50:26.459898 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed9ddf8-4f97-4686-8ec9-7c9572fb3927 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:26.460171 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed9ddf8-4f97-4686-8ec9-7c9572fb3927 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:26.460480 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed9ddf8-4f97-4686-8ec9-7c9572fb3927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:26.480405 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 169/337] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:50:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 09:50:26.483609 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-8ed9ddf8-4f97-4686-8ec9-7c9572fb3927 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:50:26.484810 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-8ed9ddf8-4f97-4686-8ec9-7c9572fb3927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:50:26.524568 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9d2f00-431a-4ae8-b469-daeadadefcf8 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:26.553610 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 169/338] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:50:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 09:50:26.576305 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed9ddf8-4f97-4686-8ec9-7c9572fb3927 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:26.609517 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:26.673313 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9d2f00-431a-4ae8-b469-daeadadefcf8 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:26.689121 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed9ddf8-4f97-4686-8ec9-7c9572fb3927 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:26.695607 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:26.722486 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef11b7e-3c9e-4e47-be0c-8c5d0869e17c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:26.723120 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef11b7e-3c9e-4e47-be0c-8c5d0869e17c None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:26.723397 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef11b7e-3c9e-4e47-be0c-8c5d0869e17c None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:26.723663 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef11b7e-3c9e-4e47-be0c-8c5d0869e17c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:26.734637 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef11b7e-3c9e-4e47-be0c-8c5d0869e17c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 09:50:26.739345 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-3ef11b7e-3c9e-4e47-be0c-8c5d0869e17c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 09:50:26.739345 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:50:26.739345 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:50:26.739345 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:50:26.739345 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:50:26.739345 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:50:26.739345 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:50:26.739345 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:50:26.739345 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:50:26.739345 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:50:26.739345 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:50:26.739345 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:50:26.739345 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 09:50:26.739345 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 09:50:26.739345 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 09:50:26.739345 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 09:50:26.740195 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 09:50:26.740195 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 09:50:26.740195 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 09:50:26.740195 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 09:50:26.740195 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:50:26.740195 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:50:26.740195 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:50:26.740195 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:50:26.740195 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:50:26.740195 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:50:26.740195 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:50:26.740195 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:50:26.740195 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:50:26.740195 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:50:26.740195 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:50:26.740195 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:50:26.741443 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:50:26.741443 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:50:26.741443 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:50:26.741443 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:50:26.741443 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 09:50:26.741443 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 09:50:26.741443 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 09:50:26.741443 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 09:50:26.741443 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 09:50:26.741443 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 09:50:26.741443 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 09:50:26.741443 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:50:26.741443 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 170/339] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Aug 10 09:50:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 09:50:26.746616 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef11b7e-3c9e-4e47-be0c-8c5d0869e17c None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:26.781910 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb3b4d4-c18c-42ee-8cea-87ea80bc5cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:26.782567 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb3b4d4-c18c-42ee-8cea-87ea80bc5cfb None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:26.782844 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb3b4d4-c18c-42ee-8cea-87ea80bc5cfb None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:26.783116 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb3b4d4-c18c-42ee-8cea-87ea80bc5cfb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:26.810050 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb3b4d4-c18c-42ee-8cea-87ea80bc5cfb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 09:50:26.814817 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-4fb3b4d4-c18c-42ee-8cea-87ea80bc5cfb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 09:50:26.814817 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:50:26.814817 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:50:26.814817 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:50:26.814817 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:50:26.814817 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:50:26.814817 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:50:26.814817 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:50:26.814817 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:50:26.814817 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:50:26.814817 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:50:26.814817 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:50:26.814817 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 09:50:26.814817 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 09:50:26.814817 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 09:50:26.814817 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 09:50:26.816975 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 09:50:26.816975 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 09:50:26.816975 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 09:50:26.816975 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 09:50:26.816975 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:50:26.816975 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:50:26.816975 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:50:26.816975 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:50:26.816975 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:50:26.816975 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:50:26.816975 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:50:26.816975 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:50:26.816975 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:50:26.816975 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:50:26.816975 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:50:26.816975 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:50:26.818965 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:50:26.818965 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:50:26.818965 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:50:26.818965 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:50:26.818965 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 09:50:26.818965 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 09:50:26.818965 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 09:50:26.818965 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 09:50:26.818965 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 09:50:26.818965 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 09:50:26.818965 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 09:50:26.818965 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:50:26.818965 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 170/340] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 10 09:50:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:50:26.826860 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb3b4d4-c18c-42ee-8cea-87ea80bc5cfb None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:26.843027 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:26.853868 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef11b7e-3c9e-4e47-be0c-8c5d0869e17c None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:26.891435 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b521575-d2a9-4eed-ab0b-7f73426f3b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:26.892072 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b521575-d2a9-4eed-ab0b-7f73426f3b4b None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:26.892346 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b521575-d2a9-4eed-ab0b-7f73426f3b4b None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:26.892607 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b521575-d2a9-4eed-ab0b-7f73426f3b4b None admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:26.893309 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b521575-d2a9-4eed-ab0b-7f73426f3b4b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:26.893609 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b521575-d2a9-4eed-ab0b-7f73426f3b4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:26.894987 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b521575-d2a9-4eed-ab0b-7f73426f3b4b None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:26.903688 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 171/341] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 10 09:50:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 09:50:26.909214 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b521575-d2a9-4eed-ab0b-7f73426f3b4b None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:27.012021 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b521575-d2a9-4eed-ab0b-7f73426f3b4b None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:27.046888 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ef6dd2-7386-44e7-b05a-191d911099ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:27.047498 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef6dd2-7386-44e7-b05a-191d911099ec None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:27.047773 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef6dd2-7386-44e7-b05a-191d911099ec None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:27.048043 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef6dd2-7386-44e7-b05a-191d911099ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:27.076286 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:27.085241 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb3b4d4-c18c-42ee-8cea-87ea80bc5cfb None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:27.122468 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ef6dd2-7386-44e7-b05a-191d911099ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:27.123938 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ef6dd2-7386-44e7-b05a-191d911099ec None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:27.170649 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d63b23-6495-4540-9a63-70db2f6c3285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:27.171271 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d63b23-6495-4540-9a63-70db2f6c3285 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:27.171543 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d63b23-6495-4540-9a63-70db2f6c3285 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:27.171813 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d63b23-6495-4540-9a63-70db2f6c3285 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:27.172485 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d63b23-6495-4540-9a63-70db2f6c3285 None admin] RBAC: Adding query filter params (name=member) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:27.172788 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d63b23-6495-4540-9a63-70db2f6c3285 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:27.174218 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d63b23-6495-4540-9a63-70db2f6c3285 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:27.192573 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 171/342] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Aug 10 09:50:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:27.198872 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d63b23-6495-4540-9a63-70db2f6c3285 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:27.229287 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 172/343] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 10 09:50:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 10 09:50:27.230960 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ef6dd2-7386-44e7-b05a-191d911099ec None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:27.275512 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:27.288155 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:27.351941 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ef6dd2-7386-44e7-b05a-191d911099ec None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:27.369393 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d63b23-6495-4540-9a63-70db2f6c3285 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:27.401792 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94110ee8-22c2-467b-8be9-1ac5f87d8749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:27.402491 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94110ee8-22c2-467b-8be9-1ac5f87d8749 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:27.402695 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94110ee8-22c2-467b-8be9-1ac5f87d8749 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:27.402966 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94110ee8-22c2-467b-8be9-1ac5f87d8749 None admin] PATH_INFO: `/v3/projects/b812d355220c4d00b5c4835f163074aa` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:27.404140 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94110ee8-22c2-467b-8be9-1ac5f87d8749 None admin] RBAC: Authorizing `identity:get_project(project_id=b812d355220c4d00b5c4835f163074aa)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:27.405626 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94110ee8-22c2-467b-8be9-1ac5f87d8749 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:27.407559 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 173/344] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 10 09:50:27 2022] GET /identity/v3/projects/b812d355220c4d00b5c4835f163074aa => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 09:50:27.413085 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94110ee8-22c2-467b-8be9-1ac5f87d8749 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:27.420732 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c83169-c3db-473f-b89c-29f207580d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:27.421936 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c83169-c3db-473f-b89c-29f207580d63 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:27.422411 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c83169-c3db-473f-b89c-29f207580d63 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:27.422823 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c83169-c3db-473f-b89c-29f207580d63 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:27.519531 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94110ee8-22c2-467b-8be9-1ac5f87d8749 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:27.542993 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:27.546038 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c83169-c3db-473f-b89c-29f207580d63 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:27.547821 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c83169-c3db-473f-b89c-29f207580d63 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:27.555717 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37249c9c-b86e-4149-98d1-7dc787c86ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:27.556409 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37249c9c-b86e-4149-98d1-7dc787c86ead None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:27.556690 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37249c9c-b86e-4149-98d1-7dc787c86ead None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:27.556961 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37249c9c-b86e-4149-98d1-7dc787c86ead None admin] PATH_INFO: `/v3/groups/29d6a6b745ce49bcbbfe47ffaa25dade` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:27.564575 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37249c9c-b86e-4149-98d1-7dc787c86ead None admin] RBAC: Authorizing `identity:get_group(group_id=29d6a6b745ce49bcbbfe47ffaa25dade)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:27.566081 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37249c9c-b86e-4149-98d1-7dc787c86ead None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:27.568077 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 174/345] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Aug 10 09:50:27 2022] GET /identity/v3/groups/29d6a6b745ce49bcbbfe47ffaa25dade => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:27.574233 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37249c9c-b86e-4149-98d1-7dc787c86ead None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:27.602080 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:27.680430 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37249c9c-b86e-4149-98d1-7dc787c86ead None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:27.757544 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 172/346] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 10 09:50:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 559 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 10 09:50:27.758825 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8c89a0-1d63-4a13-a71a-ebd87d5025fb None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:27.759108 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8c89a0-1d63-4a13-a71a-ebd87d5025fb None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:27.759379 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8c89a0-1d63-4a13-a71a-ebd87d5025fb None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:27.761740 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c37694-b297-4d23-81eb-8e5b15a0a330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:27.762358 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c37694-b297-4d23-81eb-8e5b15a0a330 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:27.762675 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c37694-b297-4d23-81eb-8e5b15a0a330 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:27.762951 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c37694-b297-4d23-81eb-8e5b15a0a330 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:27.763697 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c37694-b297-4d23-81eb-8e5b15a0a330 None admin] RBAC: Adding query filter params (group.id=29d6a6b745ce49bcbbfe47ffaa25dade, role.id=5d80017a50774daba0c1fee326754295, scope.project.id=b812d355220c4d00b5c4835f163074aa) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:27.764002 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c37694-b297-4d23-81eb-8e5b15a0a330 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:27.765560 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c37694-b297-4d23-81eb-8e5b15a0a330 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:27.766911 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 173/347] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:50:27 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:50:27.767717 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8c89a0-1d63-4a13-a71a-ebd87d5025fb None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:27.776206 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 175/348] 10.222.0.27 () {56 vars in 1376 bytes} [Wed Aug 10 09:50:27 2022] GET /identity/v3/role_assignments?group.id=29d6a6b745ce49bcbbfe47ffaa25dade&scope.project.id=b812d355220c4d00b5c4835f163074aa&role.id=5d80017a50774daba0c1fee326754295 => generated 260 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 09:50:27.782072 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964dae96-b551-4c0d-9add-898d05b319f2 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:27.782435 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964dae96-b551-4c0d-9add-898d05b319f2 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:27.782803 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964dae96-b551-4c0d-9add-898d05b319f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:27.822335 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-964dae96-b551-4c0d-9add-898d05b319f2 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:50:27.823590 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-964dae96-b551-4c0d-9add-898d05b319f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:50:27.929599 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:27.956323 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8c89a0-1d63-4a13-a71a-ebd87d5025fb None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:27.969660 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 176/349] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:50:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 09:50:28.007611 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:28.016898 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170eb08e-7e91-4454-abe6-aabce423c13c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:28.017851 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170eb08e-7e91-4454-abe6-aabce423c13c None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:28.017957 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170eb08e-7e91-4454-abe6-aabce423c13c None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:28.018209 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170eb08e-7e91-4454-abe6-aabce423c13c None admin] PATH_INFO: `/v3/projects/b812d355220c4d00b5c4835f163074aa` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:28.018938 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964dae96-b551-4c0d-9add-898d05b319f2 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:28.019710 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170eb08e-7e91-4454-abe6-aabce423c13c None admin] RBAC: Authorizing `identity:get_project(project_id=b812d355220c4d00b5c4835f163074aa)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:28.021562 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170eb08e-7e91-4454-abe6-aabce423c13c None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:28.024475 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 174/350] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 10 09:50:27 2022] GET /identity/v3/projects/b812d355220c4d00b5c4835f163074aa => generated 298 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:28.025752 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cf3b5e-4aa3-47a2-babf-bffaa213fb6a None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:28.026029 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cf3b5e-4aa3-47a2-babf-bffaa213fb6a None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:28.026297 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cf3b5e-4aa3-47a2-babf-bffaa213fb6a None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:28.027706 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 175/351] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:50:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:50:28.032410 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cf3b5e-4aa3-47a2-babf-bffaa213fb6a None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:28.201040 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cf3b5e-4aa3-47a2-babf-bffaa213fb6a None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:28.205271 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964dae96-b551-4c0d-9add-898d05b319f2 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:28.243618 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc93de8-c3a7-4c92-91dd-0d9f9c037efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:28.244253 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc93de8-c3a7-4c92-91dd-0d9f9c037efb None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:28.244528 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc93de8-c3a7-4c92-91dd-0d9f9c037efb None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:28.244794 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc93de8-c3a7-4c92-91dd-0d9f9c037efb None admin] PATH_INFO: `/v3/groups/29d6a6b745ce49bcbbfe47ffaa25dade` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:28.246530 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc93de8-c3a7-4c92-91dd-0d9f9c037efb None admin] RBAC: Authorizing `identity:get_group(group_id=29d6a6b745ce49bcbbfe47ffaa25dade)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:28.247987 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc93de8-c3a7-4c92-91dd-0d9f9c037efb None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:28.249618 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 176/352] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Aug 10 09:50:28 2022] GET /identity/v3/groups/29d6a6b745ce49bcbbfe47ffaa25dade => generated 226 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:28.251121 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ccb728-d624-4f05-9591-53a1290e8953 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:28.251396 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ccb728-d624-4f05-9591-53a1290e8953 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:28.251664 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ccb728-d624-4f05-9591-53a1290e8953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:28.275481 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-79ccb728-d624-4f05-9591-53a1290e8953 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:50:28.276781 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-79ccb728-d624-4f05-9591-53a1290e8953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:50:28.295167 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ad0fb6-1ba1-437a-9709-417e5d0dd1ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:28.295812 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ad0fb6-1ba1-437a-9709-417e5d0dd1ee None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:28.296088 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ad0fb6-1ba1-437a-9709-417e5d0dd1ee None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:28.296371 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ad0fb6-1ba1-437a-9709-417e5d0dd1ee None admin] PATH_INFO: `/v3/roles/member` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:28.307714 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ad0fb6-1ba1-437a-9709-417e5d0dd1ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 09:50:28.312524 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-f9ad0fb6-1ba1-437a-9709-417e5d0dd1ee None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 09:50:28.312524 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:50:28.312524 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:50:28.312524 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:50:28.312524 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:50:28.312524 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:50:28.312524 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:50:28.312524 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:50:28.312524 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:50:28.312524 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:50:28.312524 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:50:28.312524 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:50:28.312524 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 09:50:28.312524 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 09:50:28.312524 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 09:50:28.312524 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 09:50:28.313462 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 09:50:28.313462 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 09:50:28.313462 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 09:50:28.313462 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 09:50:28.313462 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:50:28.313462 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:50:28.313462 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:50:28.313462 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:50:28.313462 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:50:28.313462 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:50:28.313462 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:50:28.313462 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:50:28.313462 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:50:28.313462 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:50:28.313462 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:50:28.313462 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:50:28.314249 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:50:28.314249 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:50:28.314249 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:50:28.314249 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:50:28.314249 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 09:50:28.314249 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 09:50:28.314249 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 09:50:28.314249 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 09:50:28.314249 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 09:50:28.314249 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 09:50:28.314249 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 09:50:28.314249 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:50:28.315151 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 177/353] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 10 09:50:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 09:50:28.315942 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ad0fb6-1ba1-437a-9709-417e5d0dd1ee None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:28.356556 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:28.366561 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 177/354] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:50:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 09:50:28.370956 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2e8be7-5b8d-41d6-be3a-4f3e21d090b2 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:28.370956 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2e8be7-5b8d-41d6-be3a-4f3e21d090b2 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:28.370956 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2e8be7-5b8d-41d6-be3a-4f3e21d090b2 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:28.372258 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 178/355] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:50:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:50:28.375152 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:28.375271 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2e8be7-5b8d-41d6-be3a-4f3e21d090b2 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:28.463223 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ad0fb6-1ba1-437a-9709-417e5d0dd1ee None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:28.508797 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544b336a-afcb-4984-a832-66bd4741927d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:28.509421 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544b336a-afcb-4984-a832-66bd4741927d None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:28.509697 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544b336a-afcb-4984-a832-66bd4741927d None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:28.510142 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544b336a-afcb-4984-a832-66bd4741927d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:28.511599 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544b336a-afcb-4984-a832-66bd4741927d None admin] RBAC: Adding query filter params (group.id=29d6a6b745ce49bcbbfe47ffaa25dade, role.id=8daabcb6b7394e39b06a3453e33e32db, scope.project.id=b812d355220c4d00b5c4835f163074aa) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:28.511911 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544b336a-afcb-4984-a832-66bd4741927d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:28.513679 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2e8be7-5b8d-41d6-be3a-4f3e21d090b2 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:28.514125 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544b336a-afcb-4984-a832-66bd4741927d None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:28.520429 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 178/356] 10.222.0.27 () {56 vars in 1376 bytes} [Wed Aug 10 09:50:28 2022] GET /identity/v3/role_assignments?group.id=29d6a6b745ce49bcbbfe47ffaa25dade&scope.project.id=b812d355220c4d00b5c4835f163074aa&role.id=8daabcb6b7394e39b06a3453e33e32db => generated 260 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:28.521820 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b50dac-6687-4cf4-a79e-3b608ea2f0c7 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:28.522103 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b50dac-6687-4cf4-a79e-3b608ea2f0c7 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:28.522372 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b50dac-6687-4cf4-a79e-3b608ea2f0c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:28.543237 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-15b50dac-6687-4cf4-a79e-3b608ea2f0c7 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:50:28.544467 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-15b50dac-6687-4cf4-a79e-3b608ea2f0c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:50:28.554887 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff082403-fe2f-43a1-a3e6-6c99c74f389b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:28.555923 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff082403-fe2f-43a1-a3e6-6c99c74f389b None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:28.556363 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff082403-fe2f-43a1-a3e6-6c99c74f389b None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:28.556816 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff082403-fe2f-43a1-a3e6-6c99c74f389b None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:28.557796 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff082403-fe2f-43a1-a3e6-6c99c74f389b None admin] RBAC: Adding query filter params (name=member) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:28.558291 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff082403-fe2f-43a1-a3e6-6c99c74f389b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:28.560032 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff082403-fe2f-43a1-a3e6-6c99c74f389b None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:28.570973 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 179/357] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Aug 10 09:50:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:28.572343 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff082403-fe2f-43a1-a3e6-6c99c74f389b None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:28.619608 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 179/358] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:50:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 09:50:28.620496 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b50dac-6687-4cf4-a79e-3b608ea2f0c7 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:28.673009 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:28.712114 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:28.734597 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff082403-fe2f-43a1-a3e6-6c99c74f389b None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:28.778753 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42929346-9e09-4596-80d9-7f9f007418fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:28.779803 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42929346-9e09-4596-80d9-7f9f007418fc None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:28.780255 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42929346-9e09-4596-80d9-7f9f007418fc None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:28.781604 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42929346-9e09-4596-80d9-7f9f007418fc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:28.795101 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42929346-9e09-4596-80d9-7f9f007418fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 09:50:28.802911 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-42929346-9e09-4596-80d9-7f9f007418fc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 09:50:28.802911 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:50:28.802911 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:50:28.802911 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:50:28.802911 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:50:28.802911 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:50:28.802911 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:50:28.802911 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:50:28.802911 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:50:28.802911 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:50:28.802911 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:50:28.802911 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:50:28.802911 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 09:50:28.802911 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 09:50:28.802911 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 09:50:28.802911 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 09:50:28.804013 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 09:50:28.804013 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 09:50:28.804013 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 09:50:28.804013 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 09:50:28.804013 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:50:28.804013 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:50:28.804013 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:50:28.804013 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:50:28.804013 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:50:28.804013 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:50:28.804013 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:50:28.804013 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:50:28.804013 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:50:28.804013 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:50:28.804013 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:50:28.804013 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:50:28.804878 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:50:28.804878 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:50:28.804878 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:50:28.804878 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:50:28.804878 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 09:50:28.804878 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 09:50:28.804878 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 09:50:28.804878 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 09:50:28.804878 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 09:50:28.804878 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 09:50:28.804878 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 10 09:50:28.804878 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:50:28.805524 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 180/359] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 10 09:50:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:50:28.807848 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42929346-9e09-4596-80d9-7f9f007418fc None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:28.851172 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b50dac-6687-4cf4-a79e-3b608ea2f0c7 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:28.890285 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3942d39d-578d-4de1-b8fb-d95e7af5d03e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:28.891046 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3942d39d-578d-4de1-b8fb-d95e7af5d03e None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:28.891416 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3942d39d-578d-4de1-b8fb-d95e7af5d03e None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:28.891778 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3942d39d-578d-4de1-b8fb-d95e7af5d03e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:28.973826 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3942d39d-578d-4de1-b8fb-d95e7af5d03e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:28.975311 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3942d39d-578d-4de1-b8fb-d95e7af5d03e None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:29.006791 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42929346-9e09-4596-80d9-7f9f007418fc None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:29.013524 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:29.031354 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:29.056206 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e488e0-09b1-4b48-8b6f-c030e8ae2704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:29.057410 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e488e0-09b1-4b48-8b6f-c030e8ae2704 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:29.058736 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e488e0-09b1-4b48-8b6f-c030e8ae2704 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:29.059163 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e488e0-09b1-4b48-8b6f-c030e8ae2704 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:29.073793 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e488e0-09b1-4b48-8b6f-c030e8ae2704 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 09:50:29.080036 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-e3e488e0-09b1-4b48-8b6f-c030e8ae2704 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 09:50:29.080036 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:50:29.080036 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:50:29.080036 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:50:29.080036 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:50:29.080036 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:50:29.080036 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:50:29.080036 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:50:29.080036 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:50:29.080036 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:50:29.080036 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:50:29.080036 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:50:29.080036 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 09:50:29.080036 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 09:50:29.080036 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 09:50:29.080036 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 09:50:29.081156 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 09:50:29.081156 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 09:50:29.081156 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 09:50:29.081156 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 09:50:29.081156 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:50:29.081156 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:50:29.081156 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:50:29.081156 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:50:29.081156 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:50:29.081156 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:50:29.081156 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:50:29.081156 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:50:29.081156 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:50:29.081156 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:50:29.081156 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:50:29.081156 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:50:29.081942 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:50:29.081942 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:50:29.081942 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:50:29.081942 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:50:29.081942 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 09:50:29.081942 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 09:50:29.081942 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 09:50:29.081942 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 09:50:29.081942 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 09:50:29.081942 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 09:50:29.081942 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 09:50:29.081942 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:50:29.082781 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 181/360] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Aug 10 09:50:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:50:29.087463 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e488e0-09b1-4b48-8b6f-c030e8ae2704 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:29.099854 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 180/361] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 10 09:50:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 09:50:29.101965 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4da2fc-d9bf-4dad-b65f-7db1df9bb235 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:29.102469 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4da2fc-d9bf-4dad-b65f-7db1df9bb235 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:29.102947 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4da2fc-d9bf-4dad-b65f-7db1df9bb235 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:29.104678 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 181/362] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:50:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:50:29.105891 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4da2fc-d9bf-4dad-b65f-7db1df9bb235 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:29.216413 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e488e0-09b1-4b48-8b6f-c030e8ae2704 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:29.248143 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4da2fc-d9bf-4dad-b65f-7db1df9bb235 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:29.255709 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d6d624-193d-4bf6-b3e9-96e4273be15e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:29.256331 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d6d624-193d-4bf6-b3e9-96e4273be15e None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:29.256610 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d6d624-193d-4bf6-b3e9-96e4273be15e None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:29.256936 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d6d624-193d-4bf6-b3e9-96e4273be15e None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:29.257616 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d6d624-193d-4bf6-b3e9-96e4273be15e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:29.257916 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d6d624-193d-4bf6-b3e9-96e4273be15e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:29.259311 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d6d624-193d-4bf6-b3e9-96e4273be15e None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:29.273089 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 182/363] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Aug 10 09:50:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:29.273089 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e617673c-bff5-4890-ac87-8179cbd3e60c None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:29.273089 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e617673c-bff5-4890-ac87-8179cbd3e60c None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:29.273089 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e617673c-bff5-4890-ac87-8179cbd3e60c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:29.291011 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-e617673c-bff5-4890-ac87-8179cbd3e60c None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:50:29.292345 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-e617673c-bff5-4890-ac87-8179cbd3e60c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:50:29.298113 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ed7e9e-7a54-4429-94b4-752d264a78c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:29.299017 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ed7e9e-7a54-4429-94b4-752d264a78c2 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:29.299494 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ed7e9e-7a54-4429-94b4-752d264a78c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:29.299963 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ed7e9e-7a54-4429-94b4-752d264a78c2 None admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:29.301408 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ed7e9e-7a54-4429-94b4-752d264a78c2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:29.301940 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ed7e9e-7a54-4429-94b4-752d264a78c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:29.304647 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ed7e9e-7a54-4429-94b4-752d264a78c2 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:29.306650 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:29.316910 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 182/364] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 10 09:50:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:29.322436 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ed7e9e-7a54-4429-94b4-752d264a78c2 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:29.340078 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:29.387618 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 183/365] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:50:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 09:50:29.388792 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e617673c-bff5-4890-ac87-8179cbd3e60c None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:29.466762 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ed7e9e-7a54-4429-94b4-752d264a78c2 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:29.505759 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a25214-ac92-4a71-9bce-8ff9ba57cf0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:29.506444 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a25214-ac92-4a71-9bce-8ff9ba57cf0c None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:29.506723 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a25214-ac92-4a71-9bce-8ff9ba57cf0c None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:29.507051 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a25214-ac92-4a71-9bce-8ff9ba57cf0c None admin] PATH_INFO: `/v3/projects/7eb704c35a604e009f0597bf2e2a2684` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:29.508883 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a25214-ac92-4a71-9bce-8ff9ba57cf0c None admin] RBAC: Authorizing `identity:get_project(project_id=7eb704c35a604e009f0597bf2e2a2684)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:29.511500 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a25214-ac92-4a71-9bce-8ff9ba57cf0c None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:29.513363 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 183/366] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 10 09:50:29 2022] GET /identity/v3/projects/7eb704c35a604e009f0597bf2e2a2684 => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:29.513733 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e617673c-bff5-4890-ac87-8179cbd3e60c None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:29.514188 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a25214-ac92-4a71-9bce-8ff9ba57cf0c None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:29.572874 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562ee54f-1057-419f-8607-4c65a2ebd8c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:29.572874 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562ee54f-1057-419f-8607-4c65a2ebd8c2 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:29.572874 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562ee54f-1057-419f-8607-4c65a2ebd8c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:29.572874 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562ee54f-1057-419f-8607-4c65a2ebd8c2 None admin] PATH_INFO: `/v3/users/b4dbd24882b04d0a835bfcdf7ddd0703` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:29.573868 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562ee54f-1057-419f-8607-4c65a2ebd8c2 None admin] RBAC: Authorizing `identity:get_user(user_id=b4dbd24882b04d0a835bfcdf7ddd0703)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:29.575338 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562ee54f-1057-419f-8607-4c65a2ebd8c2 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:29.577117 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 184/367] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 10 09:50:29 2022] GET /identity/v3/users/b4dbd24882b04d0a835bfcdf7ddd0703 => generated 293 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:29.581162 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562ee54f-1057-419f-8607-4c65a2ebd8c2 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:29.604628 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:29.633204 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:29.654373 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a25214-ac92-4a71-9bce-8ff9ba57cf0c None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:29.698099 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1bbb60-666f-4196-a34c-5ceadfb14080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:29.699011 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1bbb60-666f-4196-a34c-5ceadfb14080 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:29.699294 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1bbb60-666f-4196-a34c-5ceadfb14080 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:29.699822 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1bbb60-666f-4196-a34c-5ceadfb14080 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:29.701726 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562ee54f-1057-419f-8607-4c65a2ebd8c2 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:29.744660 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2b6942-3306-4a37-9ba3-9194364d1408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:29.745567 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2b6942-3306-4a37-9ba3-9194364d1408 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:29.745944 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2b6942-3306-4a37-9ba3-9194364d1408 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:29.746312 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2b6942-3306-4a37-9ba3-9194364d1408 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:29.757822 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2b6942-3306-4a37-9ba3-9194364d1408 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 09:50:29.762920 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-3b2b6942-3306-4a37-9ba3-9194364d1408 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 09:50:29.762920 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:50:29.762920 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:50:29.762920 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:50:29.762920 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:50:29.762920 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:50:29.762920 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:50:29.762920 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:50:29.762920 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:50:29.762920 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:50:29.762920 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:50:29.762920 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:50:29.762920 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 09:50:29.762920 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 09:50:29.762920 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 09:50:29.762920 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 09:50:29.763778 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 09:50:29.763778 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 09:50:29.763778 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 09:50:29.763778 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 09:50:29.763778 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:50:29.763778 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:50:29.763778 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:50:29.763778 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:50:29.763778 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:50:29.763778 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:50:29.763778 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:50:29.763778 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:50:29.763778 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:50:29.763778 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:50:29.763778 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:50:29.763778 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:50:29.764967 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:50:29.764967 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:50:29.764967 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:50:29.764967 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:50:29.764967 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 09:50:29.764967 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 09:50:29.764967 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 09:50:29.764967 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 09:50:29.764967 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 09:50:29.764967 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 09:50:29.764967 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 09:50:29.764967 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:50:29.764967 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 185/368] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Aug 10 09:50:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:50:29.768240 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2b6942-3306-4a37-9ba3-9194364d1408 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:29.781037 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1bbb60-666f-4196-a34c-5ceadfb14080 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:29.784475 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1bbb60-666f-4196-a34c-5ceadfb14080 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:29.852985 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:29.885711 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:29.890149 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2b6942-3306-4a37-9ba3-9194364d1408 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:29.896476 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 184/369] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 10 09:50:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 09:50:29.897201 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1bbb60-666f-4196-a34c-5ceadfb14080 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:29.932557 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04735b5b-0c04-4b7d-82ee-535a7b70d488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:29.933609 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04735b5b-0c04-4b7d-82ee-535a7b70d488 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:29.934089 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04735b5b-0c04-4b7d-82ee-535a7b70d488 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:29.934574 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04735b5b-0c04-4b7d-82ee-535a7b70d488 None admin] PATH_INFO: `/v3/groups/29d6a6b745ce49bcbbfe47ffaa25dade` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:29.935899 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04735b5b-0c04-4b7d-82ee-535a7b70d488 None admin] RBAC: Authorizing `identity:get_group(group_id=29d6a6b745ce49bcbbfe47ffaa25dade)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:29.937692 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04735b5b-0c04-4b7d-82ee-535a7b70d488 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:29.939492 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 186/370] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Aug 10 09:50:29 2022] GET /identity/v3/groups/29d6a6b745ce49bcbbfe47ffaa25dade => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:29.940442 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04735b5b-0c04-4b7d-82ee-535a7b70d488 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:30.013674 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1bbb60-666f-4196-a34c-5ceadfb14080 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:30.050741 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04735b5b-0c04-4b7d-82ee-535a7b70d488 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:30.050966 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cfc1ae-8e59-4f1f-8f6e-3283260c3c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:30.051485 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cfc1ae-8e59-4f1f-8f6e-3283260c3c1a None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:30.051763 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cfc1ae-8e59-4f1f-8f6e-3283260c3c1a None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:30.052034 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cfc1ae-8e59-4f1f-8f6e-3283260c3c1a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:30.053503 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cfc1ae-8e59-4f1f-8f6e-3283260c3c1a None admin] RBAC: Adding query filter params (role.id=362321830b5e4df5a2864d0852f5b7c4, user.id=b4dbd24882b04d0a835bfcdf7ddd0703, scope.system=all) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:30.053503 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cfc1ae-8e59-4f1f-8f6e-3283260c3c1a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:30.054794 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cfc1ae-8e59-4f1f-8f6e-3283260c3c1a None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:30.068783 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 185/371] 10.222.0.27 () {56 vars in 1308 bytes} [Wed Aug 10 09:50:29 2022] GET /identity/v3/role_assignments?user.id=b4dbd24882b04d0a835bfcdf7ddd0703&scope.system=all&role.id=362321830b5e4df5a2864d0852f5b7c4 => generated 510 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:30.073092 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cfc1ae-8e59-4f1f-8f6e-3283260c3c1a None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:30.097122 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:30.128934 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548a626a-0526-4fc3-9093-087713efa574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:30.129603 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548a626a-0526-4fc3-9093-087713efa574 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:30.129886 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548a626a-0526-4fc3-9093-087713efa574 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:30.130251 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548a626a-0526-4fc3-9093-087713efa574 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:30.130947 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548a626a-0526-4fc3-9093-087713efa574 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:30.131241 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548a626a-0526-4fc3-9093-087713efa574 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:30.132804 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548a626a-0526-4fc3-9093-087713efa574 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:30.151712 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 187/372] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 10 09:50:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:30.152489 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548a626a-0526-4fc3-9093-087713efa574 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:30.186227 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cfc1ae-8e59-4f1f-8f6e-3283260c3c1a None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:30.225495 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:30.229945 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa817bd-d4e5-432a-a8dc-0973478b5728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:30.230855 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa817bd-d4e5-432a-a8dc-0973478b5728 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:30.231276 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa817bd-d4e5-432a-a8dc-0973478b5728 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:30.231712 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa817bd-d4e5-432a-a8dc-0973478b5728 None admin] PATH_INFO: `/v3/projects/7eb704c35a604e009f0597bf2e2a2684` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:30.235654 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa817bd-d4e5-432a-a8dc-0973478b5728 None admin] RBAC: Authorizing `identity:get_project(project_id=7eb704c35a604e009f0597bf2e2a2684)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:30.237440 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa817bd-d4e5-432a-a8dc-0973478b5728 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:30.239721 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 186/373] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 10 09:50:30 2022] GET /identity/v3/projects/7eb704c35a604e009f0597bf2e2a2684 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:30.240838 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa817bd-d4e5-432a-a8dc-0973478b5728 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:30.313403 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548a626a-0526-4fc3-9093-087713efa574 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:30.357694 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faa0359-7fcd-46da-992f-9e69243d49fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:30.358313 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faa0359-7fcd-46da-992f-9e69243d49fc None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:30.358591 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faa0359-7fcd-46da-992f-9e69243d49fc None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:30.358860 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faa0359-7fcd-46da-992f-9e69243d49fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:30.359794 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faa0359-7fcd-46da-992f-9e69243d49fc None admin] RBAC: Adding query filter params (group.id=29d6a6b745ce49bcbbfe47ffaa25dade, role.id=8daabcb6b7394e39b06a3453e33e32db, scope.project.id=7eb704c35a604e009f0597bf2e2a2684) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:30.359901 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faa0359-7fcd-46da-992f-9e69243d49fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:30.361938 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:30.362054 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faa0359-7fcd-46da-992f-9e69243d49fc None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:30.368638 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 188/374] 10.222.0.27 () {56 vars in 1376 bytes} [Wed Aug 10 09:50:30 2022] GET /identity/v3/role_assignments?group.id=29d6a6b745ce49bcbbfe47ffaa25dade&scope.project.id=7eb704c35a604e009f0597bf2e2a2684&role.id=8daabcb6b7394e39b06a3453e33e32db => generated 260 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:30.371248 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114fea90-a118-4e6a-8b73-577ba0ba4ee8 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:30.371543 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114fea90-a118-4e6a-8b73-577ba0ba4ee8 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:30.371814 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114fea90-a118-4e6a-8b73-577ba0ba4ee8 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:30.373503 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 189/375] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:50:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:50:30.374394 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114fea90-a118-4e6a-8b73-577ba0ba4ee8 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:30.377881 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa817bd-d4e5-432a-a8dc-0973478b5728 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:30.425275 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40da0ea0-ee81-4e95-914f-fb37f12274eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:30.425902 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40da0ea0-ee81-4e95-914f-fb37f12274eb None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:30.426176 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40da0ea0-ee81-4e95-914f-fb37f12274eb None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:30.426445 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40da0ea0-ee81-4e95-914f-fb37f12274eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:30.496391 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:30.503207 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40da0ea0-ee81-4e95-914f-fb37f12274eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:30.504765 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40da0ea0-ee81-4e95-914f-fb37f12274eb None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:30.511360 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114fea90-a118-4e6a-8b73-577ba0ba4ee8 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:30.551973 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212105b1-3439-47c8-b049-080b997151c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:30.553488 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212105b1-3439-47c8-b049-080b997151c8 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:30.553969 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212105b1-3439-47c8-b049-080b997151c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:30.554572 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212105b1-3439-47c8-b049-080b997151c8 None admin] PATH_INFO: `/v3/groups/29d6a6b745ce49bcbbfe47ffaa25dade` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:30.556202 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212105b1-3439-47c8-b049-080b997151c8 None admin] RBAC: Authorizing `identity:get_group(group_id=29d6a6b745ce49bcbbfe47ffaa25dade)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:30.557947 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212105b1-3439-47c8-b049-080b997151c8 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:30.560400 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 190/376] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Aug 10 09:50:30 2022] GET /identity/v3/groups/29d6a6b745ce49bcbbfe47ffaa25dade => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:30.561936 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2518a993-78f7-47a7-aea0-7fec4bbbacee None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:30.562426 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2518a993-78f7-47a7-aea0-7fec4bbbacee None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:30.562907 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2518a993-78f7-47a7-aea0-7fec4bbbacee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:30.584850 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-2518a993-78f7-47a7-aea0-7fec4bbbacee None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:50:30.586602 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-2518a993-78f7-47a7-aea0-7fec4bbbacee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:50:30.606668 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:30.617492 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 187/377] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 10 09:50:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 09:50:30.618433 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40da0ea0-ee81-4e95-914f-fb37f12274eb None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:30.672915 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 191/378] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:50:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 09:50:30.674263 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2518a993-78f7-47a7-aea0-7fec4bbbacee None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:30.752668 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40da0ea0-ee81-4e95-914f-fb37f12274eb None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:30.799574 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:30.805920 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15700368-7d8c-4e5f-ba7c-a514faee9d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:30.806884 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15700368-7d8c-4e5f-ba7c-a514faee9d52 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:30.807379 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15700368-7d8c-4e5f-ba7c-a514faee9d52 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:30.807747 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2518a993-78f7-47a7-aea0-7fec4bbbacee None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:30.808060 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15700368-7d8c-4e5f-ba7c-a514faee9d52 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:30.808987 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15700368-7d8c-4e5f-ba7c-a514faee9d52 None admin] RBAC: Adding query filter params (group.id=29d6a6b745ce49bcbbfe47ffaa25dade, role.id=5d80017a50774daba0c1fee326754295, scope.project.id=7eb704c35a604e009f0597bf2e2a2684) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:30.809503 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15700368-7d8c-4e5f-ba7c-a514faee9d52 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:30.811675 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15700368-7d8c-4e5f-ba7c-a514faee9d52 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:30.818466 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 188/379] 10.222.0.27 () {56 vars in 1376 bytes} [Wed Aug 10 09:50:30 2022] GET /identity/v3/role_assignments?group.id=29d6a6b745ce49bcbbfe47ffaa25dade&scope.project.id=7eb704c35a604e009f0597bf2e2a2684&role.id=5d80017a50774daba0c1fee326754295 => generated 260 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:30.820103 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15700368-7d8c-4e5f-ba7c-a514faee9d52 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:30.847756 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fab176f-ed5a-4dac-957f-ccf494feab73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:30.848405 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fab176f-ed5a-4dac-957f-ccf494feab73 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:30.848686 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fab176f-ed5a-4dac-957f-ccf494feab73 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:30.848967 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fab176f-ed5a-4dac-957f-ccf494feab73 None admin] PATH_INFO: `/v3/projects/e16002ad64714b509607c7c129a68ed7` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:30.851616 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fab176f-ed5a-4dac-957f-ccf494feab73 None admin] RBAC: Authorizing `identity:get_project(project_id=e16002ad64714b509607c7c129a68ed7)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:30.853340 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fab176f-ed5a-4dac-957f-ccf494feab73 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:30.855251 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 192/380] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 10 09:50:30 2022] GET /identity/v3/projects/e16002ad64714b509607c7c129a68ed7 => generated 344 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:30.860847 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fab176f-ed5a-4dac-957f-ccf494feab73 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:30.932431 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:31.018610 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fab176f-ed5a-4dac-957f-ccf494feab73 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:31.021905 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15700368-7d8c-4e5f-ba7c-a514faee9d52 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:31.070181 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838d5fd0-5c42-4a4f-888b-955810f73dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:31.070746 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308ed8c2-6d51-484f-afe3-71f9760e9621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:31.070864 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d5fd0-5c42-4a4f-888b-955810f73dc7 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:31.071124 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d5fd0-5c42-4a4f-888b-955810f73dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:31.071394 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d5fd0-5c42-4a4f-888b-955810f73dc7 None admin] PATH_INFO: `/v3/groups/a4015e5b44ad4a45a930c3e8abbad8b3` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:31.072077 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ed8c2-6d51-484f-afe3-71f9760e9621 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:31.072537 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ed8c2-6d51-484f-afe3-71f9760e9621 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:31.072971 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ed8c2-6d51-484f-afe3-71f9760e9621 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:31.082016 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838d5fd0-5c42-4a4f-888b-955810f73dc7 None admin] RBAC: Authorizing `identity:get_group(group_id=a4015e5b44ad4a45a930c3e8abbad8b3)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:31.083633 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838d5fd0-5c42-4a4f-888b-955810f73dc7 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:31.085003 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308ed8c2-6d51-484f-afe3-71f9760e9621 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 09:50:31.085856 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 193/381] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Aug 10 09:50:30 2022] GET /identity/v3/groups/a4015e5b44ad4a45a930c3e8abbad8b3 => generated 229 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:31.087213 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ec07d-6b06-4073-b839-233b8e60ef38 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:31.087563 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ec07d-6b06-4073-b839-233b8e60ef38 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:31.087902 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ec07d-6b06-4073-b839-233b8e60ef38 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:31.089486 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 194/382] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:50:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:50:31.091273 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1ec07d-6b06-4073-b839-233b8e60ef38 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:31.091939 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-308ed8c2-6d51-484f-afe3-71f9760e9621 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 09:50:31.091939 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:50:31.091939 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:50:31.091939 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:50:31.091939 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:50:31.091939 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:50:31.091939 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:50:31.091939 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:50:31.091939 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:50:31.091939 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:50:31.091939 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:50:31.091939 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:50:31.091939 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 09:50:31.091939 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 09:50:31.091939 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 09:50:31.091939 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 09:50:31.092979 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 09:50:31.092979 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 09:50:31.092979 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 09:50:31.092979 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 09:50:31.092979 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:50:31.092979 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:50:31.092979 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:50:31.092979 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:50:31.092979 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:50:31.092979 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:50:31.092979 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:50:31.092979 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:50:31.092979 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:50:31.092979 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:50:31.092979 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:50:31.092979 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:50:31.093910 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:50:31.093910 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:50:31.093910 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:50:31.093910 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:50:31.093910 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 09:50:31.093910 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 09:50:31.093910 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 09:50:31.093910 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 09:50:31.093910 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 09:50:31.093910 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 09:50:31.093910 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 09:50:31.093910 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:50:31.096042 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 189/383] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Aug 10 09:50:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:50:31.097461 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8628a7-8258-4c6b-959e-2054559c936a None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:31.097963 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8628a7-8258-4c6b-959e-2054559c936a None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:31.098452 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8628a7-8258-4c6b-959e-2054559c936a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:31.118044 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-9a8628a7-8258-4c6b-959e-2054559c936a None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:50:31.119530 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-9a8628a7-8258-4c6b-959e-2054559c936a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:50:31.140409 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:31.191827 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 190/384] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:50:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 09:50:31.192984 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8628a7-8258-4c6b-959e-2054559c936a None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:31.212136 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1ec07d-6b06-4073-b839-233b8e60ef38 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:31.240521 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:31.252229 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8085cf-3e51-408d-96f9-abb296734a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:31.253047 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8085cf-3e51-408d-96f9-abb296734a85 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:31.253816 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8085cf-3e51-408d-96f9-abb296734a85 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:31.253816 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8085cf-3e51-408d-96f9-abb296734a85 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:31.254438 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8085cf-3e51-408d-96f9-abb296734a85 None admin] RBAC: Adding query filter params (group.id=a4015e5b44ad4a45a930c3e8abbad8b3, role.id=eb04edc46b3742d7a0f0ead26f68bc22, scope.project.id=e16002ad64714b509607c7c129a68ed7) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:31.254804 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8085cf-3e51-408d-96f9-abb296734a85 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:31.256408 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8085cf-3e51-408d-96f9-abb296734a85 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:31.264890 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 195/385] 10.222.0.27 () {56 vars in 1376 bytes} [Wed Aug 10 09:50:31 2022] GET /identity/v3/role_assignments?group.id=a4015e5b44ad4a45a930c3e8abbad8b3&scope.project.id=e16002ad64714b509607c7c129a68ed7&role.id=eb04edc46b3742d7a0f0ead26f68bc22 => generated 260 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:31.265150 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8085cf-3e51-408d-96f9-abb296734a85 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:31.304651 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8628a7-8258-4c6b-959e-2054559c936a None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:31.344114 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c2df0a-6e41-4008-9373-861b45986ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:31.345174 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c2df0a-6e41-4008-9373-861b45986ed5 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:31.345686 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c2df0a-6e41-4008-9373-861b45986ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:31.346143 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c2df0a-6e41-4008-9373-861b45986ed5 None admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:31.347048 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c2df0a-6e41-4008-9373-861b45986ed5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:31.347543 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c2df0a-6e41-4008-9373-861b45986ed5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:31.349251 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c2df0a-6e41-4008-9373-861b45986ed5 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:31.358768 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 191/386] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 10 09:50:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:31.366383 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c2df0a-6e41-4008-9373-861b45986ed5 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:31.381646 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:31.391516 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8085cf-3e51-408d-96f9-abb296734a85 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:31.463249 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067b8f27-2faa-4158-81bc-a8567305fc04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:31.463913 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067b8f27-2faa-4158-81bc-a8567305fc04 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:31.464192 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067b8f27-2faa-4158-81bc-a8567305fc04 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:31.464464 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067b8f27-2faa-4158-81bc-a8567305fc04 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:31.488695 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067b8f27-2faa-4158-81bc-a8567305fc04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 09:50:31.494248 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-067b8f27-2faa-4158-81bc-a8567305fc04 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 09:50:31.494248 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:50:31.494248 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:50:31.494248 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:50:31.494248 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:50:31.494248 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:50:31.494248 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:50:31.494248 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:50:31.494248 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:50:31.494248 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:50:31.494248 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:50:31.494248 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:50:31.494248 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 09:50:31.494248 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 09:50:31.494248 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 09:50:31.494248 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 09:50:31.495325 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 09:50:31.495325 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 09:50:31.495325 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 09:50:31.495325 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 09:50:31.495325 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:50:31.495325 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:50:31.495325 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:50:31.495325 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:50:31.495325 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:50:31.495325 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:50:31.495325 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:50:31.495325 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:50:31.495325 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:50:31.495325 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:50:31.495325 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:50:31.495325 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:50:31.496610 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:50:31.496610 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:50:31.496610 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:50:31.496610 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:50:31.496610 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 09:50:31.496610 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 09:50:31.496610 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 09:50:31.496610 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 09:50:31.496610 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 09:50:31.496610 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 09:50:31.496610 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 09:50:31.496610 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:50:31.496610 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 196/387] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 10 09:50:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:50:31.502215 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067b8f27-2faa-4158-81bc-a8567305fc04 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:31.539741 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c2df0a-6e41-4008-9373-861b45986ed5 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:31.549616 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:31.599409 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68de06db-3eb1-457d-b50b-23f93ccac9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:31.599972 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68de06db-3eb1-457d-b50b-23f93ccac9b7 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:31.600250 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68de06db-3eb1-457d-b50b-23f93ccac9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:31.600521 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68de06db-3eb1-457d-b50b-23f93ccac9b7 None admin] PATH_INFO: `/v3/groups/29d6a6b745ce49bcbbfe47ffaa25dade` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:31.602234 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68de06db-3eb1-457d-b50b-23f93ccac9b7 None admin] RBAC: Authorizing `identity:get_group(group_id=29d6a6b745ce49bcbbfe47ffaa25dade)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:31.603702 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68de06db-3eb1-457d-b50b-23f93ccac9b7 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:31.605900 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 192/388] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Aug 10 09:50:31 2022] GET /identity/v3/groups/29d6a6b745ce49bcbbfe47ffaa25dade => generated 226 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:31.612009 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68de06db-3eb1-457d-b50b-23f93ccac9b7 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:31.675243 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067b8f27-2faa-4158-81bc-a8567305fc04 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:31.720472 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82067218-e74d-494d-9988-09c91b455d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:31.721452 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82067218-e74d-494d-9988-09c91b455d68 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:31.721875 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82067218-e74d-494d-9988-09c91b455d68 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:31.722872 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82067218-e74d-494d-9988-09c91b455d68 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:31.723856 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82067218-e74d-494d-9988-09c91b455d68 None admin] RBAC: Adding query filter params (name=member) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:31.724309 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82067218-e74d-494d-9988-09c91b455d68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:31.725928 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82067218-e74d-494d-9988-09c91b455d68 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:31.738585 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 197/389] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Aug 10 09:50:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 09:50:31.746378 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82067218-e74d-494d-9988-09c91b455d68 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:31.762264 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:31.794073 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68de06db-3eb1-457d-b50b-23f93ccac9b7 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:31.868781 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74af9e05-35dd-48f3-a6e3-3b5181a7dac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:31.869353 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74af9e05-35dd-48f3-a6e3-3b5181a7dac2 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:31.869634 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74af9e05-35dd-48f3-a6e3-3b5181a7dac2 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:31.869899 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74af9e05-35dd-48f3-a6e3-3b5181a7dac2 None admin] PATH_INFO: `/v3/projects/b812d355220c4d00b5c4835f163074aa` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:31.871036 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74af9e05-35dd-48f3-a6e3-3b5181a7dac2 None admin] RBAC: Authorizing `identity:get_project(project_id=b812d355220c4d00b5c4835f163074aa)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:31.872512 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74af9e05-35dd-48f3-a6e3-3b5181a7dac2 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:31.874180 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 193/390] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 10 09:50:31 2022] GET /identity/v3/projects/b812d355220c4d00b5c4835f163074aa => generated 298 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:31.881661 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74af9e05-35dd-48f3-a6e3-3b5181a7dac2 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:31.917232 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82067218-e74d-494d-9988-09c91b455d68 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:31.939856 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:32.002369 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63e08e7-d89d-4846-96be-9593982ad25a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:32.003018 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63e08e7-d89d-4846-96be-9593982ad25a None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:32.003294 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63e08e7-d89d-4846-96be-9593982ad25a None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:32.003568 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63e08e7-d89d-4846-96be-9593982ad25a None admin] PATH_INFO: `/v3/groups/29d6a6b745ce49bcbbfe47ffaa25dade` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:32.007610 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74af9e05-35dd-48f3-a6e3-3b5181a7dac2 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:32.009741 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63e08e7-d89d-4846-96be-9593982ad25a None admin] RBAC: Authorizing `identity:get_group(group_id=29d6a6b745ce49bcbbfe47ffaa25dade)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:32.011227 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63e08e7-d89d-4846-96be-9593982ad25a None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:32.013241 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 198/391] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Aug 10 09:50:31 2022] GET /identity/v3/groups/29d6a6b745ce49bcbbfe47ffaa25dade => generated 226 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 09:50:32.019460 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63e08e7-d89d-4846-96be-9593982ad25a None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:32.057930 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0d3b75-feec-418a-9b88-f15a47e222c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:32.058620 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0d3b75-feec-418a-9b88-f15a47e222c3 None admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:32.058881 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0d3b75-feec-418a-9b88-f15a47e222c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:32.059155 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0d3b75-feec-418a-9b88-f15a47e222c3 None admin] PATH_INFO: `/v3/projects/b812d355220c4d00b5c4835f163074aa/groups/29d6a6b745ce49bcbbfe47ffaa25dade/roles/5d80017a50774daba0c1fee326754295` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:32.073115 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0d3b75-feec-418a-9b88-f15a47e222c3 None admin] RBAC: Authorizing `identity:create_grant(project_id=b812d355220c4d00b5c4835f163074aa, group_id=29d6a6b745ce49bcbbfe47ffaa25dade, role_id=5d80017a50774daba0c1fee326754295)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:32.073115 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0d3b75-feec-418a-9b88-f15a47e222c3 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:32.099416 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 194/392] 10.222.0.27 () {58 vars in 1442 bytes} [Wed Aug 10 09:50:31 2022] PUT /identity/v3/projects/b812d355220c4d00b5c4835f163074aa/groups/29d6a6b745ce49bcbbfe47ffaa25dade/roles/5d80017a50774daba0c1fee326754295 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 09:50:32.133053 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:32.162191 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63e08e7-d89d-4846-96be-9593982ad25a None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:32.199092 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5be4bb-671d-4ff6-80d8-7ee9ff7f9e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:32.199747 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5be4bb-671d-4ff6-80d8-7ee9ff7f9e91 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:32.200032 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5be4bb-671d-4ff6-80d8-7ee9ff7f9e91 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:32.200304 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5be4bb-671d-4ff6-80d8-7ee9ff7f9e91 None admin] PATH_INFO: `/v3/projects/b812d355220c4d00b5c4835f163074aa` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:32.201470 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5be4bb-671d-4ff6-80d8-7ee9ff7f9e91 None admin] RBAC: Authorizing `identity:get_project(project_id=b812d355220c4d00b5c4835f163074aa)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:32.202924 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5be4bb-671d-4ff6-80d8-7ee9ff7f9e91 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:32.204967 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 199/393] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 10 09:50:32 2022] GET /identity/v3/projects/b812d355220c4d00b5c4835f163074aa => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 09:50:32.210890 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0d3b75-feec-418a-9b88-f15a47e222c3 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:32.356881 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0d3b75-feec-418a-9b88-f15a47e222c3 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:32.358462 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:32.395969 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263be107-b373-44a2-832d-c2de071b6a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:32.396542 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263be107-b373-44a2-832d-c2de071b6a4d None admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:32.396817 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263be107-b373-44a2-832d-c2de071b6a4d None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:32.397101 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263be107-b373-44a2-832d-c2de071b6a4d None admin] PATH_INFO: `/v3/projects/b812d355220c4d00b5c4835f163074aa/groups/29d6a6b745ce49bcbbfe47ffaa25dade/roles/8daabcb6b7394e39b06a3453e33e32db` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:32.400395 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263be107-b373-44a2-832d-c2de071b6a4d None admin] RBAC: Authorizing `identity:create_grant(project_id=b812d355220c4d00b5c4835f163074aa, group_id=29d6a6b745ce49bcbbfe47ffaa25dade, role_id=8daabcb6b7394e39b06a3453e33e32db)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:32.401933 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263be107-b373-44a2-832d-c2de071b6a4d None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:32.421297 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 195/394] 10.222.0.27 () {58 vars in 1442 bytes} [Wed Aug 10 09:50:32 2022] PUT /identity/v3/projects/b812d355220c4d00b5c4835f163074aa/groups/29d6a6b745ce49bcbbfe47ffaa25dade/roles/8daabcb6b7394e39b06a3453e33e32db => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 09:50:33.131405 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48ad36e-431b-475e-af0b-dda6d09f63a5 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:33.132541 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48ad36e-431b-475e-af0b-dda6d09f63a5 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:33.133040 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48ad36e-431b-475e-af0b-dda6d09f63a5 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:33.134881 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 200/395] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:50:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:50:33.151042 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e83ed28-aa73-4887-b8d4-2837c23a874f None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:33.151580 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e83ed28-aa73-4887-b8d4-2837c23a874f None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:33.151580 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e83ed28-aa73-4887-b8d4-2837c23a874f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:33.170369 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8396dd18-6ebd-4fa9-a700-ceae53a8edbb None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:33.171015 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8396dd18-6ebd-4fa9-a700-ceae53a8edbb None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:33.171508 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8396dd18-6ebd-4fa9-a700-ceae53a8edbb None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:33.172686 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-1e83ed28-aa73-4887-b8d4-2837c23a874f None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:50:33.173646 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 201/396] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:50:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:50:33.175774 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-1e83ed28-aa73-4887-b8d4-2837c23a874f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:50:33.182012 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292f5581-4c1d-4f87-b951-81a3ae09f09b None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:33.182412 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292f5581-4c1d-4f87-b951-81a3ae09f09b None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:33.182780 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292f5581-4c1d-4f87-b951-81a3ae09f09b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:33.201891 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-292f5581-4c1d-4f87-b951-81a3ae09f09b None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:50:33.203375 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-292f5581-4c1d-4f87-b951-81a3ae09f09b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:50:33.277717 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 202/397] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:50:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 09:50:33.289276 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 196/398] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:50:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 09:50:33.305043 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292f5581-4c1d-4f87-b951-81a3ae09f09b None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:33.328068 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e83ed28-aa73-4887-b8d4-2837c23a874f None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:33.393490 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:33.439171 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292f5581-4c1d-4f87-b951-81a3ae09f09b None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:33.485322 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9c2efc-87c7-4dbe-ad2d-fe6b19314d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:33.485971 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c2efc-87c7-4dbe-ad2d-fe6b19314d76 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:33.486658 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c2efc-87c7-4dbe-ad2d-fe6b19314d76 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:33.486944 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c2efc-87c7-4dbe-ad2d-fe6b19314d76 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:33.500875 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9c2efc-87c7-4dbe-ad2d-fe6b19314d76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 09:50:33.506354 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-1e9c2efc-87c7-4dbe-ad2d-fe6b19314d76 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 09:50:33.506354 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:50:33.506354 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:50:33.506354 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:50:33.506354 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:50:33.506354 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:50:33.506354 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:50:33.506354 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:50:33.506354 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:50:33.506354 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:50:33.506354 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:50:33.506354 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:50:33.506354 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 09:50:33.506354 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 09:50:33.506354 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 09:50:33.506354 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 09:50:33.507330 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 09:50:33.507330 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 09:50:33.507330 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 09:50:33.507330 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 09:50:33.507330 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:50:33.507330 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:50:33.507330 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:50:33.507330 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:50:33.507330 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:50:33.507330 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:50:33.507330 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:50:33.507330 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:50:33.507330 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:50:33.507330 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:50:33.507330 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:50:33.507330 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:50:33.508145 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:50:33.508145 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:50:33.508145 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:50:33.508145 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:50:33.508145 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 09:50:33.508145 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 09:50:33.508145 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 09:50:33.508145 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 09:50:33.508145 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 09:50:33.508145 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 09:50:33.508145 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 09:50:33.508145 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:50:33.508145 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 203/399] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Aug 10 09:50:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:50:33.515390 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9c2efc-87c7-4dbe-ad2d-fe6b19314d76 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:33.525441 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:33.557242 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e83ed28-aa73-4887-b8d4-2837c23a874f None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:33.606507 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdc2612-3a9d-4744-8bc2-b73836d0a3fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:33.607168 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdc2612-3a9d-4744-8bc2-b73836d0a3fa None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:33.607450 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdc2612-3a9d-4744-8bc2-b73836d0a3fa None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:33.607727 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdc2612-3a9d-4744-8bc2-b73836d0a3fa None admin] PATH_INFO: `/v3/roles/member` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:33.622205 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdc2612-3a9d-4744-8bc2-b73836d0a3fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 09:50:33.627126 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-dcdc2612-3a9d-4744-8bc2-b73836d0a3fa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 09:50:33.627126 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:50:33.627126 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:50:33.627126 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:50:33.627126 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:50:33.627126 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:50:33.627126 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:50:33.627126 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:50:33.627126 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:50:33.627126 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:50:33.627126 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:50:33.627126 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:50:33.627126 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 09:50:33.627126 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 09:50:33.627126 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 09:50:33.627126 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 09:50:33.627979 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 09:50:33.627979 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 09:50:33.627979 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 09:50:33.627979 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 09:50:33.627979 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:50:33.627979 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:50:33.627979 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:50:33.627979 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:50:33.627979 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:50:33.627979 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:50:33.627979 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:50:33.627979 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:50:33.627979 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:50:33.627979 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:50:33.627979 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:50:33.627979 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:50:33.628826 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:50:33.628826 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:50:33.628826 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:50:33.628826 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:50:33.628826 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 09:50:33.628826 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 09:50:33.628826 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 09:50:33.628826 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 09:50:33.628826 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 09:50:33.628826 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 09:50:33.628826 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 09:50:33.628826 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:50:33.628826 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 197/400] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 10 09:50:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 09:50:33.635527 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdc2612-3a9d-4744-8bc2-b73836d0a3fa None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:33.724404 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9c2efc-87c7-4dbe-ad2d-fe6b19314d76 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:33.784288 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdc2612-3a9d-4744-8bc2-b73836d0a3fa None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:33.794186 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5a4744-8530-4c21-a250-7cfd5e2fc10a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:33.794813 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5a4744-8530-4c21-a250-7cfd5e2fc10a None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:33.795192 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5a4744-8530-4c21-a250-7cfd5e2fc10a None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:33.795473 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5a4744-8530-4c21-a250-7cfd5e2fc10a None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:33.796192 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5a4744-8530-4c21-a250-7cfd5e2fc10a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:33.796507 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5a4744-8530-4c21-a250-7cfd5e2fc10a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:33.798056 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5a4744-8530-4c21-a250-7cfd5e2fc10a None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:33.805422 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:33.807625 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 204/401] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 10 09:50:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:33.809794 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3288056a-4cdd-4959-bee6-a1647a3677b5 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:33.810020 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3288056a-4cdd-4959-bee6-a1647a3677b5 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:33.810371 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3288056a-4cdd-4959-bee6-a1647a3677b5 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:33.812408 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 205/402] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:50:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:50:33.818570 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3288056a-4cdd-4959-bee6-a1647a3677b5 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:33.825141 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2148c9f-2b4c-4300-bcdb-ccbf85d2c98a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:33.825766 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2148c9f-2b4c-4300-bcdb-ccbf85d2c98a None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:33.826042 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2148c9f-2b4c-4300-bcdb-ccbf85d2c98a None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:33.826311 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2148c9f-2b4c-4300-bcdb-ccbf85d2c98a None admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:33.826988 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2148c9f-2b4c-4300-bcdb-ccbf85d2c98a None admin] RBAC: Adding query filter params (name=member) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:33.827293 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2148c9f-2b4c-4300-bcdb-ccbf85d2c98a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:33.829134 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2148c9f-2b4c-4300-bcdb-ccbf85d2c98a None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:33.840128 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 198/403] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Aug 10 09:50:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:33.841477 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a4ddfa-e5b3-4cbc-937a-1057079cd1fc None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:33.841761 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a4ddfa-e5b3-4cbc-937a-1057079cd1fc None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:33.842037 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a4ddfa-e5b3-4cbc-937a-1057079cd1fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:33.864157 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-70a4ddfa-e5b3-4cbc-937a-1057079cd1fc None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:50:33.865814 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-70a4ddfa-e5b3-4cbc-937a-1057079cd1fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:50:33.877820 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:33.947889 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 199/404] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:50:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 09:50:33.950309 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3288056a-4cdd-4959-bee6-a1647a3677b5 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:33.950854 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a4ddfa-e5b3-4cbc-937a-1057079cd1fc None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:33.996659 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87795d9-c8f1-4166-8f66-60a9066cf9f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:33.997348 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87795d9-c8f1-4166-8f66-60a9066cf9f7 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:33.997809 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87795d9-c8f1-4166-8f66-60a9066cf9f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:33.998093 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87795d9-c8f1-4166-8f66-60a9066cf9f7 None admin] PATH_INFO: `/v3/groups/29d6a6b745ce49bcbbfe47ffaa25dade` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:33.999275 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87795d9-c8f1-4166-8f66-60a9066cf9f7 None admin] RBAC: Authorizing `identity:get_group(group_id=29d6a6b745ce49bcbbfe47ffaa25dade)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:34.000781 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87795d9-c8f1-4166-8f66-60a9066cf9f7 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:34.002725 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 206/405] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Aug 10 09:50:33 2022] GET /identity/v3/groups/29d6a6b745ce49bcbbfe47ffaa25dade => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:34.003699 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87795d9-c8f1-4166-8f66-60a9066cf9f7 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:34.063229 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a4ddfa-e5b3-4cbc-937a-1057079cd1fc None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:34.084655 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:34.102051 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e460126-1ae2-4863-b2fd-1c005d3b283f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:34.102711 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e460126-1ae2-4863-b2fd-1c005d3b283f None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:34.103024 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e460126-1ae2-4863-b2fd-1c005d3b283f None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:34.103301 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e460126-1ae2-4863-b2fd-1c005d3b283f None admin] PATH_INFO: `/v3/groups/29d6a6b745ce49bcbbfe47ffaa25dade` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:34.104899 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e460126-1ae2-4863-b2fd-1c005d3b283f None admin] RBAC: Authorizing `identity:get_group(group_id=29d6a6b745ce49bcbbfe47ffaa25dade)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:34.106624 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e460126-1ae2-4863-b2fd-1c005d3b283f None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:34.108486 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 200/406] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Aug 10 09:50:33 2022] GET /identity/v3/groups/29d6a6b745ce49bcbbfe47ffaa25dade => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:34.114091 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e460126-1ae2-4863-b2fd-1c005d3b283f None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:34.134161 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:34.135402 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87795d9-c8f1-4166-8f66-60a9066cf9f7 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:34.178519 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ff24c8-5608-4c7b-a972-e79a458b8c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:34.179246 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ff24c8-5608-4c7b-a972-e79a458b8c1f None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:34.179529 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ff24c8-5608-4c7b-a972-e79a458b8c1f None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:34.179950 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ff24c8-5608-4c7b-a972-e79a458b8c1f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:34.192910 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ff24c8-5608-4c7b-a972-e79a458b8c1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 09:50:34.199695 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-41ff24c8-5608-4c7b-a972-e79a458b8c1f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 09:50:34.199695 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:50:34.199695 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:50:34.199695 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:50:34.199695 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:50:34.199695 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:50:34.199695 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:50:34.199695 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:50:34.199695 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:50:34.199695 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:50:34.199695 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:50:34.199695 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:50:34.199695 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 09:50:34.199695 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 09:50:34.199695 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 09:50:34.199695 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 09:50:34.200564 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 09:50:34.200564 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 09:50:34.200564 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 09:50:34.200564 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 09:50:34.200564 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:50:34.200564 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:50:34.200564 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:50:34.200564 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:50:34.200564 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:50:34.200564 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:50:34.200564 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:50:34.200564 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:50:34.200564 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:50:34.200564 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:50:34.200564 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:50:34.200564 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:50:34.201382 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:50:34.201382 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:50:34.201382 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:50:34.201382 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:50:34.201382 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 09:50:34.201382 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 09:50:34.201382 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 09:50:34.201382 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 09:50:34.201382 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 09:50:34.201382 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 09:50:34.201382 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 09:50:34.201382 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:50:34.201382 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 207/407] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Aug 10 09:50:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:50:34.202040 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ff24c8-5608-4c7b-a972-e79a458b8c1f None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:34.238541 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e460126-1ae2-4863-b2fd-1c005d3b283f None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:34.279160 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d075d3-283b-4cac-8821-ae77f9a086f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:34.279809 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d075d3-283b-4cac-8821-ae77f9a086f4 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:34.280086 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d075d3-283b-4cac-8821-ae77f9a086f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:34.280376 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d075d3-283b-4cac-8821-ae77f9a086f4 None admin] PATH_INFO: `/v3/projects/7eb704c35a604e009f0597bf2e2a2684` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:34.281550 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d075d3-283b-4cac-8821-ae77f9a086f4 None admin] RBAC: Authorizing `identity:get_project(project_id=7eb704c35a604e009f0597bf2e2a2684)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:34.283006 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d075d3-283b-4cac-8821-ae77f9a086f4 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:34.284646 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 201/408] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 10 09:50:34 2022] GET /identity/v3/projects/7eb704c35a604e009f0597bf2e2a2684 => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:34.285452 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d075d3-283b-4cac-8821-ae77f9a086f4 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:34.334696 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ff24c8-5608-4c7b-a972-e79a458b8c1f None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:34.385105 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4a121b-ac62-44a6-9a3c-f2847fa4080d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:34.385105 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4a121b-ac62-44a6-9a3c-f2847fa4080d None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:34.385105 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4a121b-ac62-44a6-9a3c-f2847fa4080d None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:34.385105 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4a121b-ac62-44a6-9a3c-f2847fa4080d None admin] PATH_INFO: `/v3/projects/7eb704c35a604e009f0597bf2e2a2684` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:34.387258 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:34.387335 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4a121b-ac62-44a6-9a3c-f2847fa4080d None admin] RBAC: Authorizing `identity:get_project(project_id=7eb704c35a604e009f0597bf2e2a2684)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:34.387335 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4a121b-ac62-44a6-9a3c-f2847fa4080d None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:34.389345 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:34.390343 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 208/409] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 10 09:50:34 2022] GET /identity/v3/projects/7eb704c35a604e009f0597bf2e2a2684 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:34.391331 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4a121b-ac62-44a6-9a3c-f2847fa4080d None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:34.407573 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d075d3-283b-4cac-8821-ae77f9a086f4 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:34.450149 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9857f0bc-9f28-44b0-bdbf-b05e7c3a506a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:34.451147 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9857f0bc-9f28-44b0-bdbf-b05e7c3a506a None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:34.451555 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9857f0bc-9f28-44b0-bdbf-b05e7c3a506a None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:34.451945 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9857f0bc-9f28-44b0-bdbf-b05e7c3a506a None admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:34.452759 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9857f0bc-9f28-44b0-bdbf-b05e7c3a506a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:34.453209 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9857f0bc-9f28-44b0-bdbf-b05e7c3a506a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:34.454877 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9857f0bc-9f28-44b0-bdbf-b05e7c3a506a None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:34.464818 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 202/410] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 10 09:50:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:34.465830 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9857f0bc-9f28-44b0-bdbf-b05e7c3a506a None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:34.512603 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4a121b-ac62-44a6-9a3c-f2847fa4080d None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:34.550002 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0d4662-b82b-4995-8a68-397f33cce430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:34.550852 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d4662-b82b-4995-8a68-397f33cce430 None admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:34.551252 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d4662-b82b-4995-8a68-397f33cce430 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:34.551618 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d4662-b82b-4995-8a68-397f33cce430 None admin] PATH_INFO: `/v3/projects/7eb704c35a604e009f0597bf2e2a2684/groups/29d6a6b745ce49bcbbfe47ffaa25dade/roles/5d80017a50774daba0c1fee326754295` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:34.554092 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0d4662-b82b-4995-8a68-397f33cce430 None admin] RBAC: Authorizing `identity:create_grant(project_id=7eb704c35a604e009f0597bf2e2a2684, group_id=29d6a6b745ce49bcbbfe47ffaa25dade, role_id=5d80017a50774daba0c1fee326754295)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:34.555718 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0d4662-b82b-4995-8a68-397f33cce430 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:34.573511 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 209/411] 10.222.0.27 () {58 vars in 1442 bytes} [Wed Aug 10 09:50:34 2022] PUT /identity/v3/projects/7eb704c35a604e009f0597bf2e2a2684/groups/29d6a6b745ce49bcbbfe47ffaa25dade/roles/5d80017a50774daba0c1fee326754295 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 09:50:34.574609 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0d4662-b82b-4995-8a68-397f33cce430 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:34.578860 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9857f0bc-9f28-44b0-bdbf-b05e7c3a506a None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:34.619114 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d441ebf-f1c3-4419-a218-221e2ea1d1d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:34.620293 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d441ebf-f1c3-4419-a218-221e2ea1d1d3 None admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:34.620780 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d441ebf-f1c3-4419-a218-221e2ea1d1d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:34.621287 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d441ebf-f1c3-4419-a218-221e2ea1d1d3 None admin] PATH_INFO: `/v3/projects/7eb704c35a604e009f0597bf2e2a2684/groups/29d6a6b745ce49bcbbfe47ffaa25dade/roles/8daabcb6b7394e39b06a3453e33e32db` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:34.623744 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d441ebf-f1c3-4419-a218-221e2ea1d1d3 None admin] RBAC: Authorizing `identity:create_grant(project_id=7eb704c35a604e009f0597bf2e2a2684, group_id=29d6a6b745ce49bcbbfe47ffaa25dade, role_id=8daabcb6b7394e39b06a3453e33e32db)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:34.625779 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d441ebf-f1c3-4419-a218-221e2ea1d1d3 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:34.636249 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:34.650554 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 203/412] 10.222.0.27 () {58 vars in 1442 bytes} [Wed Aug 10 09:50:34 2022] PUT /identity/v3/projects/7eb704c35a604e009f0597bf2e2a2684/groups/29d6a6b745ce49bcbbfe47ffaa25dade/roles/8daabcb6b7394e39b06a3453e33e32db => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 09:50:34.756447 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0d4662-b82b-4995-8a68-397f33cce430 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:34.807576 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5953cfe6-1869-45e0-91a8-b5ffd8dcfe90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:34.808243 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5953cfe6-1869-45e0-91a8-b5ffd8dcfe90 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:34.808524 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5953cfe6-1869-45e0-91a8-b5ffd8dcfe90 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:34.808801 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5953cfe6-1869-45e0-91a8-b5ffd8dcfe90 None admin] PATH_INFO: `/v3/groups/a4015e5b44ad4a45a930c3e8abbad8b3` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:34.813976 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5953cfe6-1869-45e0-91a8-b5ffd8dcfe90 None admin] RBAC: Authorizing `identity:get_group(group_id=a4015e5b44ad4a45a930c3e8abbad8b3)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:34.815491 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5953cfe6-1869-45e0-91a8-b5ffd8dcfe90 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:34.817304 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 210/413] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Aug 10 09:50:34 2022] GET /identity/v3/groups/a4015e5b44ad4a45a930c3e8abbad8b3 => generated 229 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:34.823488 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d441ebf-f1c3-4419-a218-221e2ea1d1d3 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:34.826506 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:34.935758 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d441ebf-f1c3-4419-a218-221e2ea1d1d3 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:34.970089 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45165184-77a6-4e83-a913-c5a85c11e757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:34.970730 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45165184-77a6-4e83-a913-c5a85c11e757 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:34.971001 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45165184-77a6-4e83-a913-c5a85c11e757 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:34.971270 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45165184-77a6-4e83-a913-c5a85c11e757 None admin] PATH_INFO: `/v3/projects/e16002ad64714b509607c7c129a68ed7` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:34.972394 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45165184-77a6-4e83-a913-c5a85c11e757 None admin] RBAC: Authorizing `identity:get_project(project_id=e16002ad64714b509607c7c129a68ed7)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:34.973891 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45165184-77a6-4e83-a913-c5a85c11e757 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:34.975847 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 204/414] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 10 09:50:34 2022] GET /identity/v3/projects/e16002ad64714b509607c7c129a68ed7 => generated 344 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:34.981503 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5953cfe6-1869-45e0-91a8-b5ffd8dcfe90 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:35.043016 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22adeade-0428-4f2e-a63a-215ce570cb8d None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:35.043324 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22adeade-0428-4f2e-a63a-215ce570cb8d None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:35.043533 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22adeade-0428-4f2e-a63a-215ce570cb8d None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:35.045019 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 205/415] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:50:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 09:50:35.051771 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c796c6a-0d26-4cd3-b1ff-dbc9e0e209d5 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:35.052325 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c796c6a-0d26-4cd3-b1ff-dbc9e0e209d5 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:35.053206 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c796c6a-0d26-4cd3-b1ff-dbc9e0e209d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:35.074363 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-1c796c6a-0d26-4cd3-b1ff-dbc9e0e209d5 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:50:35.075935 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-1c796c6a-0d26-4cd3-b1ff-dbc9e0e209d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:50:35.154310 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5953cfe6-1869-45e0-91a8-b5ffd8dcfe90 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:35.165478 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:35.177090 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 206/416] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:50:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 09:50:35.177090 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b206be-16af-483e-a607-08344f90a379 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:35.177090 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b206be-16af-483e-a607-08344f90a379 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:35.177090 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b206be-16af-483e-a607-08344f90a379 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:35.180583 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 207/417] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:50:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:50:35.182269 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3b8a1b-99e5-489a-a8ac-403ef3f6a595 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:35.182548 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3b8a1b-99e5-489a-a8ac-403ef3f6a595 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:35.182819 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3b8a1b-99e5-489a-a8ac-403ef3f6a595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:35.186214 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:35.206292 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-5e3b8a1b-99e5-489a-a8ac-403ef3f6a595 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:50:35.207727 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-5e3b8a1b-99e5-489a-a8ac-403ef3f6a595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:50:35.214735 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b149177e-47de-4053-9231-f0a2b23c8c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:35.215682 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b149177e-47de-4053-9231-f0a2b23c8c64 None admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:35.216158 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b149177e-47de-4053-9231-f0a2b23c8c64 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:35.216627 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b149177e-47de-4053-9231-f0a2b23c8c64 None admin] PATH_INFO: `/v3/projects/e16002ad64714b509607c7c129a68ed7/groups/a4015e5b44ad4a45a930c3e8abbad8b3/roles/eb04edc46b3742d7a0f0ead26f68bc22` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:35.222385 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b149177e-47de-4053-9231-f0a2b23c8c64 None admin] RBAC: Authorizing `identity:create_grant(project_id=e16002ad64714b509607c7c129a68ed7, group_id=a4015e5b44ad4a45a930c3e8abbad8b3, role_id=eb04edc46b3742d7a0f0ead26f68bc22)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:35.224449 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b149177e-47de-4053-9231-f0a2b23c8c64 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:35.244575 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 211/418] 10.222.0.27 () {58 vars in 1442 bytes} [Wed Aug 10 09:50:34 2022] PUT /identity/v3/projects/e16002ad64714b509607c7c129a68ed7/groups/a4015e5b44ad4a45a930c3e8abbad8b3/roles/eb04edc46b3742d7a0f0ead26f68bc22 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 09:50:35.249283 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b149177e-47de-4053-9231-f0a2b23c8c64 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:35.326596 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 208/419] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:50:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 09:50:35.350663 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3b8a1b-99e5-489a-a8ac-403ef3f6a595 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:35.382176 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b149177e-47de-4053-9231-f0a2b23c8c64 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:35.456871 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74ef817-3ae4-4d9b-9036-331bac0a10f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:35.457613 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74ef817-3ae4-4d9b-9036-331bac0a10f9 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:35.457900 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74ef817-3ae4-4d9b-9036-331bac0a10f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:35.458172 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74ef817-3ae4-4d9b-9036-331bac0a10f9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:35.473169 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74ef817-3ae4-4d9b-9036-331bac0a10f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 09:50:35.481511 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-d74ef817-3ae4-4d9b-9036-331bac0a10f9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 09:50:35.481511 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:50:35.481511 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:50:35.481511 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:50:35.481511 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:50:35.481511 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:50:35.481511 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:50:35.481511 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:50:35.481511 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:50:35.481511 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:50:35.481511 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:50:35.481511 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:50:35.481511 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 09:50:35.481511 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 09:50:35.481511 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 09:50:35.481511 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 09:50:35.482426 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 09:50:35.482426 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 09:50:35.482426 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 09:50:35.482426 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 09:50:35.482426 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:50:35.482426 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:50:35.482426 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:50:35.482426 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:50:35.482426 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:50:35.482426 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:50:35.482426 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:50:35.482426 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:50:35.482426 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:50:35.482426 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:50:35.482426 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:50:35.482426 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:50:35.483226 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:50:35.483226 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:50:35.483226 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:50:35.483226 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:50:35.483226 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 09:50:35.483226 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 09:50:35.483226 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 09:50:35.483226 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 09:50:35.483226 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 09:50:35.483226 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 09:50:35.483226 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 09:50:35.483226 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:50:35.483226 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 212/420] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Aug 10 09:50:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:50:35.488570 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74ef817-3ae4-4d9b-9036-331bac0a10f9 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:35.516684 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3b8a1b-99e5-489a-a8ac-403ef3f6a595 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:35.546659 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:35.549634 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:35.556204 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a1b4ab-59a3-409f-bcea-52d615c9404c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:35.556856 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a1b4ab-59a3-409f-bcea-52d615c9404c None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:35.565570 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a1b4ab-59a3-409f-bcea-52d615c9404c None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:35.565943 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a1b4ab-59a3-409f-bcea-52d615c9404c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:35.596246 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a1b4ab-59a3-409f-bcea-52d615c9404c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 09:50:35.600930 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-b0a1b4ab-59a3-409f-bcea-52d615c9404c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 09:50:35.600930 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:50:35.600930 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:50:35.600930 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:50:35.600930 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:50:35.600930 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:50:35.600930 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:50:35.600930 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:50:35.600930 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:50:35.600930 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:50:35.600930 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:50:35.600930 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:50:35.600930 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 09:50:35.600930 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 09:50:35.600930 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 09:50:35.600930 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 09:50:35.601831 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 09:50:35.601831 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 09:50:35.601831 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 09:50:35.601831 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 09:50:35.601831 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:50:35.601831 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:50:35.601831 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:50:35.601831 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:50:35.601831 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:50:35.601831 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:50:35.601831 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:50:35.601831 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:50:35.601831 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:50:35.601831 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:50:35.601831 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:50:35.601831 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:50:35.602596 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:50:35.602596 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:50:35.602596 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:50:35.602596 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:50:35.602596 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 09:50:35.602596 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 09:50:35.602596 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 09:50:35.602596 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 09:50:35.602596 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 09:50:35.602596 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 09:50:35.602596 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 09:50:35.602596 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:50:35.609217 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 209/421] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 10 09:50:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 09:50:35.615366 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a1b4ab-59a3-409f-bcea-52d615c9404c None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:35.618444 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74ef817-3ae4-4d9b-9036-331bac0a10f9 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:35.676715 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9106e070-172d-42e1-adbc-cdf3a3ccfdb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:35.678633 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9106e070-172d-42e1-adbc-cdf3a3ccfdb0 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:35.680159 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9106e070-172d-42e1-adbc-cdf3a3ccfdb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:35.680634 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9106e070-172d-42e1-adbc-cdf3a3ccfdb0 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:35.689117 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9106e070-172d-42e1-adbc-cdf3a3ccfdb0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:35.689117 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9106e070-172d-42e1-adbc-cdf3a3ccfdb0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:35.689117 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9106e070-172d-42e1-adbc-cdf3a3ccfdb0 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:35.715314 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 213/422] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 10 09:50:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 09:50:35.724009 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9106e070-172d-42e1-adbc-cdf3a3ccfdb0 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:35.748789 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a1b4ab-59a3-409f-bcea-52d615c9404c None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:35.808172 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b7039c-b828-408e-adea-fba5583b82c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:35.808783 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b7039c-b828-408e-adea-fba5583b82c6 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:35.809052 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b7039c-b828-408e-adea-fba5583b82c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:35.809348 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b7039c-b828-408e-adea-fba5583b82c6 None admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:35.810014 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b7039c-b828-408e-adea-fba5583b82c6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:35.810312 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b7039c-b828-408e-adea-fba5583b82c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:35.811692 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b7039c-b828-408e-adea-fba5583b82c6 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:35.827481 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 210/423] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Aug 10 09:50:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 09:50:35.833430 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b7039c-b828-408e-adea-fba5583b82c6 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:35.865822 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9106e070-172d-42e1-adbc-cdf3a3ccfdb0 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:35.867552 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:35.921019 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:35.925475 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76874b46-ac91-4fc1-baae-1018b0308a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:35.927203 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76874b46-ac91-4fc1-baae-1018b0308a53 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:35.927479 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76874b46-ac91-4fc1-baae-1018b0308a53 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:35.927745 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76874b46-ac91-4fc1-baae-1018b0308a53 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:36.010276 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b7039c-b828-408e-adea-fba5583b82c6 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:36.050904 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76874b46-ac91-4fc1-baae-1018b0308a53 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:36.052388 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76874b46-ac91-4fc1-baae-1018b0308a53 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:36.082126 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9802f93-edc2-409a-9607-42ce835604e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:36.082754 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9802f93-edc2-409a-9607-42ce835604e0 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:36.083032 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9802f93-edc2-409a-9607-42ce835604e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:36.083305 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9802f93-edc2-409a-9607-42ce835604e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:36.164274 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 214/424] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 10 09:50:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 09:50:36.170019 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76874b46-ac91-4fc1-baae-1018b0308a53 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:36.173367 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:36.263527 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9802f93-edc2-409a-9607-42ce835604e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:36.265006 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9802f93-edc2-409a-9607-42ce835604e0 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:36.323843 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:36.375741 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 211/425] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 10 09:50:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 543 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 10 09:50:36.386346 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9802f93-edc2-409a-9607-42ce835604e0 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:36.410643 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76874b46-ac91-4fc1-baae-1018b0308a53 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:36.481672 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeed4ff-4adb-4445-8b27-baf35be214e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:36.482371 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeed4ff-4adb-4445-8b27-baf35be214e6 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:36.482649 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeed4ff-4adb-4445-8b27-baf35be214e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:36.482922 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeed4ff-4adb-4445-8b27-baf35be214e6 None admin] PATH_INFO: `/v3/projects/b812d355220c4d00b5c4835f163074aa` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:36.484964 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeed4ff-4adb-4445-8b27-baf35be214e6 None admin] RBAC: Authorizing `identity:get_project(project_id=b812d355220c4d00b5c4835f163074aa)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:36.486509 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeed4ff-4adb-4445-8b27-baf35be214e6 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:36.489891 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 215/426] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 10 09:50:36 2022] GET /identity/v3/projects/b812d355220c4d00b5c4835f163074aa => generated 298 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:36.494213 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeed4ff-4adb-4445-8b27-baf35be214e6 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:36.561123 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9802f93-edc2-409a-9607-42ce835604e0 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:36.601361 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f222ccd-35cd-4de9-9218-7fdf571a658d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:36.602481 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f222ccd-35cd-4de9-9218-7fdf571a658d None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:36.602950 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f222ccd-35cd-4de9-9218-7fdf571a658d None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:36.603431 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f222ccd-35cd-4de9-9218-7fdf571a658d None admin] PATH_INFO: `/v3/projects/b812d355220c4d00b5c4835f163074aa` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:36.604766 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f222ccd-35cd-4de9-9218-7fdf571a658d None admin] RBAC: Authorizing `identity:get_project(project_id=b812d355220c4d00b5c4835f163074aa)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:36.606854 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f222ccd-35cd-4de9-9218-7fdf571a658d None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:36.609344 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 212/427] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 10 09:50:36 2022] GET /identity/v3/projects/b812d355220c4d00b5c4835f163074aa => generated 298 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:36.617415 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f222ccd-35cd-4de9-9218-7fdf571a658d None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:36.625434 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:36.659344 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:36.705267 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeed4ff-4adb-4445-8b27-baf35be214e6 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:36.771767 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92758f37-6775-4ed5-af6e-e23aeaed4e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:36.772320 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92758f37-6775-4ed5-af6e-e23aeaed4e3f None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:36.772606 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92758f37-6775-4ed5-af6e-e23aeaed4e3f None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:36.772931 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92758f37-6775-4ed5-af6e-e23aeaed4e3f None admin] PATH_INFO: `/v3/groups/29d6a6b745ce49bcbbfe47ffaa25dade` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:36.775781 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92758f37-6775-4ed5-af6e-e23aeaed4e3f None admin] RBAC: Authorizing `identity:get_group(group_id=29d6a6b745ce49bcbbfe47ffaa25dade)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:36.777276 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92758f37-6775-4ed5-af6e-e23aeaed4e3f None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:36.779043 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 216/428] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Aug 10 09:50:36 2022] GET /identity/v3/groups/29d6a6b745ce49bcbbfe47ffaa25dade => generated 226 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:36.786693 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92758f37-6775-4ed5-af6e-e23aeaed4e3f None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:36.809457 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f222ccd-35cd-4de9-9218-7fdf571a658d None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:36.872314 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952f6b05-b120-4a54-8f9f-98d4e1bc5774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:36.872957 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952f6b05-b120-4a54-8f9f-98d4e1bc5774 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:36.873253 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952f6b05-b120-4a54-8f9f-98d4e1bc5774 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:36.873524 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952f6b05-b120-4a54-8f9f-98d4e1bc5774 None admin] PATH_INFO: `/v3/groups/29d6a6b745ce49bcbbfe47ffaa25dade` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:36.875934 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952f6b05-b120-4a54-8f9f-98d4e1bc5774 None admin] RBAC: Authorizing `identity:get_group(group_id=29d6a6b745ce49bcbbfe47ffaa25dade)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:36.877408 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952f6b05-b120-4a54-8f9f-98d4e1bc5774 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:36.885826 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 213/429] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Aug 10 09:50:36 2022] GET /identity/v3/groups/29d6a6b745ce49bcbbfe47ffaa25dade => generated 226 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:36.887328 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952f6b05-b120-4a54-8f9f-98d4e1bc5774 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:36.969102 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92758f37-6775-4ed5-af6e-e23aeaed4e3f None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:36.992179 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:37.002469 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952f6b05-b120-4a54-8f9f-98d4e1bc5774 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:37.002824 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b25017-2469-49db-84c1-1cc58d6349db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:37.003452 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b25017-2469-49db-84c1-1cc58d6349db None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:37.003770 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b25017-2469-49db-84c1-1cc58d6349db None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:37.004028 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b25017-2469-49db-84c1-1cc58d6349db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:37.005051 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b25017-2469-49db-84c1-1cc58d6349db None admin] RBAC: Adding query filter params (group.id=29d6a6b745ce49bcbbfe47ffaa25dade, role.id=5d80017a50774daba0c1fee326754295, scope.project.id=b812d355220c4d00b5c4835f163074aa) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:37.005506 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b25017-2469-49db-84c1-1cc58d6349db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:37.007050 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b25017-2469-49db-84c1-1cc58d6349db None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:37.013594 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 217/430] 10.222.0.27 () {56 vars in 1376 bytes} [Wed Aug 10 09:50:36 2022] GET /identity/v3/role_assignments?group.id=29d6a6b745ce49bcbbfe47ffaa25dade&scope.project.id=b812d355220c4d00b5c4835f163074aa&role.id=5d80017a50774daba0c1fee326754295 => generated 611 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:37.039332 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689c3c9f-890e-4d04-8569-223111595982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:37.039866 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689c3c9f-890e-4d04-8569-223111595982 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:37.040153 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689c3c9f-890e-4d04-8569-223111595982 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:37.040427 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689c3c9f-890e-4d04-8569-223111595982 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:37.041209 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689c3c9f-890e-4d04-8569-223111595982 None admin] RBAC: Adding query filter params (group.id=29d6a6b745ce49bcbbfe47ffaa25dade, role.id=8daabcb6b7394e39b06a3453e33e32db, scope.project.id=b812d355220c4d00b5c4835f163074aa) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:37.041521 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689c3c9f-890e-4d04-8569-223111595982 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:37.043027 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689c3c9f-890e-4d04-8569-223111595982 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:37.057231 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 214/431] 10.222.0.27 () {56 vars in 1376 bytes} [Wed Aug 10 09:50:36 2022] GET /identity/v3/role_assignments?group.id=29d6a6b745ce49bcbbfe47ffaa25dade&scope.project.id=b812d355220c4d00b5c4835f163074aa&role.id=8daabcb6b7394e39b06a3453e33e32db => generated 611 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:37.095210 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee27ef4-73c1-4426-bba7-5b2b8d8c8612 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:37.095558 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee27ef4-73c1-4426-bba7-5b2b8d8c8612 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:37.095862 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee27ef4-73c1-4426-bba7-5b2b8d8c8612 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:37.097529 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 218/432] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:50:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:50:37.103356 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2078fa-f0ba-47da-8a99-2af3d484c6f0 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:37.103668 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2078fa-f0ba-47da-8a99-2af3d484c6f0 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:37.103908 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2078fa-f0ba-47da-8a99-2af3d484c6f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:37.115034 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c6f197-35c5-46ea-8cc1-a7ced4651fd6 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:37.115350 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c6f197-35c5-46ea-8cc1-a7ced4651fd6 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:37.115592 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c6f197-35c5-46ea-8cc1-a7ced4651fd6 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:37.117452 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 219/433] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:50:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:50:37.123281 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7140f935-107d-434a-83d8-32f7dc5548ea None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:37.123567 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7140f935-107d-434a-83d8-32f7dc5548ea None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:37.123837 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7140f935-107d-434a-83d8-32f7dc5548ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:37.128151 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-0d2078fa-f0ba-47da-8a99-2af3d484c6f0 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:50:37.129504 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-0d2078fa-f0ba-47da-8a99-2af3d484c6f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:50:37.130373 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:37.145338 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-7140f935-107d-434a-83d8-32f7dc5548ea None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:50:37.146651 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-7140f935-107d-434a-83d8-32f7dc5548ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:50:37.258698 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 215/434] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:50:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 09:50:37.275897 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 220/435] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:50:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 09:50:37.284477 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2078fa-f0ba-47da-8a99-2af3d484c6f0 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:37.303522 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7140f935-107d-434a-83d8-32f7dc5548ea None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:37.376536 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:37.400573 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2078fa-f0ba-47da-8a99-2af3d484c6f0 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:37.419516 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7140f935-107d-434a-83d8-32f7dc5548ea None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:37.446500 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7ab24e-5fce-414c-a989-d59c7d2d1590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:37.447244 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ab24e-5fce-414c-a989-d59c7d2d1590 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:37.447617 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ab24e-5fce-414c-a989-d59c7d2d1590 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:37.447947 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ab24e-5fce-414c-a989-d59c7d2d1590 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:37.459607 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:37.466129 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7ab24e-5fce-414c-a989-d59c7d2d1590 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 09:50:37.466480 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebf189a-47d8-4a23-abc5-3d0d9bed30b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:37.467323 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebf189a-47d8-4a23-abc5-3d0d9bed30b1 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:37.467814 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebf189a-47d8-4a23-abc5-3d0d9bed30b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:37.468252 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebf189a-47d8-4a23-abc5-3d0d9bed30b1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:37.471537 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-2d7ab24e-5fce-414c-a989-d59c7d2d1590 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 09:50:37.471537 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:50:37.471537 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:50:37.471537 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:50:37.471537 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:50:37.471537 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:50:37.471537 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:50:37.471537 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:50:37.471537 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:50:37.471537 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:50:37.471537 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:50:37.471537 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:50:37.471537 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 09:50:37.471537 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 09:50:37.471537 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 09:50:37.471537 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 09:50:37.472389 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 09:50:37.472389 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 09:50:37.472389 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 09:50:37.472389 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 09:50:37.472389 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:50:37.472389 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:50:37.472389 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:50:37.472389 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:50:37.472389 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:50:37.472389 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:50:37.472389 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:50:37.472389 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:50:37.472389 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:50:37.472389 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:50:37.472389 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:50:37.472389 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:50:37.473195 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:50:37.473195 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:50:37.473195 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:50:37.473195 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:50:37.473195 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 09:50:37.473195 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 09:50:37.473195 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 09:50:37.473195 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 09:50:37.473195 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 09:50:37.473195 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 09:50:37.473195 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 09:50:37.473195 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:50:37.473195 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 216/436] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Aug 10 09:50:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:50:37.478845 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7ab24e-5fce-414c-a989-d59c7d2d1590 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:37.485403 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebf189a-47d8-4a23-abc5-3d0d9bed30b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 09:50:37.490579 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-7ebf189a-47d8-4a23-abc5-3d0d9bed30b1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 09:50:37.490579 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:50:37.490579 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:50:37.490579 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:50:37.490579 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:50:37.490579 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:50:37.490579 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:50:37.490579 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:50:37.490579 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:50:37.490579 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:50:37.490579 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:50:37.490579 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:50:37.490579 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 09:50:37.490579 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 09:50:37.490579 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 09:50:37.490579 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 09:50:37.491641 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 09:50:37.491641 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 09:50:37.491641 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 09:50:37.491641 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 09:50:37.491641 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:50:37.491641 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:50:37.491641 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:50:37.491641 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:50:37.491641 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:50:37.491641 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:50:37.491641 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:50:37.491641 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:50:37.491641 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:50:37.491641 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:50:37.491641 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:50:37.491641 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:50:37.492418 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:50:37.492418 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:50:37.492418 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:50:37.492418 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:50:37.492418 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 09:50:37.492418 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 09:50:37.492418 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 09:50:37.492418 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 09:50:37.492418 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 09:50:37.492418 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 09:50:37.492418 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 10 09:50:37.492418 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:50:37.493861 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 221/437] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 10 09:50:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 09:50:37.500067 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebf189a-47d8-4a23-abc5-3d0d9bed30b1 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:37.604677 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7ab24e-5fce-414c-a989-d59c7d2d1590 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:37.624108 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebf189a-47d8-4a23-abc5-3d0d9bed30b1 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:37.650354 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25b20c8-101d-46c4-b643-9763110b40ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:37.651420 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25b20c8-101d-46c4-b643-9763110b40ca None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:37.651420 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25b20c8-101d-46c4-b643-9763110b40ca None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:37.651605 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25b20c8-101d-46c4-b643-9763110b40ca None admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:37.652201 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25b20c8-101d-46c4-b643-9763110b40ca None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:37.652506 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25b20c8-101d-46c4-b643-9763110b40ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:37.653939 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25b20c8-101d-46c4-b643-9763110b40ca None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:37.662941 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 217/438] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 10 09:50:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 09:50:37.662941 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd25d946-468a-410d-b62b-744e9c5f4532 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:37.662941 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd25d946-468a-410d-b62b-744e9c5f4532 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:37.662941 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd25d946-468a-410d-b62b-744e9c5f4532 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:37.666273 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 218/439] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:50:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:50:37.668458 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd25d946-468a-410d-b62b-744e9c5f4532 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:37.673730 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a7d6c2-cde6-4d14-bda3-b40afa25ac69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:37.673896 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:37.673976 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a7d6c2-cde6-4d14-bda3-b40afa25ac69 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:37.673976 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a7d6c2-cde6-4d14-bda3-b40afa25ac69 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:37.674126 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a7d6c2-cde6-4d14-bda3-b40afa25ac69 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:37.674750 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a7d6c2-cde6-4d14-bda3-b40afa25ac69 None admin] RBAC: Adding query filter params (name=member) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:37.678090 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a7d6c2-cde6-4d14-bda3-b40afa25ac69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:37.678090 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a7d6c2-cde6-4d14-bda3-b40afa25ac69 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:37.690840 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 222/440] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Aug 10 09:50:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 09:50:37.692339 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965b0a3e-019c-4cb0-b218-5312d1b068b5 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:37.692690 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965b0a3e-019c-4cb0-b218-5312d1b068b5 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:37.693030 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965b0a3e-019c-4cb0-b218-5312d1b068b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:37.712974 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-965b0a3e-019c-4cb0-b218-5312d1b068b5 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:50:37.714221 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-965b0a3e-019c-4cb0-b218-5312d1b068b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:50:37.774606 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:37.791472 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd25d946-468a-410d-b62b-744e9c5f4532 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:37.794199 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 223/441] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:50:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 09:50:37.795042 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965b0a3e-019c-4cb0-b218-5312d1b068b5 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:37.824968 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7a1b66-af65-46b6-83d7-018c71cb1165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:37.825600 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7a1b66-af65-46b6-83d7-018c71cb1165 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:37.825878 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7a1b66-af65-46b6-83d7-018c71cb1165 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:37.826148 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7a1b66-af65-46b6-83d7-018c71cb1165 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:37.891493 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7a1b66-af65-46b6-83d7-018c71cb1165 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:37.892898 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7a1b66-af65-46b6-83d7-018c71cb1165 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:37.895566 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:37.896243 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965b0a3e-019c-4cb0-b218-5312d1b068b5 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:37.931615 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f714589d-4473-47ca-b7dc-5772b2cda998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:37.932224 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f714589d-4473-47ca-b7dc-5772b2cda998 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:37.932507 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f714589d-4473-47ca-b7dc-5772b2cda998 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:37.932783 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f714589d-4473-47ca-b7dc-5772b2cda998 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:37.983847 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:37.990731 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 219/442] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 10 09:50:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 10 09:50:37.991637 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7a1b66-af65-46b6-83d7-018c71cb1165 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:38.003954 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f714589d-4473-47ca-b7dc-5772b2cda998 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:38.005440 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f714589d-4473-47ca-b7dc-5772b2cda998 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:38.087703 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7a1b66-af65-46b6-83d7-018c71cb1165 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:38.089933 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:38.104154 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 224/443] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 10 09:50:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 09:50:38.105087 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f714589d-4473-47ca-b7dc-5772b2cda998 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:38.124901 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be44077-5f98-4545-83ff-afaa48afb7d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:38.125573 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be44077-5f98-4545-83ff-afaa48afb7d1 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:38.125852 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be44077-5f98-4545-83ff-afaa48afb7d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:38.126125 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be44077-5f98-4545-83ff-afaa48afb7d1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:38.135997 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be44077-5f98-4545-83ff-afaa48afb7d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 09:50:38.140687 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-3be44077-5f98-4545-83ff-afaa48afb7d1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 09:50:38.140687 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:50:38.140687 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:50:38.140687 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:50:38.140687 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:50:38.140687 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:50:38.140687 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:50:38.140687 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:50:38.140687 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:50:38.140687 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:50:38.140687 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:50:38.140687 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:50:38.140687 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 09:50:38.140687 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 09:50:38.140687 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 09:50:38.140687 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 09:50:38.141671 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 09:50:38.141671 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 09:50:38.141671 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 09:50:38.141671 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 09:50:38.141671 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:50:38.141671 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:50:38.141671 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:50:38.141671 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:50:38.141671 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:50:38.141671 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:50:38.141671 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:50:38.141671 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:50:38.141671 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:50:38.141671 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:50:38.141671 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:50:38.141671 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:50:38.142457 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:50:38.142457 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:50:38.142457 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:50:38.142457 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:50:38.142457 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 09:50:38.142457 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 09:50:38.142457 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 09:50:38.142457 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 09:50:38.142457 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 09:50:38.142457 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 09:50:38.142457 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 09:50:38.142457 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:50:38.142457 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 220/444] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Aug 10 09:50:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:50:38.143089 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be44077-5f98-4545-83ff-afaa48afb7d1 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:38.187074 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:38.203357 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f714589d-4473-47ca-b7dc-5772b2cda998 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:38.237586 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026114ab-4092-4589-8ec5-f6dea73d6192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:38.238189 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026114ab-4092-4589-8ec5-f6dea73d6192 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:38.238489 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026114ab-4092-4589-8ec5-f6dea73d6192 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:38.238757 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026114ab-4092-4589-8ec5-f6dea73d6192 None admin] PATH_INFO: `/v3/projects/7eb704c35a604e009f0597bf2e2a2684` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:38.239890 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026114ab-4092-4589-8ec5-f6dea73d6192 None admin] RBAC: Authorizing `identity:get_project(project_id=7eb704c35a604e009f0597bf2e2a2684)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:38.240881 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be44077-5f98-4545-83ff-afaa48afb7d1 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:38.241355 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026114ab-4092-4589-8ec5-f6dea73d6192 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:38.243324 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 225/445] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 10 09:50:38 2022] GET /identity/v3/projects/7eb704c35a604e009f0597bf2e2a2684 => generated 302 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:38.243881 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026114ab-4092-4589-8ec5-f6dea73d6192 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:38.277378 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3de472-e54a-4150-8f20-f44ce0732d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:38.278007 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3de472-e54a-4150-8f20-f44ce0732d00 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:38.278281 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3de472-e54a-4150-8f20-f44ce0732d00 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:38.278550 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3de472-e54a-4150-8f20-f44ce0732d00 None admin] PATH_INFO: `/v3/projects/7eb704c35a604e009f0597bf2e2a2684` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:38.279671 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3de472-e54a-4150-8f20-f44ce0732d00 None admin] RBAC: Authorizing `identity:get_project(project_id=7eb704c35a604e009f0597bf2e2a2684)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:38.281161 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3de472-e54a-4150-8f20-f44ce0732d00 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:38.282775 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 221/446] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 10 09:50:38 2022] GET /identity/v3/projects/7eb704c35a604e009f0597bf2e2a2684 => generated 302 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:38.285894 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3de472-e54a-4150-8f20-f44ce0732d00 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:38.317551 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:38.341275 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026114ab-4092-4589-8ec5-f6dea73d6192 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:38.376040 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f956b4-76a4-4a68-babf-33cbf556411f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:38.376646 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f956b4-76a4-4a68-babf-33cbf556411f None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:38.376923 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f956b4-76a4-4a68-babf-33cbf556411f None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:38.377222 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f956b4-76a4-4a68-babf-33cbf556411f None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:38.377954 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f956b4-76a4-4a68-babf-33cbf556411f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:38.378258 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f956b4-76a4-4a68-babf-33cbf556411f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:38.379661 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f956b4-76a4-4a68-babf-33cbf556411f None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:38.385313 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3de472-e54a-4150-8f20-f44ce0732d00 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:38.387717 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 226/447] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 10 09:50:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:38.388524 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f956b4-76a4-4a68-babf-33cbf556411f None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:38.403962 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:38.419430 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a77691-8301-4c1e-97c3-7073dc17b3ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:38.420067 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a77691-8301-4c1e-97c3-7073dc17b3ef None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:38.420349 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a77691-8301-4c1e-97c3-7073dc17b3ef None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:38.420630 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a77691-8301-4c1e-97c3-7073dc17b3ef None admin] PATH_INFO: `/v3/groups/29d6a6b745ce49bcbbfe47ffaa25dade` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:38.421867 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a77691-8301-4c1e-97c3-7073dc17b3ef None admin] RBAC: Authorizing `identity:get_group(group_id=29d6a6b745ce49bcbbfe47ffaa25dade)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:38.423351 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a77691-8301-4c1e-97c3-7073dc17b3ef None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:38.424951 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 222/448] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Aug 10 09:50:38 2022] GET /identity/v3/groups/29d6a6b745ce49bcbbfe47ffaa25dade => generated 226 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:38.425745 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a77691-8301-4c1e-97c3-7073dc17b3ef None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:38.490621 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f956b4-76a4-4a68-babf-33cbf556411f None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:38.521886 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:38.524158 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c530dc-5792-40a1-a858-51d16f61558b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:38.524677 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a77691-8301-4c1e-97c3-7073dc17b3ef None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:38.524961 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c530dc-5792-40a1-a858-51d16f61558b None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:38.525284 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c530dc-5792-40a1-a858-51d16f61558b None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:38.525563 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c530dc-5792-40a1-a858-51d16f61558b None admin] PATH_INFO: `/v3/groups/29d6a6b745ce49bcbbfe47ffaa25dade` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:38.526696 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c530dc-5792-40a1-a858-51d16f61558b None admin] RBAC: Authorizing `identity:get_group(group_id=29d6a6b745ce49bcbbfe47ffaa25dade)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:38.528162 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c530dc-5792-40a1-a858-51d16f61558b None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:38.529760 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 227/449] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Aug 10 09:50:38 2022] GET /identity/v3/groups/29d6a6b745ce49bcbbfe47ffaa25dade => generated 226 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:38.530510 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c530dc-5792-40a1-a858-51d16f61558b None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:38.558093 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205dff18-cee9-4b3e-b6ab-36abeacb60ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:38.558681 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205dff18-cee9-4b3e-b6ab-36abeacb60ea None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:38.558955 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205dff18-cee9-4b3e-b6ab-36abeacb60ea None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:38.559219 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205dff18-cee9-4b3e-b6ab-36abeacb60ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:38.612542 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:38.626838 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205dff18-cee9-4b3e-b6ab-36abeacb60ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:38.628308 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205dff18-cee9-4b3e-b6ab-36abeacb60ea None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:38.630488 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c530dc-5792-40a1-a858-51d16f61558b None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:38.662772 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8217c5a5-a893-46ef-8337-8e8c66844ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:38.663299 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8217c5a5-a893-46ef-8337-8e8c66844ab5 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:38.663625 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8217c5a5-a893-46ef-8337-8e8c66844ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:38.663899 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8217c5a5-a893-46ef-8337-8e8c66844ab5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:38.664616 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8217c5a5-a893-46ef-8337-8e8c66844ab5 None admin] RBAC: Adding query filter params (group.id=29d6a6b745ce49bcbbfe47ffaa25dade, role.id=5d80017a50774daba0c1fee326754295, scope.project.id=7eb704c35a604e009f0597bf2e2a2684) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:38.664926 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8217c5a5-a893-46ef-8337-8e8c66844ab5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:38.666418 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8217c5a5-a893-46ef-8337-8e8c66844ab5 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:38.672341 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 228/450] 10.222.0.27 () {56 vars in 1376 bytes} [Wed Aug 10 09:50:38 2022] GET /identity/v3/role_assignments?group.id=29d6a6b745ce49bcbbfe47ffaa25dade&scope.project.id=7eb704c35a604e009f0597bf2e2a2684&role.id=5d80017a50774daba0c1fee326754295 => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:38.673365 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8217c5a5-a893-46ef-8337-8e8c66844ab5 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:38.742448 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:38.752229 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 223/451] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 10 09:50:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 09:50:38.753247 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205dff18-cee9-4b3e-b6ab-36abeacb60ea None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:38.795670 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8217c5a5-a893-46ef-8337-8e8c66844ab5 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:38.836635 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b552679-b5c0-4bd6-b5c8-930b1c5583fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:38.837289 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b552679-b5c0-4bd6-b5c8-930b1c5583fd None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:38.837560 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b552679-b5c0-4bd6-b5c8-930b1c5583fd None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:38.838441 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b552679-b5c0-4bd6-b5c8-930b1c5583fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:38.838917 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b552679-b5c0-4bd6-b5c8-930b1c5583fd None admin] RBAC: Adding query filter params (group.id=29d6a6b745ce49bcbbfe47ffaa25dade, role.id=8daabcb6b7394e39b06a3453e33e32db, scope.project.id=7eb704c35a604e009f0597bf2e2a2684) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:38.839226 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b552679-b5c0-4bd6-b5c8-930b1c5583fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:38.840990 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b552679-b5c0-4bd6-b5c8-930b1c5583fd None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:38.846965 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 229/452] 10.222.0.27 () {56 vars in 1376 bytes} [Wed Aug 10 09:50:38 2022] GET /identity/v3/role_assignments?group.id=29d6a6b745ce49bcbbfe47ffaa25dade&scope.project.id=7eb704c35a604e009f0597bf2e2a2684&role.id=8daabcb6b7394e39b06a3453e33e32db => generated 611 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:38.870377 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205dff18-cee9-4b3e-b6ab-36abeacb60ea None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:38.908986 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f1b280-4c4c-42cb-abe4-7a1093ec6570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:38.909658 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f1b280-4c4c-42cb-abe4-7a1093ec6570 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:38.909932 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f1b280-4c4c-42cb-abe4-7a1093ec6570 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:38.910198 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f1b280-4c4c-42cb-abe4-7a1093ec6570 None admin] PATH_INFO: `/v3/projects/e16002ad64714b509607c7c129a68ed7` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:38.911334 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f1b280-4c4c-42cb-abe4-7a1093ec6570 None admin] RBAC: Authorizing `identity:get_project(project_id=e16002ad64714b509607c7c129a68ed7)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:38.912864 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f1b280-4c4c-42cb-abe4-7a1093ec6570 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:38.914612 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 224/453] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 10 09:50:38 2022] GET /identity/v3/projects/e16002ad64714b509607c7c129a68ed7 => generated 344 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:38.920363 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b552679-b5c0-4bd6-b5c8-930b1c5583fd None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:38.934036 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:39.034441 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b552679-b5c0-4bd6-b5c8-930b1c5583fd None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:39.072419 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8a68cc-c0de-4b64-8131-7bd212ffc3bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:39.073089 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8a68cc-c0de-4b64-8131-7bd212ffc3bb None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:39.073404 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8a68cc-c0de-4b64-8131-7bd212ffc3bb None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:39.073694 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8a68cc-c0de-4b64-8131-7bd212ffc3bb None admin] PATH_INFO: `/v3/groups/a4015e5b44ad4a45a930c3e8abbad8b3` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:39.074833 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8a68cc-c0de-4b64-8131-7bd212ffc3bb None admin] RBAC: Authorizing `identity:get_group(group_id=a4015e5b44ad4a45a930c3e8abbad8b3)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:39.076309 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8a68cc-c0de-4b64-8131-7bd212ffc3bb None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:39.078009 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 230/454] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Aug 10 09:50:38 2022] GET /identity/v3/groups/a4015e5b44ad4a45a930c3e8abbad8b3 => generated 229 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:39.083944 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f1b280-4c4c-42cb-abe4-7a1093ec6570 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:39.148834 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:39.183214 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f1b280-4c4c-42cb-abe4-7a1093ec6570 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:39.217168 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83dc816-0a99-4986-b8c8-a42e1357a575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:39.217786 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83dc816-0a99-4986-b8c8-a42e1357a575 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:39.218067 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83dc816-0a99-4986-b8c8-a42e1357a575 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:39.218341 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83dc816-0a99-4986-b8c8-a42e1357a575 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:39.219077 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83dc816-0a99-4986-b8c8-a42e1357a575 None admin] RBAC: Adding query filter params (group.id=a4015e5b44ad4a45a930c3e8abbad8b3, role.id=eb04edc46b3742d7a0f0ead26f68bc22, scope.project.id=e16002ad64714b509607c7c129a68ed7) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:39.219382 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83dc816-0a99-4986-b8c8-a42e1357a575 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:39.220830 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83dc816-0a99-4986-b8c8-a42e1357a575 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:39.226909 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 225/455] 10.222.0.27 () {56 vars in 1376 bytes} [Wed Aug 10 09:50:39 2022] GET /identity/v3/role_assignments?group.id=a4015e5b44ad4a45a930c3e8abbad8b3&scope.project.id=e16002ad64714b509607c7c129a68ed7&role.id=eb04edc46b3742d7a0f0ead26f68bc22 => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:41.661367 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b9d913-c868-4bec-a572-b1d9a1b5c9d6 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:41.661902 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b9d913-c868-4bec-a572-b1d9a1b5c9d6 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:41.661902 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b9d913-c868-4bec-a572-b1d9a1b5c9d6 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:41.663585 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 231/456] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:50:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:50:41.668706 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38355f6a-159e-4b1d-b4b7-80af46934eff None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:41.669193 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38355f6a-159e-4b1d-b4b7-80af46934eff None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:41.669284 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38355f6a-159e-4b1d-b4b7-80af46934eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:41.694597 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-38355f6a-159e-4b1d-b4b7-80af46934eff None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:50:41.695782 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-38355f6a-159e-4b1d-b4b7-80af46934eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:50:41.790975 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 226/457] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:50:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 09:50:41.806175 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624f5356-0afe-4af5-a6d4-d4622b4c88b8 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:41.806580 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624f5356-0afe-4af5-a6d4-d4622b4c88b8 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:41.806850 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624f5356-0afe-4af5-a6d4-d4622b4c88b8 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:41.808377 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 232/458] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:50:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:50:41.820312 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38355f6a-159e-4b1d-b4b7-80af46934eff None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:41.833296 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094758e3-04e2-4a91-8ad6-7bf4e132bb84 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:41.833662 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094758e3-04e2-4a91-8ad6-7bf4e132bb84 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:41.833829 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094758e3-04e2-4a91-8ad6-7bf4e132bb84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:41.858419 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-094758e3-04e2-4a91-8ad6-7bf4e132bb84 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:50:41.859611 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-094758e3-04e2-4a91-8ad6-7bf4e132bb84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:50:41.945228 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:41.987750 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38355f6a-159e-4b1d-b4b7-80af46934eff None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:42.015719 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 233/459] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:50:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 09:50:42.018409 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a321af-444a-46e4-966d-ad032b0927a9 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:42.018895 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a321af-444a-46e4-966d-ad032b0927a9 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:42.019357 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a321af-444a-46e4-966d-ad032b0927a9 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:42.020842 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 234/460] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:50:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 09:50:42.025973 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b96afb-7ded-4226-bca8-872bdbacc158 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:42.026478 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b96afb-7ded-4226-bca8-872bdbacc158 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:42.026937 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b96afb-7ded-4226-bca8-872bdbacc158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:42.035646 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4bb67c-d4fb-471d-8f92-eb7136357b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:42.036307 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4bb67c-d4fb-471d-8f92-eb7136357b09 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:42.036592 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4bb67c-d4fb-471d-8f92-eb7136357b09 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:42.036867 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4bb67c-d4fb-471d-8f92-eb7136357b09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:42.046878 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-98b96afb-7ded-4226-bca8-872bdbacc158 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:50:42.048314 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-98b96afb-7ded-4226-bca8-872bdbacc158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:50:42.050539 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:42.052080 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4bb67c-d4fb-471d-8f92-eb7136357b09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:42.062128 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4bb67c-d4fb-471d-8f92-eb7136357b09 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:42.078197 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-1e4bb67c-d4fb-471d-8f92-eb7136357b09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:50:42.078197 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:50:42.078197 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:50:42.078197 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:50:42.078197 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:50:42.078197 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:50:42.078197 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:50:42.078197 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:50:42.078197 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:50:42.078197 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:50:42.078197 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:50:42.078197 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:50:42.078197 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 09:50:42.078197 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 09:50:42.078197 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 09:50:42.078197 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 09:50:42.079142 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:50:42.079142 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:50:42.079142 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:50:42.079142 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:50:42.079142 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:50:42.079142 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:50:42.079142 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:50:42.079142 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:50:42.079142 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:50:42.079142 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:50:42.079142 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:50:42.079142 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:50:42.079142 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:50:42.079142 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:50:42.079142 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:50:42.079142 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:50:42.079142 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 09:50:42.079961 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 09:50:42.079961 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:50:42.079961 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:50:42.084701 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 227/461] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 10 09:50:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:50:42.084701 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4bb67c-d4fb-471d-8f92-eb7136357b09 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:42.141925 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 235/462] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:50:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 09:50:42.142821 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b96afb-7ded-4226-bca8-872bdbacc158 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:42.204250 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4bb67c-d4fb-471d-8f92-eb7136357b09 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:42.223766 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:42.251365 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc043427-58c7-48be-9bfb-60ddd24f5778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:42.251995 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc043427-58c7-48be-9bfb-60ddd24f5778 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:42.252269 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc043427-58c7-48be-9bfb-60ddd24f5778 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:42.252533 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc043427-58c7-48be-9bfb-60ddd24f5778 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:42.262563 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b96afb-7ded-4226-bca8-872bdbacc158 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:42.267032 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc043427-58c7-48be-9bfb-60ddd24f5778 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:42.268508 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc043427-58c7-48be-9bfb-60ddd24f5778 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:42.289549 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-cc043427-58c7-48be-9bfb-60ddd24f5778 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:50:42.289549 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:50:42.289549 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:50:42.289549 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:50:42.289549 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:50:42.289549 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:50:42.289549 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:50:42.289549 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:50:42.289549 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:50:42.289549 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:50:42.289549 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:50:42.289549 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:50:42.289549 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 09:50:42.289549 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 09:50:42.289549 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 09:50:42.289549 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 09:50:42.290476 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:50:42.290476 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:50:42.290476 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:50:42.290476 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:50:42.290476 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:50:42.290476 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:50:42.290476 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:50:42.290476 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:50:42.290476 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:50:42.290476 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:50:42.290476 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:50:42.290476 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:50:42.290476 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:50:42.290476 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:50:42.290476 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:50:42.290476 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:50:42.290476 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 09:50:42.291309 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 09:50:42.291309 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:50:42.291309 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:50:42.298109 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 228/463] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 10 09:50:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:50:42.299187 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc043427-58c7-48be-9bfb-60ddd24f5778 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:42.304646 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75711763-7d59-4719-a2c2-be6ea8bc6b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:42.305292 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75711763-7d59-4719-a2c2-be6ea8bc6b30 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:42.305632 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75711763-7d59-4719-a2c2-be6ea8bc6b30 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:42.305905 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75711763-7d59-4719-a2c2-be6ea8bc6b30 None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:42.306554 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75711763-7d59-4719-a2c2-be6ea8bc6b30 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:42.306855 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75711763-7d59-4719-a2c2-be6ea8bc6b30 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:42.308229 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75711763-7d59-4719-a2c2-be6ea8bc6b30 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:42.316695 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:42.327363 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 236/464] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 10 09:50:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:42.328030 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75711763-7d59-4719-a2c2-be6ea8bc6b30 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:42.415680 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc043427-58c7-48be-9bfb-60ddd24f5778 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:42.445120 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75711763-7d59-4719-a2c2-be6ea8bc6b30 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:42.453266 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aca23c6-b7b3-47aa-9935-71e4416a73e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:42.453895 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca23c6-b7b3-47aa-9935-71e4416a73e1 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:42.454180 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca23c6-b7b3-47aa-9935-71e4416a73e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:42.454511 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca23c6-b7b3-47aa-9935-71e4416a73e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:42.464885 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aca23c6-b7b3-47aa-9935-71e4416a73e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:42.466379 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aca23c6-b7b3-47aa-9935-71e4416a73e1 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:42.479782 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9e436c-de87-4035-82f9-6aa1068476e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:42.480406 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-2aca23c6-b7b3-47aa-9935-71e4416a73e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:50:42.480406 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:50:42.480406 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:50:42.480406 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:50:42.480406 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:50:42.480406 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:50:42.480406 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:50:42.480406 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:50:42.480406 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:50:42.480406 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:50:42.480406 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:50:42.480406 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:50:42.480406 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 09:50:42.480406 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 09:50:42.480406 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 09:50:42.480406 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 09:50:42.481268 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:50:42.481268 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:50:42.481268 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:50:42.481268 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:50:42.481268 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:50:42.481268 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:50:42.481268 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:50:42.481268 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:50:42.481268 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:50:42.481268 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:50:42.481268 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:50:42.481268 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:50:42.481268 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:50:42.481268 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:50:42.481268 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:50:42.481268 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:50:42.481268 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 09:50:42.482132 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 09:50:42.482132 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:50:42.482132 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:50:42.482132 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 229/465] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 10 09:50:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:50:42.482336 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aca23c6-b7b3-47aa-9935-71e4416a73e1 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:42.483175 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9e436c-de87-4035-82f9-6aa1068476e0 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:42.483595 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9e436c-de87-4035-82f9-6aa1068476e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:42.483998 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9e436c-de87-4035-82f9-6aa1068476e0 None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:42.484776 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9e436c-de87-4035-82f9-6aa1068476e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:42.485253 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9e436c-de87-4035-82f9-6aa1068476e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:42.486779 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9e436c-de87-4035-82f9-6aa1068476e0 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:42.500433 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 237/466] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 10 09:50:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:42.501982 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ead839-7b66-4969-8ded-902f44f26dc9 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:42.502403 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ead839-7b66-4969-8ded-902f44f26dc9 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:42.502846 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ead839-7b66-4969-8ded-902f44f26dc9 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:42.504506 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 238/467] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:50:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:50:42.505407 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ead839-7b66-4969-8ded-902f44f26dc9 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:42.507490 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:42.572992 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:42.592139 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aca23c6-b7b3-47aa-9935-71e4416a73e1 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:42.619716 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ead839-7b66-4969-8ded-902f44f26dc9 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:42.627980 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2587a83-908c-43e8-93ac-cf0fc86be480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:42.628589 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2587a83-908c-43e8-93ac-cf0fc86be480 None admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:42.628868 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2587a83-908c-43e8-93ac-cf0fc86be480 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:42.629176 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2587a83-908c-43e8-93ac-cf0fc86be480 None admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:42.629820 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2587a83-908c-43e8-93ac-cf0fc86be480 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:42.631613 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2587a83-908c-43e8-93ac-cf0fc86be480 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:42.654067 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 230/468] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Aug 10 09:50:42 2022] POST /identity/v3/users => generated 246 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 09:50:42.654875 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2587a83-908c-43e8-93ac-cf0fc86be480 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:42.666629 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1719727b-6e5a-43a0-8184-a25ab9a7267e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:42.667993 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1719727b-6e5a-43a0-8184-a25ab9a7267e None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:42.668502 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1719727b-6e5a-43a0-8184-a25ab9a7267e None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:42.669006 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1719727b-6e5a-43a0-8184-a25ab9a7267e None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:42.669961 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1719727b-6e5a-43a0-8184-a25ab9a7267e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:42.670449 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1719727b-6e5a-43a0-8184-a25ab9a7267e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:42.672071 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1719727b-6e5a-43a0-8184-a25ab9a7267e None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:42.691202 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 239/469] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 10 09:50:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:42.692951 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9341805a-ca6a-4403-a1fd-b7e665744fe2 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:42.693313 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9341805a-ca6a-4403-a1fd-b7e665744fe2 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:42.693590 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9341805a-ca6a-4403-a1fd-b7e665744fe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:42.716960 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-9341805a-ca6a-4403-a1fd-b7e665744fe2 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:50:42.719008 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-9341805a-ca6a-4403-a1fd-b7e665744fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:50:42.759906 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:42.793247 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2587a83-908c-43e8-93ac-cf0fc86be480 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:42.821308 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 240/470] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:50:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 09:50:42.822527 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9341805a-ca6a-4403-a1fd-b7e665744fe2 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:42.843044 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82d9d24-2b62-4c22-9314-7eef77d19252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:42.843954 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82d9d24-2b62-4c22-9314-7eef77d19252 None admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:42.844406 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82d9d24-2b62-4c22-9314-7eef77d19252 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:42.844845 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82d9d24-2b62-4c22-9314-7eef77d19252 None admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:42.845807 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82d9d24-2b62-4c22-9314-7eef77d19252 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:42.847496 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82d9d24-2b62-4c22-9314-7eef77d19252 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:42.874304 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 231/471] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Aug 10 09:50:42 2022] POST /identity/v3/users => generated 248 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 09:50:42.875851 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82d9d24-2b62-4c22-9314-7eef77d19252 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:42.889453 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:42.948185 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9341805a-ca6a-4403-a1fd-b7e665744fe2 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:42.989831 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a7c735-8b39-46fb-8458-9024abc85aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:42.990421 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a7c735-8b39-46fb-8458-9024abc85aa8 None admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:42.990699 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a7c735-8b39-46fb-8458-9024abc85aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:42.990971 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a7c735-8b39-46fb-8458-9024abc85aa8 None admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:42.991694 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a7c735-8b39-46fb-8458-9024abc85aa8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:42.993252 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a7c735-8b39-46fb-8458-9024abc85aa8 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:43.025343 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 241/472] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Aug 10 09:50:42 2022] POST /identity/v3/users => generated 248 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 09:50:43.031767 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82d9d24-2b62-4c22-9314-7eef77d19252 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:43.071353 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:43.082872 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ebc280-9d78-4ea8-b6f8-6d7339b3267e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:43.083743 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ebc280-9d78-4ea8-b6f8-6d7339b3267e None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:43.084025 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ebc280-9d78-4ea8-b6f8-6d7339b3267e None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:43.084303 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ebc280-9d78-4ea8-b6f8-6d7339b3267e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:43.097874 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ebc280-9d78-4ea8-b6f8-6d7339b3267e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:43.099785 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ebc280-9d78-4ea8-b6f8-6d7339b3267e None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:43.110830 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88888205-0625-4e05-a479-f17684cd96da None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:43.111165 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88888205-0625-4e05-a479-f17684cd96da None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:43.111389 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88888205-0625-4e05-a479-f17684cd96da None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:43.112880 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 242/473] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:50:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 09:50:43.118567 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671738e5-fc74-4b56-8731-b21665329321 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:43.118846 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671738e5-fc74-4b56-8731-b21665329321 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:43.119115 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671738e5-fc74-4b56-8731-b21665329321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:43.120091 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-74ebc280-9d78-4ea8-b6f8-6d7339b3267e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:50:43.120091 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:50:43.120091 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:50:43.120091 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:50:43.120091 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:50:43.120091 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:50:43.120091 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:50:43.120091 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:50:43.120091 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:50:43.120091 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:50:43.120091 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:50:43.120091 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:50:43.120091 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 09:50:43.120091 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 09:50:43.120091 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 09:50:43.120091 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 09:50:43.120924 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:50:43.120924 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:50:43.120924 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:50:43.120924 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:50:43.120924 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:50:43.120924 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:50:43.120924 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:50:43.120924 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:50:43.120924 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:50:43.120924 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:50:43.120924 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:50:43.120924 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:50:43.120924 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:50:43.120924 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:50:43.120924 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:50:43.120924 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:50:43.120924 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 09:50:43.121789 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 09:50:43.121789 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:50:43.121789 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:50:43.121789 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 232/474] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 10 09:50:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:50:43.128335 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ebc280-9d78-4ea8-b6f8-6d7339b3267e None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:43.152049 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-671738e5-fc74-4b56-8731-b21665329321 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:50:43.153332 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-671738e5-fc74-4b56-8731-b21665329321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:50:43.252869 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 243/475] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:50:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 09:50:43.262241 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ebc280-9d78-4ea8-b6f8-6d7339b3267e None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:43.276066 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671738e5-fc74-4b56-8731-b21665329321 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:43.302415 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e898d0-84cf-42a5-9900-da69224b9918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:43.303428 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e898d0-84cf-42a5-9900-da69224b9918 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:43.304293 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e898d0-84cf-42a5-9900-da69224b9918 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:43.304821 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e898d0-84cf-42a5-9900-da69224b9918 None admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:43.306020 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e898d0-84cf-42a5-9900-da69224b9918 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:43.306497 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e898d0-84cf-42a5-9900-da69224b9918 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:43.308469 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e898d0-84cf-42a5-9900-da69224b9918 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:43.322971 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:43.326981 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 233/476] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 10 09:50:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:43.333616 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e898d0-84cf-42a5-9900-da69224b9918 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:43.391691 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:43.404145 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671738e5-fc74-4b56-8731-b21665329321 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:43.445390 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860f6622-2053-4a27-a689-0f3dcbe7b6ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:43.447022 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860f6622-2053-4a27-a689-0f3dcbe7b6ea None admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:43.447474 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860f6622-2053-4a27-a689-0f3dcbe7b6ea None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:43.447881 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860f6622-2053-4a27-a689-0f3dcbe7b6ea None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:43.448811 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860f6622-2053-4a27-a689-0f3dcbe7b6ea None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:43.450220 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860f6622-2053-4a27-a689-0f3dcbe7b6ea None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:43.459223 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.sql.core [None req-860f6622-2053-4a27-a689-0f3dcbe7b6ea None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 10 09:50:43.459223 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 10 09:50:43.459223 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [parameters: {'id': 'a60defd624524c3c9580602c8199443f', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 10 09:50:43.459223 dv-cinder-850836-5-smb devstack@keystone.service[80231]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80231) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 10 09:50:43.463035 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e898d0-84cf-42a5-9900-da69224b9918 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:43.480938 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-860f6622-2053-4a27-a689-0f3dcbe7b6ea None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 10 09:50:43.480938 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:50:43.480938 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 10 09:50:43.480938 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 10 09:50:43.480938 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 10 09:50:43.480938 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 10 09:50:43.480938 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 10 09:50:43.480938 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application result = self._query(query) Aug 10 09:50:43.480938 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 10 09:50:43.480938 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application conn.query(q) Aug 10 09:50:43.480938 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 10 09:50:43.480938 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 10 09:50:43.480938 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 10 09:50:43.480938 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application result.read() Aug 10 09:50:43.480938 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 10 09:50:43.481863 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 10 09:50:43.481863 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 10 09:50:43.481863 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 10 09:50:43.481863 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 10 09:50:43.481863 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 10 09:50:43.481863 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 10 09:50:43.481863 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 10 09:50:43.481863 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 10 09:50:43.481863 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:50:43.481863 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 10 09:50:43.481863 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:50:43.481863 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:50:43.481863 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 10 09:50:43.481863 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 10 09:50:43.481863 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 10 09:50:43.481863 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return ref.to_dict() Aug 10 09:50:43.481863 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 10 09:50:43.481863 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application next(self.gen) Aug 10 09:50:43.482853 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 10 09:50:43.482853 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application yield resource Aug 10 09:50:43.482853 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 10 09:50:43.482853 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application next(self.gen) Aug 10 09:50:43.482853 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 10 09:50:43.482853 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self.session.rollback() Aug 10 09:50:43.482853 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 09:50:43.482853 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self.force_reraise() Aug 10 09:50:43.482853 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 09:50:43.482853 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise self.value Aug 10 09:50:43.482853 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 10 09:50:43.482853 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 10 09:50:43.482853 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 10 09:50:43.482853 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application session.commit() Aug 10 09:50:43.482853 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 10 09:50:43.482853 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 10 09:50:43.482853 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 10 09:50:43.483678 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._prepare_impl() Aug 10 09:50:43.483678 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 10 09:50:43.483678 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self.session.flush() Aug 10 09:50:43.483678 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 10 09:50:43.483678 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._flush(objects) Aug 10 09:50:43.483678 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 10 09:50:43.483678 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 10 09:50:43.483678 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 10 09:50:43.483678 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application compat.raise_( Aug 10 09:50:43.483678 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 10 09:50:43.483678 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception Aug 10 09:50:43.483678 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 10 09:50:43.483678 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application flush_context.execute() Aug 10 09:50:43.483678 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 10 09:50:43.483678 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rec.execute(self) Aug 10 09:50:43.483678 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 10 09:50:43.483678 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 10 09:50:43.484549 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 10 09:50:43.484549 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 10 09:50:43.484549 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 10 09:50:43.484549 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 10 09:50:43.484549 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 10 09:50:43.484549 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 10 09:50:43.484549 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 10 09:50:43.484549 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 10 09:50:43.484549 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 10 09:50:43.484549 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 10 09:50:43.484549 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 10 09:50:43.484549 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 10 09:50:43.484549 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 10 09:50:43.484549 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 10 09:50:43.484549 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 10 09:50:43.484549 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception Aug 10 09:50:43.485357 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 10 09:50:43.485357 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 10 09:50:43.485357 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 10 09:50:43.485357 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 10 09:50:43.485357 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 10 09:50:43.485357 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application result = self._query(query) Aug 10 09:50:43.485357 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 10 09:50:43.485357 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application conn.query(q) Aug 10 09:50:43.485357 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 10 09:50:43.485357 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 10 09:50:43.485357 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 10 09:50:43.485357 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application result.read() Aug 10 09:50:43.485357 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 10 09:50:43.485357 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 10 09:50:43.485357 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 10 09:50:43.485357 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 10 09:50:43.486110 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 10 09:50:43.486110 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 10 09:50:43.486110 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 10 09:50:43.486110 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 10 09:50:43.486110 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 10 09:50:43.486110 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 10 09:50:43.486110 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [parameters: {'id': 'a60defd624524c3c9580602c8199443f', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 10 09:50:43.486110 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 10 09:50:43.486110 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:50:43.486110 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 09:50:43.486110 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:50:43.486110 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:50:43.486110 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:50:43.486110 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:50:43.486110 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:50:43.486110 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:50:43.486885 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:50:43.486885 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:50:43.486885 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:50:43.486885 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:50:43.486885 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:50:43.486885 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:50:43.486885 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 10 09:50:43.486885 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 10 09:50:43.486885 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:50:43.486885 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:50:43.486885 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 10 09:50:43.486885 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 10 09:50:43.486885 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 10 09:50:43.486885 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 10 09:50:43.486885 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 10 09:50:43.486885 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:50:43.487706 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 244/477] 10.222.0.27 () {60 vars in 1131 bytes} [Wed Aug 10 09:50:43 2022] POST /identity/v3/roles => generated 144 bytes in 207 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 10 09:50:43.489322 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860f6622-2053-4a27-a689-0f3dcbe7b6ea None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:43.514417 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004e9615-1443-432f-9a0b-7ce8d798034b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:43.515358 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004e9615-1443-432f-9a0b-7ce8d798034b None admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:43.516375 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004e9615-1443-432f-9a0b-7ce8d798034b None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:43.516861 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004e9615-1443-432f-9a0b-7ce8d798034b None admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:43.518003 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004e9615-1443-432f-9a0b-7ce8d798034b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:43.520617 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004e9615-1443-432f-9a0b-7ce8d798034b None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:43.572019 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 234/478] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Aug 10 09:50:43 2022] POST /identity/v3/users => generated 249 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 09:50:43.606587 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860f6622-2053-4a27-a689-0f3dcbe7b6ea None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:43.609442 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:43.644280 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce2700a-7023-4327-b6c4-1850ff7d49fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:43.644980 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce2700a-7023-4327-b6c4-1850ff7d49fa None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:43.645287 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce2700a-7023-4327-b6c4-1850ff7d49fa None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:43.645557 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce2700a-7023-4327-b6c4-1850ff7d49fa None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:43.660748 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce2700a-7023-4327-b6c4-1850ff7d49fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 09:50:43.666546 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-5ce2700a-7023-4327-b6c4-1850ff7d49fa None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 09:50:43.666546 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:50:43.666546 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:50:43.666546 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:50:43.666546 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:50:43.666546 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:50:43.666546 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:50:43.666546 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:50:43.666546 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:50:43.666546 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:50:43.666546 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:50:43.666546 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:50:43.666546 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 09:50:43.666546 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 09:50:43.666546 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 09:50:43.666546 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 09:50:43.667915 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 09:50:43.667915 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 09:50:43.667915 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 09:50:43.667915 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 09:50:43.667915 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:50:43.667915 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:50:43.667915 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:50:43.667915 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:50:43.667915 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:50:43.667915 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:50:43.667915 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:50:43.667915 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:50:43.667915 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:50:43.667915 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:50:43.667915 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:50:43.667915 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:50:43.668779 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:50:43.668779 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:50:43.668779 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:50:43.668779 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:50:43.668779 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 09:50:43.668779 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 09:50:43.668779 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 09:50:43.668779 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 09:50:43.668779 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 09:50:43.668779 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 09:50:43.668779 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 09:50:43.668779 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:50:43.668779 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 245/479] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Aug 10 09:50:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 09:50:43.675287 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004e9615-1443-432f-9a0b-7ce8d798034b None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:43.814152 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:43.820677 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004e9615-1443-432f-9a0b-7ce8d798034b None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:43.858083 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5113f469-2ec9-4f95-adcb-9334531b73e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:43.858693 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5113f469-2ec9-4f95-adcb-9334531b73e5 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:43.858967 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5113f469-2ec9-4f95-adcb-9334531b73e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:43.859233 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5113f469-2ec9-4f95-adcb-9334531b73e5 None admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:43.859910 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5113f469-2ec9-4f95-adcb-9334531b73e5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:43.860211 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5113f469-2ec9-4f95-adcb-9334531b73e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:43.861699 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5113f469-2ec9-4f95-adcb-9334531b73e5 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:43.870871 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 235/480] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 10 09:50:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:45.276151 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da34690-8db4-4a2c-b823-92055a79f32a None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:45.276722 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da34690-8db4-4a2c-b823-92055a79f32a None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:45.276722 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da34690-8db4-4a2c-b823-92055a79f32a None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:45.278534 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 246/481] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:50:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:50:45.284666 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1316d67-049c-44d8-bc3b-310e3ad53755 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:45.285202 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1316d67-049c-44d8-bc3b-310e3ad53755 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:45.285280 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1316d67-049c-44d8-bc3b-310e3ad53755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:45.314146 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-b1316d67-049c-44d8-bc3b-310e3ad53755 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:50:45.315369 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-b1316d67-049c-44d8-bc3b-310e3ad53755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:50:45.386511 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 236/482] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:50:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 09:50:45.408963 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da34690-8db4-4a2c-b823-92055a79f32a None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:45.516917 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7ba827-f319-4259-a248-76c8848ff6ab None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:45.517283 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7ba827-f319-4259-a248-76c8848ff6ab None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:45.517520 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7ba827-f319-4259-a248-76c8848ff6ab None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:45.519151 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 237/483] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:50:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:50:45.529165 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8cdeb8-35e5-440e-82ef-696aae5b164a None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:45.529165 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8cdeb8-35e5-440e-82ef-696aae5b164a None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:45.529165 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8cdeb8-35e5-440e-82ef-696aae5b164a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:45.543061 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-6f8cdeb8-35e5-440e-82ef-696aae5b164a None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:50:45.544614 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-6f8cdeb8-35e5-440e-82ef-696aae5b164a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:50:45.550675 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da34690-8db4-4a2c-b823-92055a79f32a None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:45.607079 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2645c9-d7b4-475f-80c6-2bdc70959194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:45.607976 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2645c9-d7b4-475f-80c6-2bdc70959194 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:45.608396 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2645c9-d7b4-475f-80c6-2bdc70959194 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:45.608801 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2645c9-d7b4-475f-80c6-2bdc70959194 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:45.626970 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2645c9-d7b4-475f-80c6-2bdc70959194 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 09:50:45.632779 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-5c2645c9-d7b4-475f-80c6-2bdc70959194 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 09:50:45.632779 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:50:45.632779 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:50:45.632779 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:50:45.632779 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:50:45.632779 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:50:45.632779 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:50:45.632779 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:50:45.632779 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:50:45.632779 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:50:45.632779 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:50:45.632779 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:50:45.632779 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 09:50:45.632779 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 09:50:45.632779 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 09:50:45.632779 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 09:50:45.633894 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 09:50:45.633894 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 09:50:45.633894 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 09:50:45.633894 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 09:50:45.633894 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:50:45.633894 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:50:45.633894 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:50:45.633894 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:50:45.633894 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:50:45.633894 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:50:45.633894 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:50:45.633894 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:50:45.633894 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:50:45.633894 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:50:45.633894 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:50:45.633894 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:50:45.634876 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:50:45.634876 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:50:45.634876 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:50:45.634876 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:50:45.634876 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 09:50:45.634876 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 09:50:45.634876 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 09:50:45.634876 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 09:50:45.634876 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 09:50:45.634876 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 09:50:45.634876 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 09:50:45.634876 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:50:45.637406 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 247/484] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Aug 10 09:50:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:50:45.638895 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c3e41d-ba02-4545-905b-ae703db5a7d3 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:45.639335 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c3e41d-ba02-4545-905b-ae703db5a7d3 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:45.639743 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c3e41d-ba02-4545-905b-ae703db5a7d3 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:45.641397 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 248/485] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:50:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:50:45.643458 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c3e41d-ba02-4545-905b-ae703db5a7d3 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:45.644859 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 238/486] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:50:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 09:50:45.646500 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac6c9f-a83a-44d0-bbf1-0cd21c95e4f5 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:45.647000 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac6c9f-a83a-44d0-bbf1-0cd21c95e4f5 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:45.647474 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac6c9f-a83a-44d0-bbf1-0cd21c95e4f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:45.667768 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-6cac6c9f-a83a-44d0-bbf1-0cd21c95e4f5 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:50:45.669299 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-6cac6c9f-a83a-44d0-bbf1-0cd21c95e4f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:50:45.690622 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:45.691589 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:45.756364 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 239/487] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:50:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 09:50:45.758153 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cac6c9f-a83a-44d0-bbf1-0cd21c95e4f5 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:45.781273 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c3e41d-ba02-4545-905b-ae703db5a7d3 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:45.816191 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92056ef0-6ff4-4d0d-bce8-b45734b73080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:45.816903 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92056ef0-6ff4-4d0d-bce8-b45734b73080 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:45.817234 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92056ef0-6ff4-4d0d-bce8-b45734b73080 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:45.817541 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92056ef0-6ff4-4d0d-bce8-b45734b73080 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:45.818220 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92056ef0-6ff4-4d0d-bce8-b45734b73080 None admin] RBAC: Adding query filter params (name=service) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:45.818523 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92056ef0-6ff4-4d0d-bce8-b45734b73080 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:45.820601 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92056ef0-6ff4-4d0d-bce8-b45734b73080 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:45.829741 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 249/488] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Aug 10 09:50:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:45.830945 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92056ef0-6ff4-4d0d-bce8-b45734b73080 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:45.882544 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cac6c9f-a83a-44d0-bbf1-0cd21c95e4f5 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:45.921651 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cf0324-b18a-483c-9a0f-5cb51d1e9193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:45.922282 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cf0324-b18a-483c-9a0f-5cb51d1e9193 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:45.922559 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cf0324-b18a-483c-9a0f-5cb51d1e9193 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:45.922827 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cf0324-b18a-483c-9a0f-5cb51d1e9193 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:45.933621 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cf0324-b18a-483c-9a0f-5cb51d1e9193 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 09:50:45.937438 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:45.938340 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-59cf0324-b18a-483c-9a0f-5cb51d1e9193 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 09:50:45.938340 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:50:45.938340 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:50:45.938340 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:50:45.938340 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:50:45.938340 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:50:45.938340 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:50:45.938340 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:50:45.938340 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:50:45.938340 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:50:45.938340 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:50:45.938340 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:50:45.938340 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 09:50:45.938340 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 09:50:45.938340 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 09:50:45.938340 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 09:50:45.939211 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 09:50:45.939211 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 09:50:45.939211 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 09:50:45.939211 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 09:50:45.939211 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:50:45.939211 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:50:45.939211 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:50:45.939211 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:50:45.939211 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:50:45.939211 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:50:45.939211 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:50:45.939211 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:50:45.939211 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:50:45.939211 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:50:45.939211 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:50:45.939211 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:50:45.940000 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:50:45.940000 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:50:45.940000 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:50:45.940000 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:50:45.940000 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 09:50:45.940000 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 09:50:45.940000 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 09:50:45.940000 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 09:50:45.940000 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 09:50:45.940000 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 09:50:45.940000 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 09:50:45.940000 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:50:45.944933 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 240/489] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Aug 10 09:50:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:50:45.945887 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cf0324-b18a-483c-9a0f-5cb51d1e9193 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:45.948671 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92056ef0-6ff4-4d0d-bce8-b45734b73080 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:45.961482 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:45.995448 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890641a5-14a4-40e1-b73a-1c2c60b8b94a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:45.996090 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890641a5-14a4-40e1-b73a-1c2c60b8b94a None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:45.996670 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890641a5-14a4-40e1-b73a-1c2c60b8b94a None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:45.996942 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890641a5-14a4-40e1-b73a-1c2c60b8b94a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:46.010361 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890641a5-14a4-40e1-b73a-1c2c60b8b94a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 09:50:46.016339 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-890641a5-14a4-40e1-b73a-1c2c60b8b94a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 09:50:46.016339 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:50:46.016339 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:50:46.016339 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:50:46.016339 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:50:46.016339 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:50:46.016339 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:50:46.016339 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:50:46.016339 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:50:46.016339 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:50:46.016339 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:50:46.016339 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:50:46.016339 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 09:50:46.016339 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 09:50:46.016339 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 09:50:46.016339 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 09:50:46.018508 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 09:50:46.018508 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 09:50:46.018508 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 09:50:46.018508 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 09:50:46.018508 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:50:46.018508 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:50:46.018508 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:50:46.018508 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:50:46.018508 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:50:46.018508 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:50:46.018508 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:50:46.018508 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:50:46.018508 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:50:46.018508 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:50:46.018508 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:50:46.018508 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:50:46.020509 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:50:46.020509 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:50:46.020509 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:50:46.020509 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:50:46.020509 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 09:50:46.020509 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 09:50:46.020509 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 09:50:46.020509 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 09:50:46.020509 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 09:50:46.020509 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 09:50:46.020509 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 09:50:46.020509 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:50:46.020509 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 250/490] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Aug 10 09:50:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:50:46.020509 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890641a5-14a4-40e1-b73a-1c2c60b8b94a None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:46.065652 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cf0324-b18a-483c-9a0f-5cb51d1e9193 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:46.107405 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a038e003-6330-443c-919b-afae40d88a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:46.108151 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a038e003-6330-443c-919b-afae40d88a8b None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:46.108432 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a038e003-6330-443c-919b-afae40d88a8b None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:46.108703 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a038e003-6330-443c-919b-afae40d88a8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:46.119974 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a038e003-6330-443c-919b-afae40d88a8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:46.121612 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a038e003-6330-443c-919b-afae40d88a8b None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:46.137638 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-a038e003-6330-443c-919b-afae40d88a8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:50:46.137638 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:50:46.137638 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:50:46.137638 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:50:46.137638 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:50:46.137638 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:50:46.137638 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:50:46.137638 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:50:46.137638 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:50:46.137638 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:50:46.137638 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:50:46.137638 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:50:46.137638 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 09:50:46.137638 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 09:50:46.137638 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 09:50:46.137638 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 09:50:46.138749 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:50:46.138749 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:50:46.138749 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:50:46.138749 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:50:46.138749 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:50:46.138749 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:50:46.138749 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:50:46.138749 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:50:46.138749 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:50:46.138749 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:50:46.138749 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:50:46.138749 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:50:46.138749 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:50:46.138749 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:50:46.138749 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:50:46.138749 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:50:46.138749 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 09:50:46.139781 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 09:50:46.139781 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:50:46.139781 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:50:46.143509 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 241/491] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 10 09:50:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:50:46.144453 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a038e003-6330-443c-919b-afae40d88a8b None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:46.151914 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890641a5-14a4-40e1-b73a-1c2c60b8b94a None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:46.195365 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e059af2f-9c33-4e6c-8ea6-4b9bd6fb89f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:46.196394 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e059af2f-9c33-4e6c-8ea6-4b9bd6fb89f9 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:46.196745 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e059af2f-9c33-4e6c-8ea6-4b9bd6fb89f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:46.197103 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e059af2f-9c33-4e6c-8ea6-4b9bd6fb89f9 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:46.198018 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e059af2f-9c33-4e6c-8ea6-4b9bd6fb89f9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:46.198655 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e059af2f-9c33-4e6c-8ea6-4b9bd6fb89f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:46.200172 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e059af2f-9c33-4e6c-8ea6-4b9bd6fb89f9 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:46.209829 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:46.211236 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 251/492] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Aug 10 09:50:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:46.212874 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e059af2f-9c33-4e6c-8ea6-4b9bd6fb89f9 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:46.215722 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:46.254958 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a038e003-6330-443c-919b-afae40d88a8b None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:46.297000 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba292e6-fc92-4f6c-ad90-12e51b83a065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:46.297732 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba292e6-fc92-4f6c-ad90-12e51b83a065 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:46.298047 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba292e6-fc92-4f6c-ad90-12e51b83a065 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:46.298319 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba292e6-fc92-4f6c-ad90-12e51b83a065 None admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:46.299003 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba292e6-fc92-4f6c-ad90-12e51b83a065 None admin] RBAC: Adding query filter params (name=service) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:46.299304 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba292e6-fc92-4f6c-ad90-12e51b83a065 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:46.300697 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba292e6-fc92-4f6c-ad90-12e51b83a065 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:46.313106 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 242/493] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Aug 10 09:50:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:46.313106 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba292e6-fc92-4f6c-ad90-12e51b83a065 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:46.334813 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e059af2f-9c33-4e6c-8ea6-4b9bd6fb89f9 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:46.369892 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f16ced-16f7-4216-9fba-c31647a5f779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:46.370915 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f16ced-16f7-4216-9fba-c31647a5f779 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:46.371201 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f16ced-16f7-4216-9fba-c31647a5f779 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:46.371476 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f16ced-16f7-4216-9fba-c31647a5f779 None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:46.372277 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f16ced-16f7-4216-9fba-c31647a5f779 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:46.372584 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f16ced-16f7-4216-9fba-c31647a5f779 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:46.374026 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f16ced-16f7-4216-9fba-c31647a5f779 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:46.391019 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 252/494] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 10 09:50:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:46.391019 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bf8039-f67b-4305-9f9f-7fbe7459645c None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:46.391019 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bf8039-f67b-4305-9f9f-7fbe7459645c None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:46.391019 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bf8039-f67b-4305-9f9f-7fbe7459645c None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:46.391019 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 253/495] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:50:46 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:50:46.391019 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bf8039-f67b-4305-9f9f-7fbe7459645c None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:46.427619 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba292e6-fc92-4f6c-ad90-12e51b83a065 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:46.451988 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:46.454132 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:46.464908 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab82be1-1fac-4853-9d4f-6053b8300f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:46.465616 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab82be1-1fac-4853-9d4f-6053b8300f27 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:46.465895 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab82be1-1fac-4853-9d4f-6053b8300f27 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:46.466168 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab82be1-1fac-4853-9d4f-6053b8300f27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:46.477614 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab82be1-1fac-4853-9d4f-6053b8300f27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:46.479648 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab82be1-1fac-4853-9d4f-6053b8300f27 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:46.495755 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-8ab82be1-1fac-4853-9d4f-6053b8300f27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:50:46.495755 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:50:46.495755 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:50:46.495755 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:50:46.495755 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:50:46.495755 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:50:46.495755 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:50:46.495755 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:50:46.495755 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:50:46.495755 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:50:46.495755 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:50:46.495755 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:50:46.495755 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 09:50:46.495755 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 09:50:46.495755 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 09:50:46.495755 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 09:50:46.496649 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:50:46.496649 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:50:46.496649 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:50:46.496649 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:50:46.496649 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:50:46.496649 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:50:46.496649 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:50:46.496649 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:50:46.496649 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:50:46.496649 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:50:46.496649 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:50:46.496649 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:50:46.496649 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:50:46.496649 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:50:46.496649 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:50:46.496649 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:50:46.496649 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 09:50:46.502616 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 09:50:46.502616 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:50:46.502616 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:50:46.502616 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 243/496] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 10 09:50:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:50:46.502833 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bf8039-f67b-4305-9f9f-7fbe7459645c None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:46.502913 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab82be1-1fac-4853-9d4f-6053b8300f27 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:46.537896 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a8caae-0b65-4bb9-92bc-58607f664114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:46.538556 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a8caae-0b65-4bb9-92bc-58607f664114 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:46.538832 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a8caae-0b65-4bb9-92bc-58607f664114 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:46.539088 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a8caae-0b65-4bb9-92bc-58607f664114 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:46.550100 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a8caae-0b65-4bb9-92bc-58607f664114 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:46.551688 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a8caae-0b65-4bb9-92bc-58607f664114 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:46.567486 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-33a8caae-0b65-4bb9-92bc-58607f664114 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:50:46.567486 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:50:46.567486 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:50:46.567486 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:50:46.567486 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:50:46.567486 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:50:46.567486 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:50:46.567486 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:50:46.567486 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:50:46.567486 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:50:46.567486 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:50:46.567486 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:50:46.567486 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 09:50:46.567486 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 09:50:46.567486 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 09:50:46.567486 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 09:50:46.568434 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:50:46.568434 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:50:46.568434 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:50:46.568434 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:50:46.568434 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:50:46.568434 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:50:46.568434 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:50:46.568434 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:50:46.568434 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:50:46.568434 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:50:46.568434 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:50:46.568434 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:50:46.568434 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:50:46.568434 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:50:46.568434 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:50:46.568434 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:50:46.568434 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 09:50:46.569947 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 09:50:46.569947 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:50:46.569947 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:50:46.569947 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 254/497] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 10 09:50:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:50:46.570584 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2df1e2-9049-4f7b-8151-42b7ecfd055d None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:46.570709 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2df1e2-9049-4f7b-8151-42b7ecfd055d None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:46.571003 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2df1e2-9049-4f7b-8151-42b7ecfd055d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:46.588679 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-6a2df1e2-9049-4f7b-8151-42b7ecfd055d None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:50:46.589836 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-6a2df1e2-9049-4f7b-8151-42b7ecfd055d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:50:46.601311 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab82be1-1fac-4853-9d4f-6053b8300f27 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:46.634054 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4544fa92-d65f-4043-8098-8742d0799c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:46.634671 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4544fa92-d65f-4043-8098-8742d0799c13 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:46.634949 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4544fa92-d65f-4043-8098-8742d0799c13 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:46.635217 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4544fa92-d65f-4043-8098-8742d0799c13 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:46.643918 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4544fa92-d65f-4043-8098-8742d0799c13 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:46.645427 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4544fa92-d65f-4043-8098-8742d0799c13 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:46.653962 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 255/498] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:50:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 09:50:46.654786 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2df1e2-9049-4f7b-8151-42b7ecfd055d None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:46.657414 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-4544fa92-d65f-4043-8098-8742d0799c13 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 10 09:50:46.657414 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:50:46.657414 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:50:46.657414 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:50:46.657414 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:50:46.657414 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:50:46.657414 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:50:46.657414 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:50:46.657414 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:50:46.657414 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:50:46.657414 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:50:46.657414 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:50:46.657414 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 09:50:46.657414 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 09:50:46.657414 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 09:50:46.657414 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 09:50:46.658249 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:50:46.658249 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:50:46.658249 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 09:50:46.658249 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 09:50:46.658249 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 09:50:46.658249 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 09:50:46.658249 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:50:46.658249 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:50:46.658249 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:50:46.658249 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:50:46.658249 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:50:46.658249 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:50:46.658249 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:50:46.658249 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:50:46.658249 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:50:46.658249 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:50:46.658249 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:50:46.658249 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:50:46.659145 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:50:46.659145 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:50:46.659145 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 09:50:46.659145 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 09:50:46.659145 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 09:50:46.659145 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 09:50:46.659145 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 09:50:46.659145 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 09:50:46.659145 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 10 09:50:46.659145 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:50:46.659145 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 244/499] 10.222.0.27 () {56 vars in 1093 bytes} [Wed Aug 10 09:50:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:50:46.660575 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de27985-52b2-4bfe-9fb9-24d0aaa002cb None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:46.660575 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de27985-52b2-4bfe-9fb9-24d0aaa002cb None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:46.660575 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de27985-52b2-4bfe-9fb9-24d0aaa002cb None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:46.661577 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 245/500] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:50:46 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:50:46.662067 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de27985-52b2-4bfe-9fb9-24d0aaa002cb None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:46.706920 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:46.712499 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:46.766214 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2df1e2-9049-4f7b-8151-42b7ecfd055d None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:46.777283 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de27985-52b2-4bfe-9fb9-24d0aaa002cb None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:46.799666 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4d13c7-6ef0-422a-b29d-093b1731ed18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:46.800277 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4d13c7-6ef0-422a-b29d-093b1731ed18 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:46.800555 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4d13c7-6ef0-422a-b29d-093b1731ed18 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:46.800829 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4d13c7-6ef0-422a-b29d-093b1731ed18 None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:46.801520 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4d13c7-6ef0-422a-b29d-093b1731ed18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:46.801819 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4d13c7-6ef0-422a-b29d-093b1731ed18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:46.803234 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4d13c7-6ef0-422a-b29d-093b1731ed18 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:46.811035 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3134eb2-6cb6-43a1-8588-5b2266148896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:46.811626 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3134eb2-6cb6-43a1-8588-5b2266148896 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:46.811899 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3134eb2-6cb6-43a1-8588-5b2266148896 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:46.812165 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3134eb2-6cb6-43a1-8588-5b2266148896 None admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:46.812823 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3134eb2-6cb6-43a1-8588-5b2266148896 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:46.813142 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3134eb2-6cb6-43a1-8588-5b2266148896 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:46.814403 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 256/501] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 10 09:50:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:46.814537 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3134eb2-6cb6-43a1-8588-5b2266148896 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:46.815534 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140182e7-231d-4160-acee-844277946c0a None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:46.815804 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140182e7-231d-4160-acee-844277946c0a None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:46.816094 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140182e7-231d-4160-acee-844277946c0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:46.826057 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 246/502] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 10 09:50:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:46.826843 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3134eb2-6cb6-43a1-8588-5b2266148896 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:46.835694 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-140182e7-231d-4160-acee-844277946c0a None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:50:46.837148 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-140182e7-231d-4160-acee-844277946c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:50:46.901592 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 257/503] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:50:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 09:50:46.902599 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140182e7-231d-4160-acee-844277946c0a None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:46.930178 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:46.937287 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3134eb2-6cb6-43a1-8588-5b2266148896 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:46.937917 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:46.971018 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bccd2f-003c-4970-aee2-af4dd5bc84d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:46.971622 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bccd2f-003c-4970-aee2-af4dd5bc84d5 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:46.971926 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bccd2f-003c-4970-aee2-af4dd5bc84d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:46.972199 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bccd2f-003c-4970-aee2-af4dd5bc84d5 None admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:46.972932 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bccd2f-003c-4970-aee2-af4dd5bc84d5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:46.973276 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bccd2f-003c-4970-aee2-af4dd5bc84d5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:46.974721 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bccd2f-003c-4970-aee2-af4dd5bc84d5 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:47.007325 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140182e7-231d-4160-acee-844277946c0a None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:47.010378 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 247/504] 10.222.0.27 () {56 vars in 1133 bytes} [Wed Aug 10 09:50:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:47.011192 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bccd2f-003c-4970-aee2-af4dd5bc84d5 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:47.042680 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06af6c2f-e993-463a-b43f-754ff7af9267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:47.043305 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06af6c2f-e993-463a-b43f-754ff7af9267 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:47.043578 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06af6c2f-e993-463a-b43f-754ff7af9267 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:47.043859 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06af6c2f-e993-463a-b43f-754ff7af9267 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:47.054164 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06af6c2f-e993-463a-b43f-754ff7af9267 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 09:50:47.058764 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-06af6c2f-e993-463a-b43f-754ff7af9267 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 09:50:47.058764 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:50:47.058764 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:50:47.058764 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:50:47.058764 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:50:47.058764 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:50:47.058764 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:50:47.058764 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:50:47.058764 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:50:47.058764 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:50:47.058764 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:50:47.058764 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:50:47.058764 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 09:50:47.058764 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 09:50:47.058764 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 09:50:47.058764 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 09:50:47.059639 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 09:50:47.059639 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 09:50:47.059639 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 09:50:47.059639 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 09:50:47.059639 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:50:47.059639 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:50:47.059639 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:50:47.059639 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:50:47.059639 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:50:47.059639 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:50:47.059639 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:50:47.059639 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:50:47.059639 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:50:47.059639 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:50:47.059639 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:50:47.059639 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:50:47.060420 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:50:47.060420 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:50:47.060420 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:50:47.060420 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:50:47.060420 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 09:50:47.060420 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 09:50:47.060420 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 09:50:47.060420 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 09:50:47.060420 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 09:50:47.060420 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 09:50:47.060420 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 09:50:47.060420 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:50:47.060420 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 258/505] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Aug 10 09:50:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:50:47.061197 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06af6c2f-e993-463a-b43f-754ff7af9267 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:47.117088 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bccd2f-003c-4970-aee2-af4dd5bc84d5 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:47.150770 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f154f28d-b4b9-4854-a528-8ae27aa674b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:47.150925 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:47.151784 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f154f28d-b4b9-4854-a528-8ae27aa674b1 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:47.151784 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f154f28d-b4b9-4854-a528-8ae27aa674b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:47.152117 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f154f28d-b4b9-4854-a528-8ae27aa674b1 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:47.157798 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06af6c2f-e993-463a-b43f-754ff7af9267 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:47.159245 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f154f28d-b4b9-4854-a528-8ae27aa674b1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:47.160718 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f154f28d-b4b9-4854-a528-8ae27aa674b1 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:47.172045 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-f154f28d-b4b9-4854-a528-8ae27aa674b1 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 10 09:50:47.172045 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:50:47.172045 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:50:47.172045 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:50:47.172045 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:50:47.172045 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:50:47.172045 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:50:47.172045 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:50:47.172045 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:50:47.172045 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:50:47.172045 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:50:47.172045 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:50:47.172045 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 09:50:47.172045 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 09:50:47.172045 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 09:50:47.172045 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 09:50:47.172927 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:50:47.172927 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:50:47.172927 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 09:50:47.172927 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 09:50:47.172927 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 09:50:47.172927 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 09:50:47.172927 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:50:47.172927 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:50:47.172927 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:50:47.172927 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:50:47.172927 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:50:47.172927 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:50:47.172927 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:50:47.172927 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:50:47.172927 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:50:47.172927 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:50:47.172927 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:50:47.172927 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:50:47.173901 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:50:47.173901 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:50:47.173901 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 09:50:47.173901 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 09:50:47.173901 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 09:50:47.173901 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 09:50:47.173901 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 09:50:47.173901 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 09:50:47.173901 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 10 09:50:47.173901 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:50:47.173901 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 248/506] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 10 09:50:47 2022] GET /identity/v3/users/glance => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:50:47.173901 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f154f28d-b4b9-4854-a528-8ae27aa674b1 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:47.188700 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:47.197296 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eb3786-d335-4c29-b2c4-38b96f7fedda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:47.197938 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eb3786-d335-4c29-b2c4-38b96f7fedda None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:47.198216 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eb3786-d335-4c29-b2c4-38b96f7fedda None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:47.198484 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eb3786-d335-4c29-b2c4-38b96f7fedda None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:47.205991 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4eb3786-d335-4c29-b2c4-38b96f7fedda None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:47.207471 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4eb3786-d335-4c29-b2c4-38b96f7fedda None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:47.220520 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-b4eb3786-d335-4c29-b2c4-38b96f7fedda None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 10 09:50:47.220520 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:50:47.220520 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:50:47.220520 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:50:47.220520 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:50:47.220520 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:50:47.220520 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:50:47.220520 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:50:47.220520 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:50:47.220520 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:50:47.220520 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:50:47.220520 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:50:47.220520 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 09:50:47.220520 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 09:50:47.220520 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 09:50:47.220520 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 09:50:47.221611 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:50:47.221611 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:50:47.221611 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 09:50:47.221611 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 09:50:47.221611 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 09:50:47.221611 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 09:50:47.221611 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:50:47.221611 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:50:47.221611 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:50:47.221611 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:50:47.221611 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:50:47.221611 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:50:47.221611 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:50:47.221611 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:50:47.221611 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:50:47.221611 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:50:47.221611 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:50:47.221611 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:50:47.222504 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:50:47.222504 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:50:47.222504 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 09:50:47.222504 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 09:50:47.222504 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 09:50:47.222504 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 09:50:47.222504 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 09:50:47.222504 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 09:50:47.222504 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 10 09:50:47.222504 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:50:47.222504 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 259/507] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 10 09:50:47 2022] GET /identity/v3/users/cinder => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:50:47.222504 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eb3786-d335-4c29-b2c4-38b96f7fedda None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:47.277518 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f154f28d-b4b9-4854-a528-8ae27aa674b1 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:47.310014 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bd0cd4-19b3-4fdc-85c7-7ff16ab8cbeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:47.310630 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bd0cd4-19b3-4fdc-85c7-7ff16ab8cbeb None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:47.310890 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bd0cd4-19b3-4fdc-85c7-7ff16ab8cbeb None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:47.311160 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bd0cd4-19b3-4fdc-85c7-7ff16ab8cbeb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:47.318483 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eb3786-d335-4c29-b2c4-38b96f7fedda None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:47.322128 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bd0cd4-19b3-4fdc-85c7-7ff16ab8cbeb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:47.323614 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bd0cd4-19b3-4fdc-85c7-7ff16ab8cbeb None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:47.339115 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-97bd0cd4-19b3-4fdc-85c7-7ff16ab8cbeb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:50:47.339115 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:50:47.339115 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:50:47.339115 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:50:47.339115 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:50:47.339115 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:50:47.339115 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:50:47.339115 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:50:47.339115 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:50:47.339115 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:50:47.339115 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:50:47.339115 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:50:47.339115 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 09:50:47.339115 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 09:50:47.339115 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 09:50:47.339115 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 09:50:47.340397 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:50:47.340397 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:50:47.340397 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:50:47.340397 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:50:47.340397 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:50:47.340397 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:50:47.340397 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:50:47.340397 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:50:47.340397 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:50:47.340397 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:50:47.340397 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:50:47.340397 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:50:47.340397 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:50:47.340397 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:50:47.340397 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:50:47.340397 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:50:47.340397 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 09:50:47.341979 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 09:50:47.341979 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:50:47.341979 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:50:47.341979 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 249/508] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 10 09:50:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:50:47.341979 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bd0cd4-19b3-4fdc-85c7-7ff16ab8cbeb None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:47.358618 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c2ce77-4ba8-42c2-a554-f146f5ec2850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:47.359228 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c2ce77-4ba8-42c2-a554-f146f5ec2850 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:47.359504 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c2ce77-4ba8-42c2-a554-f146f5ec2850 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:47.359768 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c2ce77-4ba8-42c2-a554-f146f5ec2850 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:47.383965 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:47.405787 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:47.427822 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c2ce77-4ba8-42c2-a554-f146f5ec2850 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:47.429347 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c2ce77-4ba8-42c2-a554-f146f5ec2850 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:47.439541 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bd0cd4-19b3-4fdc-85c7-7ff16ab8cbeb None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:47.473233 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b903cad-b8ad-4fa2-8bcf-0f3c2f9e3563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:47.473838 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b903cad-b8ad-4fa2-8bcf-0f3c2f9e3563 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:47.474117 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b903cad-b8ad-4fa2-8bcf-0f3c2f9e3563 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:47.474391 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b903cad-b8ad-4fa2-8bcf-0f3c2f9e3563 None admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:47.475073 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b903cad-b8ad-4fa2-8bcf-0f3c2f9e3563 None admin] RBAC: Adding query filter params (name=service) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:47.475393 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b903cad-b8ad-4fa2-8bcf-0f3c2f9e3563 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:47.476890 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b903cad-b8ad-4fa2-8bcf-0f3c2f9e3563 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:47.485204 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 250/509] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Aug 10 09:50:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:47.485984 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b903cad-b8ad-4fa2-8bcf-0f3c2f9e3563 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:47.525136 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 260/510] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 10 09:50:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 09:50:47.526001 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c2ce77-4ba8-42c2-a554-f146f5ec2850 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:47.578647 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:47.589187 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b903cad-b8ad-4fa2-8bcf-0f3c2f9e3563 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:47.613765 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:47.621893 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c2ce77-4ba8-42c2-a554-f146f5ec2850 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:47.622091 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd72f876-eac2-406f-a58c-ab1246e4013a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:47.622605 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd72f876-eac2-406f-a58c-ab1246e4013a None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:47.622879 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd72f876-eac2-406f-a58c-ab1246e4013a None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:47.623152 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd72f876-eac2-406f-a58c-ab1246e4013a None admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:47.623949 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd72f876-eac2-406f-a58c-ab1246e4013a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:47.624266 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd72f876-eac2-406f-a58c-ab1246e4013a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:47.625755 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd72f876-eac2-406f-a58c-ab1246e4013a None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:47.642849 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 251/511] 10.222.0.27 () {56 vars in 1137 bytes} [Wed Aug 10 09:50:47 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:47.643651 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd72f876-eac2-406f-a58c-ab1246e4013a None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:47.657140 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7b9e2c-a5ae-4d86-b615-727a6f65c6cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:47.657696 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7b9e2c-a5ae-4d86-b615-727a6f65c6cc None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:47.657973 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7b9e2c-a5ae-4d86-b615-727a6f65c6cc None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:47.658244 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7b9e2c-a5ae-4d86-b615-727a6f65c6cc None admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:47.658976 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7b9e2c-a5ae-4d86-b615-727a6f65c6cc None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:47.659276 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7b9e2c-a5ae-4d86-b615-727a6f65c6cc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:47.660749 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7b9e2c-a5ae-4d86-b615-727a6f65c6cc None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:47.697585 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 261/512] 10.222.0.27 () {56 vars in 1137 bytes} [Wed Aug 10 09:50:47 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:47.698583 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7b9e2c-a5ae-4d86-b615-727a6f65c6cc None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:47.744867 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd72f876-eac2-406f-a58c-ab1246e4013a None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:47.777347 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1f0052-7d48-4e5e-a3e1-f19ace6315e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:47.777948 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1f0052-7d48-4e5e-a3e1-f19ace6315e8 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:47.778224 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1f0052-7d48-4e5e-a3e1-f19ace6315e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:47.778546 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1f0052-7d48-4e5e-a3e1-f19ace6315e8 None admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:47.779220 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1f0052-7d48-4e5e-a3e1-f19ace6315e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:47.779519 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1f0052-7d48-4e5e-a3e1-f19ace6315e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:47.780941 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1f0052-7d48-4e5e-a3e1-f19ace6315e8 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:47.792074 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 252/513] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 10 09:50:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:47.792988 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1f0052-7d48-4e5e-a3e1-f19ace6315e8 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:47.793268 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7b9e2c-a5ae-4d86-b615-727a6f65c6cc None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:47.808853 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:47.830930 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df992e6-63ef-4f60-82f6-28013e6b15cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:47.831573 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df992e6-63ef-4f60-82f6-28013e6b15cd None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:47.831848 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df992e6-63ef-4f60-82f6-28013e6b15cd None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:47.832119 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df992e6-63ef-4f60-82f6-28013e6b15cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:47.841572 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:47.842228 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df992e6-63ef-4f60-82f6-28013e6b15cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:47.843696 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df992e6-63ef-4f60-82f6-28013e6b15cd None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:47.858560 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-9df992e6-63ef-4f60-82f6-28013e6b15cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:50:47.858560 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:50:47.858560 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:50:47.858560 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:50:47.858560 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:50:47.858560 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:50:47.858560 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:50:47.858560 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:50:47.858560 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:50:47.858560 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:50:47.858560 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:50:47.858560 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:50:47.858560 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 09:50:47.858560 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 09:50:47.858560 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 09:50:47.858560 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 09:50:47.859665 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:50:47.859665 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:50:47.859665 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:50:47.859665 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:50:47.859665 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:50:47.859665 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:50:47.859665 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:50:47.859665 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:50:47.859665 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:50:47.859665 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:50:47.859665 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:50:47.859665 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:50:47.859665 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:50:47.859665 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:50:47.859665 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:50:47.859665 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:50:47.859665 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 09:50:47.860515 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 09:50:47.860515 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:50:47.860515 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:50:47.860515 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 262/514] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 10 09:50:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:50:47.860732 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df992e6-63ef-4f60-82f6-28013e6b15cd None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:47.900378 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1f0052-7d48-4e5e-a3e1-f19ace6315e8 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:47.933970 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250dc638-08cd-4096-b4ef-510adb75e90a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:47.934513 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250dc638-08cd-4096-b4ef-510adb75e90a None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:47.934800 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250dc638-08cd-4096-b4ef-510adb75e90a None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:47.935056 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250dc638-08cd-4096-b4ef-510adb75e90a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:47.945690 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250dc638-08cd-4096-b4ef-510adb75e90a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:47.947163 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250dc638-08cd-4096-b4ef-510adb75e90a None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:47.958891 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df992e6-63ef-4f60-82f6-28013e6b15cd None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:47.960671 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-250dc638-08cd-4096-b4ef-510adb75e90a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:50:47.960671 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:50:47.960671 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:50:47.960671 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:50:47.960671 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:50:47.960671 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:50:47.960671 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:50:47.960671 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:50:47.960671 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:50:47.960671 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:50:47.960671 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:50:47.960671 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:50:47.960671 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 09:50:47.960671 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 09:50:47.960671 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 09:50:47.960671 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 09:50:47.961751 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:50:47.961751 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:50:47.961751 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:50:47.961751 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:50:47.961751 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:50:47.961751 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:50:47.961751 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:50:47.961751 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:50:47.961751 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:50:47.961751 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:50:47.961751 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:50:47.961751 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:50:47.961751 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:50:47.961751 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:50:47.961751 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:50:47.961751 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:50:47.961751 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 09:50:47.962787 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 09:50:47.962787 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:50:47.962787 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:50:47.962787 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 253/515] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 10 09:50:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:50:47.962787 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250dc638-08cd-4096-b4ef-510adb75e90a None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:47.994351 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebba114d-c7c8-4aa9-9005-95b42ec5bb45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:47.994951 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba114d-c7c8-4aa9-9005-95b42ec5bb45 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:47.995231 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba114d-c7c8-4aa9-9005-95b42ec5bb45 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:47.995498 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba114d-c7c8-4aa9-9005-95b42ec5bb45 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:48.025881 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:48.058816 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:48.061680 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebba114d-c7c8-4aa9-9005-95b42ec5bb45 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:48.063106 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250dc638-08cd-4096-b4ef-510adb75e90a None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:48.063227 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebba114d-c7c8-4aa9-9005-95b42ec5bb45 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:48.097145 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c58e22-a829-4ed2-ba8f-af3c64373e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:48.097782 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c58e22-a829-4ed2-ba8f-af3c64373e2f None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:48.098060 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c58e22-a829-4ed2-ba8f-af3c64373e2f None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:48.098332 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c58e22-a829-4ed2-ba8f-af3c64373e2f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:48.159281 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 263/516] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 10 09:50:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 09:50:48.160075 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebba114d-c7c8-4aa9-9005-95b42ec5bb45 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:48.164490 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c58e22-a829-4ed2-ba8f-af3c64373e2f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:48.167413 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c58e22-a829-4ed2-ba8f-af3c64373e2f None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:48.224251 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:48.261895 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebba114d-c7c8-4aa9-9005-95b42ec5bb45 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:48.264059 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:48.269356 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 254/517] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 10 09:50:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 09:50:48.270261 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c58e22-a829-4ed2-ba8f-af3c64373e2f None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:48.296829 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62eb86c-6f95-40bc-aac6-bff77fc60a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:48.297464 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62eb86c-6f95-40bc-aac6-bff77fc60a95 None admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:48.297744 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62eb86c-6f95-40bc-aac6-bff77fc60a95 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:48.298017 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62eb86c-6f95-40bc-aac6-bff77fc60a95 None admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:48.298659 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62eb86c-6f95-40bc-aac6-bff77fc60a95 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:48.300237 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62eb86c-6f95-40bc-aac6-bff77fc60a95 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:48.320921 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 264/518] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Aug 10 09:50:48 2022] POST /identity/v3/users => generated 247 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 09:50:48.321756 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62eb86c-6f95-40bc-aac6-bff77fc60a95 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:48.386704 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c58e22-a829-4ed2-ba8f-af3c64373e2f None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:48.425406 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aade66c-d239-4967-9c01-d2ab3eb1203a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:48.426404 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aade66c-d239-4967-9c01-d2ab3eb1203a None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:48.426887 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aade66c-d239-4967-9c01-d2ab3eb1203a None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:48.427376 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aade66c-d239-4967-9c01-d2ab3eb1203a None admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:48.428223 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aade66c-d239-4967-9c01-d2ab3eb1203a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:48.428596 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aade66c-d239-4967-9c01-d2ab3eb1203a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:48.430159 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aade66c-d239-4967-9c01-d2ab3eb1203a None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:48.441893 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62eb86c-6f95-40bc-aac6-bff77fc60a95 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:48.443023 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 255/519] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 10 09:50:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:48.448915 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aade66c-d239-4967-9c01-d2ab3eb1203a None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:48.466929 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:48.485406 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7831fe0e-f444-4e76-a017-fb97eea18260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:48.486435 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7831fe0e-f444-4e76-a017-fb97eea18260 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:48.486901 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7831fe0e-f444-4e76-a017-fb97eea18260 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:48.488095 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7831fe0e-f444-4e76-a017-fb97eea18260 None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:48.488948 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7831fe0e-f444-4e76-a017-fb97eea18260 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:48.489415 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7831fe0e-f444-4e76-a017-fb97eea18260 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:48.491538 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7831fe0e-f444-4e76-a017-fb97eea18260 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:48.505142 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 265/520] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 10 09:50:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:48.505877 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7831fe0e-f444-4e76-a017-fb97eea18260 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:48.515839 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:48.560112 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aade66c-d239-4967-9c01-d2ab3eb1203a None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:48.595618 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1ef8d0-5e78-4afd-896d-bac63cd7cb7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:48.596242 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1ef8d0-5e78-4afd-896d-bac63cd7cb7f None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:48.596518 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1ef8d0-5e78-4afd-896d-bac63cd7cb7f None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:48.596785 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1ef8d0-5e78-4afd-896d-bac63cd7cb7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:48.607320 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1ef8d0-5e78-4afd-896d-bac63cd7cb7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:48.608815 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1ef8d0-5e78-4afd-896d-bac63cd7cb7f None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:48.618022 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7831fe0e-f444-4e76-a017-fb97eea18260 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:48.623128 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-3d1ef8d0-5e78-4afd-896d-bac63cd7cb7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:50:48.623128 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:50:48.623128 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:50:48.623128 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:50:48.623128 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:50:48.623128 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:50:48.623128 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:50:48.623128 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:50:48.623128 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:50:48.623128 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:50:48.623128 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:50:48.623128 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:50:48.623128 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 09:50:48.623128 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 09:50:48.623128 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 09:50:48.623128 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 09:50:48.624040 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:50:48.624040 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:50:48.624040 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:50:48.624040 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:50:48.624040 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:50:48.624040 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:50:48.624040 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:50:48.624040 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:50:48.624040 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:50:48.624040 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:50:48.624040 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:50:48.624040 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:50:48.624040 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:50:48.624040 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:50:48.624040 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:50:48.624040 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:50:48.624040 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 09:50:48.629651 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 09:50:48.629651 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:50:48.629651 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:50:48.629651 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 256/521] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 10 09:50:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:50:48.629651 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1ef8d0-5e78-4afd-896d-bac63cd7cb7f None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:48.661239 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89786a0b-8934-4e34-96b5-155908ffa088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:48.661969 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89786a0b-8934-4e34-96b5-155908ffa088 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:48.662306 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89786a0b-8934-4e34-96b5-155908ffa088 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:48.662640 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89786a0b-8934-4e34-96b5-155908ffa088 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:48.677882 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89786a0b-8934-4e34-96b5-155908ffa088 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:48.679707 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89786a0b-8934-4e34-96b5-155908ffa088 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:48.694978 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-89786a0b-8934-4e34-96b5-155908ffa088 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:50:48.694978 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:50:48.694978 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:50:48.694978 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:50:48.694978 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:50:48.694978 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:50:48.694978 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:50:48.694978 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:50:48.694978 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:50:48.694978 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:50:48.694978 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:50:48.694978 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:50:48.694978 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 09:50:48.694978 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 09:50:48.694978 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 09:50:48.694978 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 09:50:48.696082 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:50:48.696082 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:50:48.696082 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:50:48.696082 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:50:48.696082 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:50:48.696082 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:50:48.696082 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:50:48.696082 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:50:48.696082 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:50:48.696082 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:50:48.696082 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:50:48.696082 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:50:48.696082 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:50:48.696082 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:50:48.696082 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:50:48.696082 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:50:48.696082 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 09:50:48.696972 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 09:50:48.696972 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:50:48.696972 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:50:48.696972 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 266/522] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 10 09:50:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:50:48.697507 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89786a0b-8934-4e34-96b5-155908ffa088 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:48.735208 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:48.743102 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1ef8d0-5e78-4afd-896d-bac63cd7cb7f None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:48.754015 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:48.778933 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064e629b-ec37-4f5e-93fb-74cd7060e5f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:48.779724 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064e629b-ec37-4f5e-93fb-74cd7060e5f9 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:48.780006 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064e629b-ec37-4f5e-93fb-74cd7060e5f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:48.780276 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064e629b-ec37-4f5e-93fb-74cd7060e5f9 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:48.788929 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064e629b-ec37-4f5e-93fb-74cd7060e5f9 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:48.790418 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064e629b-ec37-4f5e-93fb-74cd7060e5f9 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:48.802574 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-064e629b-ec37-4f5e-93fb-74cd7060e5f9 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 10 09:50:48.802574 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:50:48.802574 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:50:48.802574 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:50:48.802574 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:50:48.802574 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:50:48.802574 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:50:48.802574 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:50:48.802574 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:50:48.802574 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:50:48.802574 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:50:48.802574 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:50:48.802574 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 09:50:48.802574 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 09:50:48.802574 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 09:50:48.802574 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 09:50:48.803490 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:50:48.803490 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:50:48.803490 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 09:50:48.803490 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 09:50:48.803490 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 09:50:48.803490 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 09:50:48.803490 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:50:48.803490 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:50:48.803490 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:50:48.803490 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:50:48.803490 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:50:48.803490 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:50:48.803490 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:50:48.803490 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:50:48.803490 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:50:48.803490 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:50:48.803490 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:50:48.803490 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:50:48.804435 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:50:48.804435 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:50:48.804435 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 09:50:48.804435 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 09:50:48.804435 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 09:50:48.804435 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 09:50:48.804435 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 09:50:48.804435 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 09:50:48.804435 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 10 09:50:48.804435 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:50:48.804435 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 257/523] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Aug 10 09:50:48 2022] GET /identity/v3/users/neutron => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:50:48.808711 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89786a0b-8934-4e34-96b5-155908ffa088 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:48.809127 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064e629b-ec37-4f5e-93fb-74cd7060e5f9 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:48.846438 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7012e978-c4d7-4dff-a83e-3d412f2d8b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:48.847069 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7012e978-c4d7-4dff-a83e-3d412f2d8b5d None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:48.847347 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7012e978-c4d7-4dff-a83e-3d412f2d8b5d None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:48.847615 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7012e978-c4d7-4dff-a83e-3d412f2d8b5d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:48.854636 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7012e978-c4d7-4dff-a83e-3d412f2d8b5d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:48.856106 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7012e978-c4d7-4dff-a83e-3d412f2d8b5d None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:48.867840 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-7012e978-c4d7-4dff-a83e-3d412f2d8b5d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 09:50:48.867840 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:50:48.867840 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:50:48.867840 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:50:48.867840 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:50:48.867840 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:50:48.867840 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:50:48.867840 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:50:48.867840 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:50:48.867840 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:50:48.867840 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:50:48.867840 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:50:48.867840 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 09:50:48.867840 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 09:50:48.867840 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 09:50:48.868840 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 09:50:48.868840 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:50:48.868840 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:50:48.868840 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:50:48.868840 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:50:48.868840 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:50:48.868840 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:50:48.868840 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:50:48.868840 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:50:48.868840 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:50:48.868840 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:50:48.868840 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:50:48.868840 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:50:48.868840 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:50:48.868840 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:50:48.868840 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:50:48.868840 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:50:48.869725 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 09:50:48.869725 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 09:50:48.869725 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 09:50:48.869725 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 09:50:48.869725 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 09:50:48.869725 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 09:50:48.869725 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 09:50:48.869725 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:50:48.869725 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 267/524] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 10 09:50:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:50:48.869725 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7012e978-c4d7-4dff-a83e-3d412f2d8b5d None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:48.920410 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064e629b-ec37-4f5e-93fb-74cd7060e5f9 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:48.959932 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85c03bd-01cf-40c8-a130-090bdc6daa81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:48.960571 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85c03bd-01cf-40c8-a130-090bdc6daa81 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:48.960849 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85c03bd-01cf-40c8-a130-090bdc6daa81 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:48.961147 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85c03bd-01cf-40c8-a130-090bdc6daa81 None admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:48.962222 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85c03bd-01cf-40c8-a130-090bdc6daa81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:48.962532 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85c03bd-01cf-40c8-a130-090bdc6daa81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:48.963919 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85c03bd-01cf-40c8-a130-090bdc6daa81 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:48.965747 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:48.976558 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 258/525] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 10 09:50:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:48.977110 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7012e978-c4d7-4dff-a83e-3d412f2d8b5d None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:48.978226 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85c03bd-01cf-40c8-a130-090bdc6daa81 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:49.011257 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:49.011611 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f89f6ef-2490-46fb-93f8-4347c297e7b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:49.012623 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f89f6ef-2490-46fb-93f8-4347c297e7b7 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:49.013160 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f89f6ef-2490-46fb-93f8-4347c297e7b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:49.013495 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f89f6ef-2490-46fb-93f8-4347c297e7b7 None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:49.014165 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f89f6ef-2490-46fb-93f8-4347c297e7b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:49.014478 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f89f6ef-2490-46fb-93f8-4347c297e7b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:49.016871 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f89f6ef-2490-46fb-93f8-4347c297e7b7 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:49.035380 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 268/526] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 10 09:50:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:49.036910 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f89f6ef-2490-46fb-93f8-4347c297e7b7 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:49.082745 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85c03bd-01cf-40c8-a130-090bdc6daa81 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:49.115389 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d0e2ec-114d-4e19-961d-a0e299cfd13f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:49.115984 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d0e2ec-114d-4e19-961d-a0e299cfd13f None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:49.116264 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d0e2ec-114d-4e19-961d-a0e299cfd13f None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:49.116534 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d0e2ec-114d-4e19-961d-a0e299cfd13f None admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:49.117299 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d0e2ec-114d-4e19-961d-a0e299cfd13f None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:49.117607 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d0e2ec-114d-4e19-961d-a0e299cfd13f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:49.119049 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d0e2ec-114d-4e19-961d-a0e299cfd13f None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:49.135536 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 259/527] 10.222.0.27 () {56 vars in 1139 bytes} [Wed Aug 10 09:50:48 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:49.136309 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d0e2ec-114d-4e19-961d-a0e299cfd13f None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:49.151431 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f89f6ef-2490-46fb-93f8-4347c297e7b7 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:49.186447 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc97fd4d-0345-4aed-ae90-4eef947e32b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:49.187449 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc97fd4d-0345-4aed-ae90-4eef947e32b1 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:49.187819 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc97fd4d-0345-4aed-ae90-4eef947e32b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:49.188176 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc97fd4d-0345-4aed-ae90-4eef947e32b1 None admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:49.188971 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc97fd4d-0345-4aed-ae90-4eef947e32b1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:49.189400 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc97fd4d-0345-4aed-ae90-4eef947e32b1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:49.191200 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc97fd4d-0345-4aed-ae90-4eef947e32b1 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:49.214666 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 269/528] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Aug 10 09:50:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:49.214666 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc97fd4d-0345-4aed-ae90-4eef947e32b1 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:49.228939 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:49.231379 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:49.245419 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d0e2ec-114d-4e19-961d-a0e299cfd13f None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:49.279416 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177c47c9-8f1d-4c47-b546-3e9d72b38355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:49.279970 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177c47c9-8f1d-4c47-b546-3e9d72b38355 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:49.280251 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177c47c9-8f1d-4c47-b546-3e9d72b38355 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:49.280520 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177c47c9-8f1d-4c47-b546-3e9d72b38355 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:49.287228 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177c47c9-8f1d-4c47-b546-3e9d72b38355 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:49.288727 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177c47c9-8f1d-4c47-b546-3e9d72b38355 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:49.300419 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-177c47c9-8f1d-4c47-b546-3e9d72b38355 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 09:50:49.300419 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:50:49.300419 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:50:49.300419 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:50:49.300419 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:50:49.300419 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:50:49.300419 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:50:49.300419 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:50:49.300419 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:50:49.300419 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:50:49.300419 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:50:49.300419 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:50:49.300419 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 09:50:49.300419 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 09:50:49.300419 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 09:50:49.301625 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 09:50:49.301625 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:50:49.301625 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:50:49.301625 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:50:49.301625 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:50:49.301625 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:50:49.301625 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:50:49.301625 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:50:49.301625 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:50:49.301625 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:50:49.301625 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:50:49.301625 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:50:49.301625 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:50:49.301625 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:50:49.301625 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:50:49.301625 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:50:49.301625 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:50:49.302680 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 09:50:49.302680 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 09:50:49.302680 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 09:50:49.302680 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 09:50:49.302680 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 09:50:49.302680 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 09:50:49.302680 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 09:50:49.302680 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:50:49.306347 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 260/529] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 10 09:50:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:50:49.307210 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177c47c9-8f1d-4c47-b546-3e9d72b38355 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:49.317489 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc97fd4d-0345-4aed-ae90-4eef947e32b1 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:49.353391 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640098f3-226a-4354-b467-91e643c19d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:49.354022 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640098f3-226a-4354-b467-91e643c19d41 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:49.354320 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640098f3-226a-4354-b467-91e643c19d41 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:49.354574 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640098f3-226a-4354-b467-91e643c19d41 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:49.361344 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640098f3-226a-4354-b467-91e643c19d41 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:49.362794 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640098f3-226a-4354-b467-91e643c19d41 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:49.374285 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-640098f3-226a-4354-b467-91e643c19d41 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 09:50:49.374285 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:50:49.374285 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:50:49.374285 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:50:49.374285 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:50:49.374285 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:50:49.374285 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:50:49.374285 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:50:49.374285 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:50:49.374285 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:50:49.374285 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:50:49.374285 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:50:49.374285 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 09:50:49.374285 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 09:50:49.374285 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 09:50:49.375261 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 09:50:49.375261 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:50:49.375261 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:50:49.375261 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:50:49.375261 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:50:49.375261 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:50:49.375261 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:50:49.375261 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:50:49.375261 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:50:49.375261 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:50:49.375261 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:50:49.375261 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:50:49.375261 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:50:49.375261 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:50:49.375261 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:50:49.375261 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:50:49.375261 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:50:49.376090 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 09:50:49.376090 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 09:50:49.376090 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 09:50:49.376090 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 09:50:49.376090 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 09:50:49.376090 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 09:50:49.376090 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 09:50:49.376090 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:50:49.376090 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 270/530] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 10 09:50:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:50:49.376536 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640098f3-226a-4354-b467-91e643c19d41 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:49.416520 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177c47c9-8f1d-4c47-b546-3e9d72b38355 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:49.452826 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc63fad-b829-4239-9390-7355160da146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:49.453474 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc63fad-b829-4239-9390-7355160da146 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:49.453752 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc63fad-b829-4239-9390-7355160da146 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:49.454021 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc63fad-b829-4239-9390-7355160da146 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:49.457313 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:49.475918 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:49.494861 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640098f3-226a-4354-b467-91e643c19d41 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:49.528701 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc63fad-b829-4239-9390-7355160da146 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:49.528906 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fcdcff-838e-4ac3-a92c-0718abe67402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:49.529693 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fcdcff-838e-4ac3-a92c-0718abe67402 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:49.530022 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fcdcff-838e-4ac3-a92c-0718abe67402 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:49.530271 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc63fad-b829-4239-9390-7355160da146 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:49.530478 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fcdcff-838e-4ac3-a92c-0718abe67402 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:49.531323 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fcdcff-838e-4ac3-a92c-0718abe67402 None admin] RBAC: Adding query filter params (role.id=c0cf832e3b184857b8eaed2f68da1532, scope.project.id=d47d5b72a00642a1a239b785110643ef, user.id=dd8580888cba41a88566da4540b1130c) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:49.531730 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fcdcff-838e-4ac3-a92c-0718abe67402 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:49.533295 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fcdcff-838e-4ac3-a92c-0718abe67402 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:49.538934 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 271/531] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 10 09:50:49 2022] GET /identity/v3/role_assignments?user.id=dd8580888cba41a88566da4540b1130c&scope.project.id=d47d5b72a00642a1a239b785110643ef&role.id=c0cf832e3b184857b8eaed2f68da1532 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:49.549389 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fcdcff-838e-4ac3-a92c-0718abe67402 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:49.660209 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fcdcff-838e-4ac3-a92c-0718abe67402 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:49.674626 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 261/532] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 10 09:50:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 09:50:49.675694 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc63fad-b829-4239-9390-7355160da146 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:49.705572 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775f6bcb-2e24-4c08-ae5b-ac90fe255a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:49.706730 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f6bcb-2e24-4c08-ae5b-ac90fe255a16 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:49.707324 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f6bcb-2e24-4c08-ae5b-ac90fe255a16 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:49.707666 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f6bcb-2e24-4c08-ae5b-ac90fe255a16 None admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:49.708680 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775f6bcb-2e24-4c08-ae5b-ac90fe255a16 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:49.709051 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775f6bcb-2e24-4c08-ae5b-ac90fe255a16 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:49.711402 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775f6bcb-2e24-4c08-ae5b-ac90fe255a16 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:49.715279 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:49.732518 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 272/533] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Aug 10 09:50:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:49.733789 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775f6bcb-2e24-4c08-ae5b-ac90fe255a16 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:49.739451 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:49.798708 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc63fad-b829-4239-9390-7355160da146 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:49.848114 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8181b9-97b3-4450-895b-c3ff63929109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:49.849640 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8181b9-97b3-4450-895b-c3ff63929109 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:49.850069 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8181b9-97b3-4450-895b-c3ff63929109 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:49.850479 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8181b9-97b3-4450-895b-c3ff63929109 None admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:49.851378 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8181b9-97b3-4450-895b-c3ff63929109 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:49.851823 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8181b9-97b3-4450-895b-c3ff63929109 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:49.851950 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775f6bcb-2e24-4c08-ae5b-ac90fe255a16 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:49.853822 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8181b9-97b3-4450-895b-c3ff63929109 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:49.881259 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 262/534] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Aug 10 09:50:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:49.883020 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8181b9-97b3-4450-895b-c3ff63929109 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:49.896217 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38593594-c123-48cb-9ca0-c4d24905ddb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:49.896888 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38593594-c123-48cb-9ca0-c4d24905ddb6 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:49.897204 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38593594-c123-48cb-9ca0-c4d24905ddb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:49.897515 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38593594-c123-48cb-9ca0-c4d24905ddb6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:49.910499 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38593594-c123-48cb-9ca0-c4d24905ddb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:49.911988 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38593594-c123-48cb-9ca0-c4d24905ddb6 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:49.931226 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-38593594-c123-48cb-9ca0-c4d24905ddb6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:50:49.931226 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:50:49.931226 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:50:49.931226 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:50:49.931226 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:50:49.931226 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:50:49.931226 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:50:49.931226 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:50:49.931226 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:50:49.931226 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:50:49.931226 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:50:49.931226 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:50:49.931226 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 09:50:49.931226 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 09:50:49.931226 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 09:50:49.931226 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 09:50:49.932232 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:50:49.932232 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:50:49.932232 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:50:49.932232 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:50:49.932232 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:50:49.932232 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:50:49.932232 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:50:49.932232 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:50:49.932232 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:50:49.932232 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:50:49.932232 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:50:49.932232 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:50:49.932232 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:50:49.932232 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:50:49.932232 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:50:49.932232 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:50:49.932232 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 09:50:49.933085 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 09:50:49.933085 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:50:49.933085 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:50:49.933085 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 273/535] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 10 09:50:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:50:49.933307 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38593594-c123-48cb-9ca0-c4d24905ddb6 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:50.011363 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:50.015162 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8181b9-97b3-4450-895b-c3ff63929109 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:50.026334 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:50.054653 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ebf051-fdbe-4e81-b961-4d41744993c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:50.055175 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ebf051-fdbe-4e81-b961-4d41744993c4 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:50.055455 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ebf051-fdbe-4e81-b961-4d41744993c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:50.055729 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ebf051-fdbe-4e81-b961-4d41744993c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:50.056466 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ebf051-fdbe-4e81-b961-4d41744993c4 None admin] RBAC: Adding query filter params (role.id=c0cf832e3b184857b8eaed2f68da1532, scope.project.id=d47d5b72a00642a1a239b785110643ef, user.id=f9e7f1ec6ad64b978f8817a5d2a73757) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:50.056830 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ebf051-fdbe-4e81-b961-4d41744993c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:50.058499 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ebf051-fdbe-4e81-b961-4d41744993c4 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:50.069242 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 263/536] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 10 09:50:49 2022] GET /identity/v3/role_assignments?user.id=f9e7f1ec6ad64b978f8817a5d2a73757&scope.project.id=d47d5b72a00642a1a239b785110643ef&role.id=c0cf832e3b184857b8eaed2f68da1532 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:50.070261 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ebf051-fdbe-4e81-b961-4d41744993c4 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:50.083322 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38593594-c123-48cb-9ca0-c4d24905ddb6 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:50.129152 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cadf25-33d8-4a32-9e50-768a94ff5286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:50.131724 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cadf25-33d8-4a32-9e50-768a94ff5286 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:50.133753 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cadf25-33d8-4a32-9e50-768a94ff5286 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:50.134289 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cadf25-33d8-4a32-9e50-768a94ff5286 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:50.135242 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cadf25-33d8-4a32-9e50-768a94ff5286 None admin] RBAC: Adding query filter params (role.id=c0cf832e3b184857b8eaed2f68da1532, scope.project.id=d47d5b72a00642a1a239b785110643ef, user.id=bbf8e725cbe0403d943b136235eac057) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:50.136744 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cadf25-33d8-4a32-9e50-768a94ff5286 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:50.138458 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cadf25-33d8-4a32-9e50-768a94ff5286 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:50.155776 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 274/537] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 10 09:50:49 2022] GET /identity/v3/role_assignments?user.id=bbf8e725cbe0403d943b136235eac057&scope.project.id=d47d5b72a00642a1a239b785110643ef&role.id=c0cf832e3b184857b8eaed2f68da1532 => generated 259 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:50.237686 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ebf051-fdbe-4e81-b961-4d41744993c4 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:50.282591 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a1a4ec-0423-46e4-a8ba-189cfb91cb80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:50.283233 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a1a4ec-0423-46e4-a8ba-189cfb91cb80 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:50.283572 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a1a4ec-0423-46e4-a8ba-189cfb91cb80 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:50.283850 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a1a4ec-0423-46e4-a8ba-189cfb91cb80 None admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:50.284540 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a1a4ec-0423-46e4-a8ba-189cfb91cb80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:50.284846 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a1a4ec-0423-46e4-a8ba-189cfb91cb80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:50.286335 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a1a4ec-0423-46e4-a8ba-189cfb91cb80 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:50.300504 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 264/538] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 10 09:50:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:50.306417 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cadf25-33d8-4a32-9e50-768a94ff5286 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:50.359147 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096d9b8c-db43-4f4c-b99e-63407bd5de6e None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:50.359723 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096d9b8c-db43-4f4c-b99e-63407bd5de6e None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:50.360178 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096d9b8c-db43-4f4c-b99e-63407bd5de6e None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:50.362063 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 265/539] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:50:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 09:50:50.367621 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58e66d2-59a0-4a9f-b92d-06df8048fa16 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:50.367908 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58e66d2-59a0-4a9f-b92d-06df8048fa16 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:50.368181 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58e66d2-59a0-4a9f-b92d-06df8048fa16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:50.390694 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-a58e66d2-59a0-4a9f-b92d-06df8048fa16 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:50:50.391896 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-a58e66d2-59a0-4a9f-b92d-06df8048fa16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:50:50.436575 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:50.442107 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cadf25-33d8-4a32-9e50-768a94ff5286 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:50.460582 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:50.508137 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f3cbe8-0036-446d-9cec-2a8a8312ebb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:50.509225 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f3cbe8-0036-446d-9cec-2a8a8312ebb8 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:50.509772 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f3cbe8-0036-446d-9cec-2a8a8312ebb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:50.510844 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f3cbe8-0036-446d-9cec-2a8a8312ebb8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:50.525024 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f3cbe8-0036-446d-9cec-2a8a8312ebb8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:50.529871 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f3cbe8-0036-446d-9cec-2a8a8312ebb8 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:50.536519 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 266/540] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:50:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 09:50:50.551840 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-07f3cbe8-0036-446d-9cec-2a8a8312ebb8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 09:50:50.551840 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:50:50.551840 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:50:50.551840 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:50:50.551840 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:50:50.551840 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:50:50.551840 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:50:50.551840 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:50:50.551840 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:50:50.551840 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:50:50.551840 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:50:50.551840 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:50:50.551840 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 09:50:50.551840 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 09:50:50.551840 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 09:50:50.552734 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 09:50:50.552734 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:50:50.552734 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:50:50.552734 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:50:50.552734 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:50:50.552734 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:50:50.552734 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:50:50.552734 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:50:50.552734 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:50:50.552734 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:50:50.552734 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:50:50.552734 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:50:50.552734 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:50:50.552734 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:50:50.552734 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:50:50.552734 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:50:50.552734 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:50:50.553759 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 09:50:50.553759 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 09:50:50.553759 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 09:50:50.553759 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 09:50:50.553759 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 09:50:50.553759 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 09:50:50.553759 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 09:50:50.553759 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:50:50.556161 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 275/541] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 10 09:50:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:50:50.561506 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58e66d2-59a0-4a9f-b92d-06df8048fa16 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:50.571037 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f3cbe8-0036-446d-9cec-2a8a8312ebb8 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:50.717970 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f3cbe8-0036-446d-9cec-2a8a8312ebb8 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:50.739253 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58e66d2-59a0-4a9f-b92d-06df8048fa16 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:50.752518 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e49d0ad-6b58-4caa-b459-4dddb7c3e7c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:50.753330 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e49d0ad-6b58-4caa-b459-4dddb7c3e7c7 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:50.753702 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e49d0ad-6b58-4caa-b459-4dddb7c3e7c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:50.754065 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e49d0ad-6b58-4caa-b459-4dddb7c3e7c7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:50.764968 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e49d0ad-6b58-4caa-b459-4dddb7c3e7c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 09:50:50.772321 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-2e49d0ad-6b58-4caa-b459-4dddb7c3e7c7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 09:50:50.772321 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:50:50.772321 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:50:50.772321 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:50:50.772321 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:50:50.772321 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:50:50.772321 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:50:50.772321 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:50:50.772321 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:50:50.772321 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:50:50.772321 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:50:50.772321 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:50:50.772321 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 09:50:50.772321 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 09:50:50.772321 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 09:50:50.772321 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 09:50:50.773303 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 09:50:50.773303 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 09:50:50.773303 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 09:50:50.773303 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 09:50:50.773303 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:50:50.773303 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:50:50.773303 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:50:50.773303 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:50:50.773303 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:50:50.773303 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:50:50.773303 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:50:50.773303 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:50:50.773303 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:50:50.773303 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:50:50.773303 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:50:50.773303 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:50:50.777883 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:50:50.777883 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:50:50.777883 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:50:50.777883 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:50:50.777883 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 09:50:50.777883 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 09:50:50.777883 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 09:50:50.777883 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 09:50:50.777883 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 09:50:50.777883 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 09:50:50.777883 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 09:50:50.777883 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:50:50.777883 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 276/542] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Aug 10 09:50:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:50:50.779570 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e49d0ad-6b58-4caa-b459-4dddb7c3e7c7 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:50.796970 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda03d4b-9240-4c1f-806e-ea5a1d8e012f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:50.797857 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda03d4b-9240-4c1f-806e-ea5a1d8e012f None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:50.798328 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda03d4b-9240-4c1f-806e-ea5a1d8e012f None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:50.798742 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda03d4b-9240-4c1f-806e-ea5a1d8e012f None admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:50.799726 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda03d4b-9240-4c1f-806e-ea5a1d8e012f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:50.800263 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda03d4b-9240-4c1f-806e-ea5a1d8e012f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:50.801938 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda03d4b-9240-4c1f-806e-ea5a1d8e012f None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:50.812917 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:50.826433 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 267/543] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Aug 10 09:50:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:50.832797 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda03d4b-9240-4c1f-806e-ea5a1d8e012f None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:50.871933 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:50.886880 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e49d0ad-6b58-4caa-b459-4dddb7c3e7c7 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:50.925440 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bafcf9-51b2-4e61-996f-4981a7d88097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:50.926431 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bafcf9-51b2-4e61-996f-4981a7d88097 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:50.926901 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bafcf9-51b2-4e61-996f-4981a7d88097 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:50.927359 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bafcf9-51b2-4e61-996f-4981a7d88097 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:50.928214 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bafcf9-51b2-4e61-996f-4981a7d88097 None admin] RBAC: Adding query filter params (name=service) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:50.928782 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bafcf9-51b2-4e61-996f-4981a7d88097 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:50.930419 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bafcf9-51b2-4e61-996f-4981a7d88097 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:50.939238 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 277/544] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Aug 10 09:50:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:50.945224 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bafcf9-51b2-4e61-996f-4981a7d88097 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:51.020868 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda03d4b-9240-4c1f-806e-ea5a1d8e012f None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:51.039409 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:51.046885 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bafcf9-51b2-4e61-996f-4981a7d88097 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:51.081321 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a1613c-17a7-4afc-b9bb-f4a214875793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:51.082252 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a1613c-17a7-4afc-b9bb-f4a214875793 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:51.082721 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a1613c-17a7-4afc-b9bb-f4a214875793 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:51.083193 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a1613c-17a7-4afc-b9bb-f4a214875793 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:51.091661 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca22ee4c-1f7e-430c-b391-efe526dfc013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:51.092485 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca22ee4c-1f7e-430c-b391-efe526dfc013 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:51.092662 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca22ee4c-1f7e-430c-b391-efe526dfc013 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:51.092922 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca22ee4c-1f7e-430c-b391-efe526dfc013 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:51.093691 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca22ee4c-1f7e-430c-b391-efe526dfc013 None admin] RBAC: Adding query filter params (role.id=c0cf832e3b184857b8eaed2f68da1532, scope.project.id=d47d5b72a00642a1a239b785110643ef, user.id=4294c170df354fe892831281acd4ea7d) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:51.094021 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca22ee4c-1f7e-430c-b391-efe526dfc013 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:51.095296 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a1613c-17a7-4afc-b9bb-f4a214875793 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:51.095504 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca22ee4c-1f7e-430c-b391-efe526dfc013 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:51.097107 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a1613c-17a7-4afc-b9bb-f4a214875793 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:51.109132 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 268/545] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 10 09:50:50 2022] GET /identity/v3/role_assignments?user.id=4294c170df354fe892831281acd4ea7d&scope.project.id=d47d5b72a00642a1a239b785110643ef&role.id=c0cf832e3b184857b8eaed2f68da1532 => generated 259 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 09:50:51.111521 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-b2a1613c-17a7-4afc-b9bb-f4a214875793 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:50:51.111521 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:50:51.111521 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:50:51.111521 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:50:51.111521 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:50:51.111521 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:50:51.111521 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:50:51.111521 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:50:51.111521 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:50:51.111521 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:50:51.111521 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:50:51.111521 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:50:51.111521 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 09:50:51.111521 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 09:50:51.111521 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 09:50:51.111521 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 09:50:51.112384 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:50:51.112384 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:50:51.112384 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:50:51.112384 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:50:51.112384 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:50:51.112384 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:50:51.112384 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:50:51.112384 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:50:51.112384 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:50:51.112384 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:50:51.112384 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:50:51.112384 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:50:51.112384 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:50:51.112384 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:50:51.112384 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:50:51.112384 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:50:51.112384 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 09:50:51.113235 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 09:50:51.113235 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:50:51.113235 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:50:51.115343 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 278/546] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 10 09:50:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 09:50:51.121471 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca22ee4c-1f7e-430c-b391-efe526dfc013 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:51.207920 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:51.223387 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca22ee4c-1f7e-430c-b391-efe526dfc013 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:51.274692 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4d6721-4311-4681-bd8e-50656ee5fc40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:51.275320 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4d6721-4311-4681-bd8e-50656ee5fc40 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:51.275572 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4d6721-4311-4681-bd8e-50656ee5fc40 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:51.275839 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4d6721-4311-4681-bd8e-50656ee5fc40 None admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:51.276494 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4d6721-4311-4681-bd8e-50656ee5fc40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:51.276798 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4d6721-4311-4681-bd8e-50656ee5fc40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:51.278347 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4d6721-4311-4681-bd8e-50656ee5fc40 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:51.296634 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 269/547] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 10 09:50:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:51.302167 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a1613c-17a7-4afc-b9bb-f4a214875793 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:51.440885 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a1613c-17a7-4afc-b9bb-f4a214875793 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:51.477172 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bd9349-3e8f-4a09-8939-281f594c773b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:51.477806 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bd9349-3e8f-4a09-8939-281f594c773b None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:51.478077 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bd9349-3e8f-4a09-8939-281f594c773b None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:51.478349 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bd9349-3e8f-4a09-8939-281f594c773b None admin] PATH_INFO: `/v3/users/swift` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:51.486556 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bd9349-3e8f-4a09-8939-281f594c773b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:51.488037 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bd9349-3e8f-4a09-8939-281f594c773b None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:51.500681 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-f3bd9349-3e8f-4a09-8939-281f594c773b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 10 09:50:51.500681 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:50:51.500681 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:50:51.500681 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:50:51.500681 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:50:51.500681 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:50:51.500681 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:50:51.500681 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:50:51.500681 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:50:51.500681 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:50:51.500681 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:50:51.500681 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:50:51.500681 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 09:50:51.500681 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 09:50:51.500681 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 09:50:51.500681 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 09:50:51.501700 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:50:51.501700 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:50:51.501700 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 09:50:51.501700 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 09:50:51.501700 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 09:50:51.501700 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 09:50:51.501700 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:50:51.501700 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:50:51.501700 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:50:51.501700 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:50:51.501700 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:50:51.501700 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:50:51.501700 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:50:51.501700 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:50:51.501700 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:50:51.501700 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:50:51.501700 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:50:51.501700 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:50:51.503202 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:50:51.503202 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:50:51.503202 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 09:50:51.503202 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 09:50:51.503202 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 09:50:51.503202 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 09:50:51.503202 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 09:50:51.503202 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 09:50:51.503202 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 10 09:50:51.503202 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:50:51.503202 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 279/548] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Aug 10 09:50:51 2022] GET /identity/v3/users/swift => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 09:50:51.508299 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4d6721-4311-4681-bd8e-50656ee5fc40 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:51.638596 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4d6721-4311-4681-bd8e-50656ee5fc40 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:51.688498 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4231df6-0d87-4fed-b761-703fb2e759b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:51.689364 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4231df6-0d87-4fed-b761-703fb2e759b7 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:51.689817 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4231df6-0d87-4fed-b761-703fb2e759b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:51.690262 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4231df6-0d87-4fed-b761-703fb2e759b7 None admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:51.691321 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4231df6-0d87-4fed-b761-703fb2e759b7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:51.691803 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4231df6-0d87-4fed-b761-703fb2e759b7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:51.693470 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4231df6-0d87-4fed-b761-703fb2e759b7 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:51.723993 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 270/549] 10.222.0.27 () {56 vars in 1135 bytes} [Wed Aug 10 09:50:51 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:51.729917 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bd9349-3e8f-4a09-8939-281f594c773b None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:51.740013 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:51.844887 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bd9349-3e8f-4a09-8939-281f594c773b None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:51.891199 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9596b1f7-faa1-4afe-848f-2d84e2dbceb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:51.891833 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9596b1f7-faa1-4afe-848f-2d84e2dbceb1 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:51.892113 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9596b1f7-faa1-4afe-848f-2d84e2dbceb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:51.892452 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9596b1f7-faa1-4afe-848f-2d84e2dbceb1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:51.962167 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9596b1f7-faa1-4afe-848f-2d84e2dbceb1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:51.963706 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9596b1f7-faa1-4afe-848f-2d84e2dbceb1 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:51.971671 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:52.049202 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac2185f-b5d7-4382-97cb-d104362e7a4a None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:52.049851 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac2185f-b5d7-4382-97cb-d104362e7a4a None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:52.050406 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac2185f-b5d7-4382-97cb-d104362e7a4a None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:52.060219 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 271/550] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:50:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 09:50:52.062965 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4651722-ab58-4fef-b360-abde7a8d3066 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:52.063675 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4651722-ab58-4fef-b360-abde7a8d3066 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:52.064325 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4651722-ab58-4fef-b360-abde7a8d3066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:52.080869 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:52.090194 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-b4651722-ab58-4fef-b360-abde7a8d3066 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:50:52.091627 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-b4651722-ab58-4fef-b360-abde7a8d3066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:50:52.108863 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 280/551] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 10 09:50:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 09:50:52.113648 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9596b1f7-faa1-4afe-848f-2d84e2dbceb1 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:52.221274 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 272/552] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:50:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 09:50:52.271357 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4651722-ab58-4fef-b360-abde7a8d3066 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:52.285392 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9596b1f7-faa1-4afe-848f-2d84e2dbceb1 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:52.297390 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:52.341790 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627ab318-e23f-4876-8314-2346346e8ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:52.343810 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627ab318-e23f-4876-8314-2346346e8ebf None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:52.344607 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627ab318-e23f-4876-8314-2346346e8ebf None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:52.345291 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627ab318-e23f-4876-8314-2346346e8ebf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:52.362049 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627ab318-e23f-4876-8314-2346346e8ebf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:52.364238 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627ab318-e23f-4876-8314-2346346e8ebf None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:52.382567 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-627ab318-e23f-4876-8314-2346346e8ebf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:50:52.382567 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:50:52.382567 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:50:52.382567 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:50:52.382567 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:50:52.382567 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:50:52.382567 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:50:52.382567 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:50:52.382567 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:50:52.382567 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:50:52.382567 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:50:52.382567 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:50:52.382567 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 09:50:52.382567 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 09:50:52.382567 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 09:50:52.382567 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 09:50:52.383664 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:50:52.383664 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:50:52.383664 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:50:52.383664 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:50:52.383664 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:50:52.383664 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:50:52.383664 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:50:52.383664 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:50:52.383664 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:50:52.383664 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:50:52.383664 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:50:52.383664 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:50:52.383664 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:50:52.383664 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:50:52.383664 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:50:52.383664 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:50:52.383664 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 09:50:52.384512 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 09:50:52.384512 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:50:52.384512 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:50:52.391628 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 281/553] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 10 09:50:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:50:52.393134 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627ab318-e23f-4876-8314-2346346e8ebf None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:52.461594 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4651722-ab58-4fef-b360-abde7a8d3066 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:52.496694 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12f2136-26d1-4e85-9ea0-bb8dd1346ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:52.497272 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f2136-26d1-4e85-9ea0-bb8dd1346ca0 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:52.497551 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f2136-26d1-4e85-9ea0-bb8dd1346ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:52.497819 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f2136-26d1-4e85-9ea0-bb8dd1346ca0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:52.499640 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:52.511234 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12f2136-26d1-4e85-9ea0-bb8dd1346ca0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 09:50:52.516040 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-f12f2136-26d1-4e85-9ea0-bb8dd1346ca0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 09:50:52.516040 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:50:52.516040 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:50:52.516040 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:50:52.516040 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:50:52.516040 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:50:52.516040 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:50:52.516040 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:50:52.516040 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:50:52.516040 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:50:52.516040 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:50:52.516040 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:50:52.516040 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 09:50:52.516040 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 09:50:52.516040 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 09:50:52.516040 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 09:50:52.516916 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 09:50:52.516916 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 09:50:52.516916 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 09:50:52.516916 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 09:50:52.516916 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:50:52.516916 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:50:52.516916 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:50:52.516916 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:50:52.516916 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:50:52.516916 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:50:52.516916 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:50:52.516916 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:50:52.516916 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:50:52.516916 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:50:52.516916 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:50:52.516916 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:50:52.518240 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:50:52.518240 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:50:52.518240 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:50:52.518240 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:50:52.518240 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 09:50:52.518240 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 09:50:52.518240 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 09:50:52.518240 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 09:50:52.518240 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 09:50:52.518240 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 09:50:52.518240 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 09:50:52.518240 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:50:52.521171 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 273/554] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Aug 10 09:50:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 09:50:52.521443 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627ab318-e23f-4876-8314-2346346e8ebf None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:52.522398 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbfd5a2-2890-4c68-ada3-9464e27625bc None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:52.522930 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbfd5a2-2890-4c68-ada3-9464e27625bc None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:52.523016 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbfd5a2-2890-4c68-ada3-9464e27625bc None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:52.524381 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 274/555] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:50:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:50:52.530531 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325fbde2-5598-4bf7-aa7c-620e64c84dc8 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:52.530814 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325fbde2-5598-4bf7-aa7c-620e64c84dc8 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:52.531085 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325fbde2-5598-4bf7-aa7c-620e64c84dc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:52.550055 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-325fbde2-5598-4bf7-aa7c-620e64c84dc8 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:50:52.551257 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-325fbde2-5598-4bf7-aa7c-620e64c84dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:50:52.563510 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d3f17e-5474-4149-8eb5-5a166f8e1ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:52.564649 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d3f17e-5474-4149-8eb5-5a166f8e1ac3 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:52.565152 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d3f17e-5474-4149-8eb5-5a166f8e1ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:52.565790 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d3f17e-5474-4149-8eb5-5a166f8e1ac3 None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:52.566979 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d3f17e-5474-4149-8eb5-5a166f8e1ac3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:52.567615 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d3f17e-5474-4149-8eb5-5a166f8e1ac3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:52.569941 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d3f17e-5474-4149-8eb5-5a166f8e1ac3 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:52.590185 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 282/556] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 10 09:50:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 09:50:52.590185 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d3f17e-5474-4149-8eb5-5a166f8e1ac3 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:52.610483 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:52.643244 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 275/557] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:50:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 09:50:52.644098 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325fbde2-5598-4bf7-aa7c-620e64c84dc8 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:52.715494 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d3f17e-5474-4149-8eb5-5a166f8e1ac3 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:52.746539 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325fbde2-5598-4bf7-aa7c-620e64c84dc8 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:52.751884 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8d8203-a7aa-4ae8-ad93-3a48fce4fe8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:52.752430 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8d8203-a7aa-4ae8-ad93-3a48fce4fe8a None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:52.752709 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8d8203-a7aa-4ae8-ad93-3a48fce4fe8a None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:52.752987 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8d8203-a7aa-4ae8-ad93-3a48fce4fe8a None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:52.753697 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8d8203-a7aa-4ae8-ad93-3a48fce4fe8a None admin] RBAC: Adding query filter params (name=service) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:52.754002 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8d8203-a7aa-4ae8-ad93-3a48fce4fe8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:52.755380 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8d8203-a7aa-4ae8-ad93-3a48fce4fe8a None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:52.768942 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 283/558] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Aug 10 09:50:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:52.768942 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb69c52-95ec-4086-bcde-4060767f77c6 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:52.768942 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb69c52-95ec-4086-bcde-4060767f77c6 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:52.768942 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb69c52-95ec-4086-bcde-4060767f77c6 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:52.768942 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 284/559] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:50:52 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:50:52.768942 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb69c52-95ec-4086-bcde-4060767f77c6 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:52.777408 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:52.789740 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a3ac02-7f5d-44ba-9458-ed6af65b6359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:52.790372 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a3ac02-7f5d-44ba-9458-ed6af65b6359 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:52.790652 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a3ac02-7f5d-44ba-9458-ed6af65b6359 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:52.791198 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a3ac02-7f5d-44ba-9458-ed6af65b6359 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:52.797604 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a3ac02-7f5d-44ba-9458-ed6af65b6359 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:52.799145 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a3ac02-7f5d-44ba-9458-ed6af65b6359 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:52.809870 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-27a3ac02-7f5d-44ba-9458-ed6af65b6359 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 09:50:52.809870 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:50:52.809870 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:50:52.809870 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:50:52.809870 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:50:52.809870 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:50:52.809870 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:50:52.809870 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:50:52.809870 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:50:52.809870 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:50:52.809870 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:50:52.809870 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:50:52.809870 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 09:50:52.809870 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 09:50:52.809870 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 09:50:52.810739 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 09:50:52.810739 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:50:52.810739 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:50:52.810739 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:50:52.810739 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:50:52.810739 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:50:52.810739 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:50:52.810739 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:50:52.810739 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:50:52.810739 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:50:52.810739 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:50:52.810739 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:50:52.810739 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:50:52.810739 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:50:52.810739 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:50:52.810739 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:50:52.810739 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:50:52.811637 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 09:50:52.811637 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 09:50:52.811637 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 09:50:52.811637 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 09:50:52.811637 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 09:50:52.811637 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 09:50:52.811637 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 09:50:52.811637 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:50:52.811637 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 276/560] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 10 09:50:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:50:52.812129 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a3ac02-7f5d-44ba-9458-ed6af65b6359 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:52.861351 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:52.884396 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb69c52-95ec-4086-bcde-4060767f77c6 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:52.918086 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5148bcf-33bf-4e22-8ac4-a110c6dcca1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:52.918623 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a3ac02-7f5d-44ba-9458-ed6af65b6359 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:52.918760 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5148bcf-33bf-4e22-8ac4-a110c6dcca1f None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:52.918972 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5148bcf-33bf-4e22-8ac4-a110c6dcca1f None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:52.919240 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5148bcf-33bf-4e22-8ac4-a110c6dcca1f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:52.929739 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5148bcf-33bf-4e22-8ac4-a110c6dcca1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 09:50:52.934407 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-e5148bcf-33bf-4e22-8ac4-a110c6dcca1f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 09:50:52.934407 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:50:52.934407 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:50:52.934407 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:50:52.934407 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:50:52.934407 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:50:52.934407 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:50:52.934407 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:50:52.934407 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:50:52.934407 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:50:52.934407 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:50:52.934407 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:50:52.934407 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 09:50:52.934407 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 09:50:52.934407 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 09:50:52.934407 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 09:50:52.935385 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 09:50:52.935385 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 09:50:52.935385 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 09:50:52.935385 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 09:50:52.935385 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:50:52.935385 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:50:52.935385 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:50:52.935385 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:50:52.935385 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:50:52.935385 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:50:52.935385 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:50:52.935385 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:50:52.935385 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:50:52.935385 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:50:52.935385 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:50:52.935385 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:50:52.936207 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:50:52.936207 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:50:52.936207 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:50:52.936207 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:50:52.936207 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 09:50:52.936207 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 09:50:52.936207 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 09:50:52.936207 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 09:50:52.936207 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 09:50:52.936207 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 09:50:52.936207 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 09:50:52.936207 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:50:52.936207 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 285/561] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Aug 10 09:50:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:50:52.937420 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25320a0-7611-496c-815d-f59403371acf None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:52.937420 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25320a0-7611-496c-815d-f59403371acf None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:52.937576 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25320a0-7611-496c-815d-f59403371acf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:52.956407 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-b25320a0-7611-496c-815d-f59403371acf None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:50:52.957846 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-b25320a0-7611-496c-815d-f59403371acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:50:52.958714 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec4777c-a274-46dd-aacd-ba4d2bd7eb3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:52.959338 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec4777c-a274-46dd-aacd-ba4d2bd7eb3c None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:52.959729 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec4777c-a274-46dd-aacd-ba4d2bd7eb3c None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:52.960064 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec4777c-a274-46dd-aacd-ba4d2bd7eb3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:52.972115 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec4777c-a274-46dd-aacd-ba4d2bd7eb3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:52.973603 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec4777c-a274-46dd-aacd-ba4d2bd7eb3c None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:52.988771 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-aec4777c-a274-46dd-aacd-ba4d2bd7eb3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:50:52.988771 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:50:52.988771 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:50:52.988771 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:50:52.988771 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:50:52.988771 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:50:52.988771 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:50:52.988771 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:50:52.988771 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:50:52.988771 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:50:52.988771 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:50:52.988771 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:50:52.988771 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 09:50:52.988771 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 09:50:52.988771 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 09:50:52.988771 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 09:50:52.989754 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:50:52.989754 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:50:52.989754 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:50:52.989754 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:50:52.989754 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:50:52.989754 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:50:52.989754 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:50:52.989754 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:50:52.989754 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:50:52.989754 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:50:52.989754 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:50:52.989754 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:50:52.989754 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:50:52.989754 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:50:52.989754 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:50:52.989754 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:50:52.989754 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 09:50:52.990682 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 09:50:52.990682 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:50:52.990682 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:50:52.990682 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 277/562] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 10 09:50:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:50:52.990682 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec4777c-a274-46dd-aacd-ba4d2bd7eb3c None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:53.032070 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:53.033881 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 286/563] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:50:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 09:50:53.045945 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25320a0-7611-496c-815d-f59403371acf None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:53.106690 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec4777c-a274-46dd-aacd-ba4d2bd7eb3c None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:53.121684 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:53.142320 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8571964d-ea81-4258-8b25-7d4fcdd43471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:53.143230 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8571964d-ea81-4258-8b25-7d4fcdd43471 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:53.143512 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8571964d-ea81-4258-8b25-7d4fcdd43471 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:53.143782 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8571964d-ea81-4258-8b25-7d4fcdd43471 None admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:53.144479 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8571964d-ea81-4258-8b25-7d4fcdd43471 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:53.144786 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8571964d-ea81-4258-8b25-7d4fcdd43471 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:53.146271 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8571964d-ea81-4258-8b25-7d4fcdd43471 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:53.154839 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25320a0-7611-496c-815d-f59403371acf None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:53.162694 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 278/564] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Aug 10 09:50:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:53.162694 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8571964d-ea81-4258-8b25-7d4fcdd43471 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:53.196562 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a90eb9-ea76-4395-8114-16dd8c9dd2a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:53.197444 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a90eb9-ea76-4395-8114-16dd8c9dd2a6 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:53.197885 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a90eb9-ea76-4395-8114-16dd8c9dd2a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:53.198389 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a90eb9-ea76-4395-8114-16dd8c9dd2a6 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:53.199195 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a90eb9-ea76-4395-8114-16dd8c9dd2a6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:53.199633 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a90eb9-ea76-4395-8114-16dd8c9dd2a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:53.201352 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a90eb9-ea76-4395-8114-16dd8c9dd2a6 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:53.210228 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 287/565] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Aug 10 09:50:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:53.211239 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a90eb9-ea76-4395-8114-16dd8c9dd2a6 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:53.257214 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:53.264152 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8571964d-ea81-4258-8b25-7d4fcdd43471 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:53.297954 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4d1116-66fc-44c1-b51a-1b28979ceb18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:53.298595 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d1116-66fc-44c1-b51a-1b28979ceb18 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:53.298872 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d1116-66fc-44c1-b51a-1b28979ceb18 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:53.299142 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d1116-66fc-44c1-b51a-1b28979ceb18 None admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:53.299791 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4d1116-66fc-44c1-b51a-1b28979ceb18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:53.300094 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4d1116-66fc-44c1-b51a-1b28979ceb18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:53.301509 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4d1116-66fc-44c1-b51a-1b28979ceb18 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:53.317708 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 279/566] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 10 09:50:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:53.317708 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4d1116-66fc-44c1-b51a-1b28979ceb18 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:53.322628 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a90eb9-ea76-4395-8114-16dd8c9dd2a6 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:53.354828 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:53.360502 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1961be-cb45-4e5d-928b-de171373c1e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:53.361178 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1961be-cb45-4e5d-928b-de171373c1e6 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:53.361459 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1961be-cb45-4e5d-928b-de171373c1e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:53.361726 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1961be-cb45-4e5d-928b-de171373c1e6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:53.371773 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1961be-cb45-4e5d-928b-de171373c1e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 09:50:53.376842 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-cc1961be-cb45-4e5d-928b-de171373c1e6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 09:50:53.376842 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:50:53.376842 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:50:53.376842 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:50:53.376842 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:50:53.376842 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:50:53.376842 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:50:53.376842 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:50:53.376842 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:50:53.376842 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:50:53.376842 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:50:53.376842 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:50:53.376842 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 09:50:53.376842 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 09:50:53.376842 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 09:50:53.376842 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 09:50:53.377805 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 09:50:53.377805 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 09:50:53.377805 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 09:50:53.377805 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 09:50:53.377805 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:50:53.377805 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:50:53.377805 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:50:53.377805 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:50:53.377805 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:50:53.377805 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:50:53.377805 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:50:53.377805 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:50:53.377805 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:50:53.377805 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:50:53.377805 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:50:53.377805 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:50:53.378652 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:50:53.378652 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:50:53.378652 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:50:53.378652 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:50:53.378652 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 09:50:53.378652 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 09:50:53.378652 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 09:50:53.378652 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 09:50:53.378652 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 09:50:53.378652 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 09:50:53.378652 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 09:50:53.378652 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:50:53.378652 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 288/567] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Aug 10 09:50:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:50:53.379329 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1961be-cb45-4e5d-928b-de171373c1e6 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:53.428703 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4d1116-66fc-44c1-b51a-1b28979ceb18 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:53.464884 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8bdc71-4cf8-4fff-bdd8-6ee40abb2721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:53.465528 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8bdc71-4cf8-4fff-bdd8-6ee40abb2721 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:53.465805 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8bdc71-4cf8-4fff-bdd8-6ee40abb2721 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:53.466076 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8bdc71-4cf8-4fff-bdd8-6ee40abb2721 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:53.466807 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8bdc71-4cf8-4fff-bdd8-6ee40abb2721 None admin] RBAC: Adding query filter params (role.id=c0cf832e3b184857b8eaed2f68da1532, scope.project.id=d47d5b72a00642a1a239b785110643ef, user.id=b801551d29ff4687ab8c1ce8cfa51614) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:53.467115 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8bdc71-4cf8-4fff-bdd8-6ee40abb2721 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:53.468559 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8bdc71-4cf8-4fff-bdd8-6ee40abb2721 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:53.474179 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 280/568] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 10 09:50:53 2022] GET /identity/v3/role_assignments?user.id=b801551d29ff4687ab8c1ce8cfa51614&scope.project.id=d47d5b72a00642a1a239b785110643ef&role.id=c0cf832e3b184857b8eaed2f68da1532 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:53.474965 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8bdc71-4cf8-4fff-bdd8-6ee40abb2721 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:53.499037 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1961be-cb45-4e5d-928b-de171373c1e6 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:53.513017 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:53.537731 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1271cc4a-e863-45fd-8129-35cb108bef6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:53.539125 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1271cc4a-e863-45fd-8129-35cb108bef6e None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:53.539549 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1271cc4a-e863-45fd-8129-35cb108bef6e None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:53.539970 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1271cc4a-e863-45fd-8129-35cb108bef6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:53.553131 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1271cc4a-e863-45fd-8129-35cb108bef6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:53.554593 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1271cc4a-e863-45fd-8129-35cb108bef6e None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:53.571036 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-1271cc4a-e863-45fd-8129-35cb108bef6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:50:53.571036 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:50:53.571036 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:50:53.571036 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:50:53.571036 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:50:53.571036 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:50:53.571036 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:50:53.571036 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:50:53.571036 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:50:53.571036 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:50:53.571036 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:50:53.571036 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:50:53.571036 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 09:50:53.571036 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 09:50:53.571036 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 09:50:53.571036 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 09:50:53.572049 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:50:53.572049 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:50:53.572049 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:50:53.572049 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:50:53.572049 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:50:53.572049 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:50:53.572049 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:50:53.572049 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:50:53.572049 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:50:53.572049 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:50:53.572049 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:50:53.572049 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:50:53.572049 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:50:53.572049 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:50:53.572049 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:50:53.572049 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:50:53.572049 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 09:50:53.572916 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 09:50:53.572916 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:50:53.572916 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:50:53.572916 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 289/569] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 10 09:50:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:50:53.573176 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1271cc4a-e863-45fd-8129-35cb108bef6e None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:53.615104 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8bdc71-4cf8-4fff-bdd8-6ee40abb2721 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:53.624120 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:53.655760 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bd3f40-eb32-48c8-bff8-12d6b99190d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:53.657109 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd3f40-eb32-48c8-bff8-12d6b99190d6 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:53.657109 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd3f40-eb32-48c8-bff8-12d6b99190d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:53.657109 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd3f40-eb32-48c8-bff8-12d6b99190d6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:53.664885 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bd3f40-eb32-48c8-bff8-12d6b99190d6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:53.666394 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bd3f40-eb32-48c8-bff8-12d6b99190d6 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:53.683016 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-34bd3f40-eb32-48c8-bff8-12d6b99190d6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 10 09:50:53.683016 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:50:53.683016 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:50:53.683016 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:50:53.683016 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:50:53.683016 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:50:53.683016 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:50:53.683016 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:50:53.683016 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:50:53.683016 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:50:53.683016 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:50:53.683016 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:50:53.683016 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 09:50:53.683016 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 09:50:53.683016 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 09:50:53.683016 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 09:50:53.684527 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:50:53.684527 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:50:53.684527 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 09:50:53.684527 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 09:50:53.684527 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 09:50:53.684527 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 09:50:53.684527 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:50:53.684527 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:50:53.684527 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:50:53.684527 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:50:53.684527 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:50:53.684527 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:50:53.684527 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:50:53.684527 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:50:53.684527 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:50:53.684527 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:50:53.684527 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:50:53.684527 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:50:53.686346 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:50:53.686346 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:50:53.686346 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 09:50:53.686346 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 09:50:53.686346 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 09:50:53.686346 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 09:50:53.686346 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 09:50:53.686346 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 09:50:53.686346 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 10 09:50:53.686346 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:50:53.688948 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 281/570] 10.222.0.27 () {56 vars in 1093 bytes} [Wed Aug 10 09:50:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:50:53.690163 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcb1e76-55f7-48e6-800c-70249b3de1fd None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:53.690448 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcb1e76-55f7-48e6-800c-70249b3de1fd None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:53.690721 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcb1e76-55f7-48e6-800c-70249b3de1fd None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:53.691764 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1271cc4a-e863-45fd-8129-35cb108bef6e None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:53.692166 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 282/571] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:50:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:50:53.692685 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcb1e76-55f7-48e6-800c-70249b3de1fd None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:53.729347 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a090e40-39ab-4365-b0a1-61b276b7ecb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:53.730356 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a090e40-39ab-4365-b0a1-61b276b7ecb6 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:53.730799 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a090e40-39ab-4365-b0a1-61b276b7ecb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:53.731311 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a090e40-39ab-4365-b0a1-61b276b7ecb6 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:53.732118 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a090e40-39ab-4365-b0a1-61b276b7ecb6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:53.732568 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a090e40-39ab-4365-b0a1-61b276b7ecb6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:53.734289 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a090e40-39ab-4365-b0a1-61b276b7ecb6 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:53.743333 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 290/572] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Aug 10 09:50:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:53.744478 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a090e40-39ab-4365-b0a1-61b276b7ecb6 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:53.783537 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:53.803936 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcb1e76-55f7-48e6-800c-70249b3de1fd None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:53.839155 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bcf1fc-8bf9-4156-9dea-61667416e57b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:53.839765 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bcf1fc-8bf9-4156-9dea-61667416e57b None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:53.840042 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bcf1fc-8bf9-4156-9dea-61667416e57b None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:53.840309 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bcf1fc-8bf9-4156-9dea-61667416e57b None admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:53.840961 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bcf1fc-8bf9-4156-9dea-61667416e57b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:53.841295 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bcf1fc-8bf9-4156-9dea-61667416e57b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:53.842691 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bcf1fc-8bf9-4156-9dea-61667416e57b None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:53.850582 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a090e40-39ab-4365-b0a1-61b276b7ecb6 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:53.858783 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 283/573] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 10 09:50:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:53.858783 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5350dda-ca5d-4bdc-be4d-859bda9ef4b7 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:53.858783 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5350dda-ca5d-4bdc-be4d-859bda9ef4b7 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:53.858783 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5350dda-ca5d-4bdc-be4d-859bda9ef4b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:53.860179 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:53.875691 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-c5350dda-ca5d-4bdc-be4d-859bda9ef4b7 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:50:53.877049 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-c5350dda-ca5d-4bdc-be4d-859bda9ef4b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:50:53.890197 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0047d48-aa3a-40fc-b354-fe262d4f140d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:53.890792 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0047d48-aa3a-40fc-b354-fe262d4f140d None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:53.891067 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0047d48-aa3a-40fc-b354-fe262d4f140d None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:53.891334 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0047d48-aa3a-40fc-b354-fe262d4f140d None admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:53.892069 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0047d48-aa3a-40fc-b354-fe262d4f140d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:53.892367 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0047d48-aa3a-40fc-b354-fe262d4f140d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:53.893826 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0047d48-aa3a-40fc-b354-fe262d4f140d None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:53.918502 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 291/574] 10.222.0.27 () {56 vars in 1133 bytes} [Wed Aug 10 09:50:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:53.918502 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0047d48-aa3a-40fc-b354-fe262d4f140d None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:53.961306 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 284/575] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:50:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 09:50:53.961306 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5350dda-ca5d-4bdc-be4d-859bda9ef4b7 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:54.027928 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0047d48-aa3a-40fc-b354-fe262d4f140d None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:54.032752 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:54.062661 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5350dda-ca5d-4bdc-be4d-859bda9ef4b7 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:54.064435 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b13602-d5fb-4346-af7e-36f055d4e0c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:54.065204 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b13602-d5fb-4346-af7e-36f055d4e0c3 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:54.065483 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b13602-d5fb-4346-af7e-36f055d4e0c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:54.065754 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b13602-d5fb-4346-af7e-36f055d4e0c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:54.076555 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b13602-d5fb-4346-af7e-36f055d4e0c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:54.078136 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b13602-d5fb-4346-af7e-36f055d4e0c3 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:54.093669 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-45b13602-d5fb-4346-af7e-36f055d4e0c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:50:54.093669 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:50:54.093669 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:50:54.093669 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:50:54.093669 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:50:54.093669 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:50:54.093669 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:50:54.093669 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:50:54.093669 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:50:54.093669 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:50:54.093669 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:50:54.093669 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:50:54.093669 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 09:50:54.093669 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 09:50:54.093669 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 09:50:54.093669 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 09:50:54.094838 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:50:54.094838 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:50:54.094838 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:50:54.094838 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:50:54.094838 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:50:54.094838 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:50:54.094838 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:50:54.094838 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:50:54.094838 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:50:54.094838 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:50:54.094838 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:50:54.094838 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:50:54.094838 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:50:54.094838 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:50:54.094838 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:50:54.094838 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:50:54.094838 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 09:50:54.095699 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 09:50:54.095699 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:50:54.095699 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:50:54.095699 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 292/576] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 10 09:50:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:50:54.095936 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b13602-d5fb-4346-af7e-36f055d4e0c3 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:54.102574 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6714c0-1ffe-433a-bb95-16fe45e58f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:54.103223 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6714c0-1ffe-433a-bb95-16fe45e58f07 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:54.103503 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6714c0-1ffe-433a-bb95-16fe45e58f07 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:54.103776 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6714c0-1ffe-433a-bb95-16fe45e58f07 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:54.111191 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6714c0-1ffe-433a-bb95-16fe45e58f07 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:54.112645 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6714c0-1ffe-433a-bb95-16fe45e58f07 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:54.114773 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:54.125199 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-2a6714c0-1ffe-433a-bb95-16fe45e58f07 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 10 09:50:54.125199 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:50:54.125199 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:50:54.125199 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:50:54.125199 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:50:54.125199 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:50:54.125199 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:50:54.125199 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:50:54.125199 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:50:54.125199 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:50:54.125199 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:50:54.125199 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:50:54.125199 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 09:50:54.125199 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 09:50:54.125199 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 09:50:54.125199 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 09:50:54.126324 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:50:54.126324 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:50:54.126324 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 09:50:54.126324 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 09:50:54.126324 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 09:50:54.126324 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 09:50:54.126324 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:50:54.126324 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:50:54.126324 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:50:54.126324 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:50:54.126324 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:50:54.126324 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:50:54.126324 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:50:54.126324 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:50:54.126324 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:50:54.126324 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:50:54.126324 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:50:54.126324 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:50:54.127293 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:50:54.127293 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:50:54.127293 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 09:50:54.127293 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 09:50:54.127293 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 09:50:54.127293 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 09:50:54.127293 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 09:50:54.127293 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 09:50:54.127293 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 10 09:50:54.127293 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:50:54.127293 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 285/577] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 10 09:50:53 2022] GET /identity/v3/users/glance => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:50:54.127293 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6714c0-1ffe-433a-bb95-16fe45e58f07 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:54.216771 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b13602-d5fb-4346-af7e-36f055d4e0c3 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:54.232366 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6714c0-1ffe-433a-bb95-16fe45e58f07 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:54.256947 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460a5907-9d98-4430-8102-49e327c78521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:54.257602 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460a5907-9d98-4430-8102-49e327c78521 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:54.257875 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460a5907-9d98-4430-8102-49e327c78521 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:54.258140 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460a5907-9d98-4430-8102-49e327c78521 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:54.263238 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:54.269603 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460a5907-9d98-4430-8102-49e327c78521 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:54.271217 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460a5907-9d98-4430-8102-49e327c78521 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:54.271533 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7003c6a-fd2a-48e0-8a54-c45ddbb98c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:54.272234 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7003c6a-fd2a-48e0-8a54-c45ddbb98c5a None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:54.272595 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7003c6a-fd2a-48e0-8a54-c45ddbb98c5a None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:54.272936 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7003c6a-fd2a-48e0-8a54-c45ddbb98c5a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:54.284808 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7003c6a-fd2a-48e0-8a54-c45ddbb98c5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 09:50:54.285478 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-460a5907-9d98-4430-8102-49e327c78521 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:50:54.285478 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:50:54.285478 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:50:54.285478 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:50:54.285478 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:50:54.285478 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:50:54.285478 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:50:54.285478 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:50:54.285478 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:50:54.285478 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:50:54.285478 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:50:54.285478 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:50:54.285478 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 09:50:54.285478 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 09:50:54.285478 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 09:50:54.285478 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 09:50:54.286564 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:50:54.286564 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:50:54.286564 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:50:54.286564 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:50:54.286564 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:50:54.286564 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:50:54.286564 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:50:54.286564 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:50:54.286564 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:50:54.286564 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:50:54.286564 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:50:54.286564 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:50:54.286564 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:50:54.286564 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:50:54.286564 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:50:54.286564 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:50:54.286564 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 09:50:54.287673 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 09:50:54.287673 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:50:54.287673 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:50:54.293549 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 293/578] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 10 09:50:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:50:54.293549 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460a5907-9d98-4430-8102-49e327c78521 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:54.293745 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-a7003c6a-fd2a-48e0-8a54-c45ddbb98c5a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 09:50:54.293745 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:50:54.293745 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:50:54.293745 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:50:54.293745 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:50:54.293745 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:50:54.293745 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:50:54.293745 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:50:54.293745 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:50:54.293745 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:50:54.293745 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:50:54.293745 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:50:54.293745 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 09:50:54.293745 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 09:50:54.293745 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 09:50:54.293745 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 09:50:54.294614 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 09:50:54.294614 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 09:50:54.294614 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 09:50:54.294614 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 09:50:54.294614 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:50:54.294614 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:50:54.294614 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:50:54.294614 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:50:54.294614 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:50:54.294614 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:50:54.294614 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:50:54.294614 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:50:54.294614 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:50:54.294614 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:50:54.294614 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:50:54.294614 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:50:54.295422 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:50:54.295422 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:50:54.295422 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:50:54.295422 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:50:54.295422 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 09:50:54.295422 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 09:50:54.295422 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 09:50:54.295422 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 09:50:54.295422 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 09:50:54.295422 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 09:50:54.295422 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 09:50:54.295422 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:50:54.295422 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 286/579] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Aug 10 09:50:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:50:54.295422 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7003c6a-fd2a-48e0-8a54-c45ddbb98c5a None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:54.364349 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:54.399876 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460a5907-9d98-4430-8102-49e327c78521 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:54.400059 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7003c6a-fd2a-48e0-8a54-c45ddbb98c5a None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:54.434766 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754b751b-ee36-4eb0-bb86-ecf96d9a7e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:54.435375 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754b751b-ee36-4eb0-bb86-ecf96d9a7e4d None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:54.435651 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754b751b-ee36-4eb0-bb86-ecf96d9a7e4d None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:54.435923 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754b751b-ee36-4eb0-bb86-ecf96d9a7e4d None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:54.436681 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754b751b-ee36-4eb0-bb86-ecf96d9a7e4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:54.437001 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754b751b-ee36-4eb0-bb86-ecf96d9a7e4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:54.438486 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754b751b-ee36-4eb0-bb86-ecf96d9a7e4d None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:54.443400 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb21bbc2-a244-456e-bbf3-de472649bdcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:54.444452 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb21bbc2-a244-456e-bbf3-de472649bdcc None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:54.444791 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb21bbc2-a244-456e-bbf3-de472649bdcc None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:54.445163 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb21bbc2-a244-456e-bbf3-de472649bdcc None admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:54.445990 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb21bbc2-a244-456e-bbf3-de472649bdcc None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:54.446359 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb21bbc2-a244-456e-bbf3-de472649bdcc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:54.447895 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb21bbc2-a244-456e-bbf3-de472649bdcc None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:54.456311 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 294/580] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 10 09:50:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:54.456311 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754b751b-ee36-4eb0-bb86-ecf96d9a7e4d None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:54.470362 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 287/581] 10.222.0.27 () {56 vars in 1137 bytes} [Wed Aug 10 09:50:54 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:54.470362 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb21bbc2-a244-456e-bbf3-de472649bdcc None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:54.517129 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:54.559698 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754b751b-ee36-4eb0-bb86-ecf96d9a7e4d None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:54.576114 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb21bbc2-a244-456e-bbf3-de472649bdcc None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:54.589098 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:54.598236 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae51dd9-d86d-47d1-96f1-7f2ee3090dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:54.598919 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae51dd9-d86d-47d1-96f1-7f2ee3090dbc None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:54.599199 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae51dd9-d86d-47d1-96f1-7f2ee3090dbc None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:54.599468 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae51dd9-d86d-47d1-96f1-7f2ee3090dbc None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:54.600113 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae51dd9-d86d-47d1-96f1-7f2ee3090dbc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:54.600420 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae51dd9-d86d-47d1-96f1-7f2ee3090dbc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:54.601861 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae51dd9-d86d-47d1-96f1-7f2ee3090dbc None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:54.619654 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 295/582] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 10 09:50:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:54.619654 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae51dd9-d86d-47d1-96f1-7f2ee3090dbc None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:54.619888 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6730c6cf-9ab1-4620-a448-38acd7cee071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:54.619888 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6730c6cf-9ab1-4620-a448-38acd7cee071 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:54.619888 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6730c6cf-9ab1-4620-a448-38acd7cee071 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:54.619888 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6730c6cf-9ab1-4620-a448-38acd7cee071 None admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:54.620609 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6730c6cf-9ab1-4620-a448-38acd7cee071 None admin] RBAC: Adding query filter params (name=service) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:54.621153 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6730c6cf-9ab1-4620-a448-38acd7cee071 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:54.622583 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6730c6cf-9ab1-4620-a448-38acd7cee071 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:54.630996 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 288/583] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Aug 10 09:50:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:54.631821 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6730c6cf-9ab1-4620-a448-38acd7cee071 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:54.732506 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae51dd9-d86d-47d1-96f1-7f2ee3090dbc None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:54.744385 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6730c6cf-9ab1-4620-a448-38acd7cee071 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:54.755873 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:54.769156 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e907b9b4-a10e-4100-862d-2890a623b1ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:54.769952 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e907b9b4-a10e-4100-862d-2890a623b1ec None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:54.770293 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e907b9b4-a10e-4100-862d-2890a623b1ec None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:54.770666 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e907b9b4-a10e-4100-862d-2890a623b1ec None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:54.781272 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e907b9b4-a10e-4100-862d-2890a623b1ec None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:54.784718 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e907b9b4-a10e-4100-862d-2890a623b1ec None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:54.785272 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0594695-9d26-46dd-bfe3-0dbf57a6ea69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:54.785963 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0594695-9d26-46dd-bfe3-0dbf57a6ea69 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:54.786307 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0594695-9d26-46dd-bfe3-0dbf57a6ea69 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:54.786643 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0594695-9d26-46dd-bfe3-0dbf57a6ea69 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:54.798175 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0594695-9d26-46dd-bfe3-0dbf57a6ea69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:54.799687 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0594695-9d26-46dd-bfe3-0dbf57a6ea69 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:54.801781 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-e907b9b4-a10e-4100-862d-2890a623b1ec None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 10 09:50:54.801781 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:50:54.801781 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:50:54.801781 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:50:54.801781 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:50:54.801781 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:50:54.801781 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:50:54.801781 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:50:54.801781 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:50:54.801781 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:50:54.801781 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:50:54.801781 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:50:54.801781 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 09:50:54.801781 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 09:50:54.801781 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 09:50:54.801781 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 09:50:54.802868 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:50:54.802868 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:50:54.802868 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 09:50:54.802868 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 09:50:54.802868 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 09:50:54.802868 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 09:50:54.802868 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:50:54.802868 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:50:54.802868 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:50:54.802868 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:50:54.802868 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:50:54.802868 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:50:54.802868 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:50:54.802868 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:50:54.802868 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:50:54.802868 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:50:54.802868 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:50:54.802868 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:50:54.804114 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:50:54.804114 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:50:54.804114 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 09:50:54.804114 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 09:50:54.804114 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 09:50:54.804114 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 09:50:54.804114 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 09:50:54.804114 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 09:50:54.804114 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 10 09:50:54.804114 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:50:54.807715 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 296/584] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 10 09:50:54 2022] GET /identity/v3/users/cinder => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:50:54.808516 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e907b9b4-a10e-4100-862d-2890a623b1ec None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:54.818183 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-f0594695-9d26-46dd-bfe3-0dbf57a6ea69 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:50:54.818183 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:50:54.818183 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:50:54.818183 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:50:54.818183 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:50:54.818183 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:50:54.818183 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:50:54.818183 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:50:54.818183 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:50:54.818183 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:50:54.818183 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:50:54.818183 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:50:54.818183 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 09:50:54.818183 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 09:50:54.818183 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 09:50:54.818183 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 09:50:54.819768 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:50:54.819768 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:50:54.819768 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:50:54.819768 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:50:54.819768 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:50:54.819768 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:50:54.819768 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:50:54.819768 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:50:54.819768 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:50:54.819768 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:50:54.819768 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:50:54.819768 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:50:54.819768 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:50:54.819768 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:50:54.819768 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:50:54.819768 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:50:54.819768 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 09:50:54.820792 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 09:50:54.820792 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:50:54.820792 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:50:54.820792 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 289/585] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 10 09:50:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:50:54.821491 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0594695-9d26-46dd-bfe3-0dbf57a6ea69 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:54.867203 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:54.918925 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e907b9b4-a10e-4100-862d-2890a623b1ec None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:54.927790 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0594695-9d26-46dd-bfe3-0dbf57a6ea69 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:54.954148 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7c2d09-da1c-4479-b2f4-3a891609990f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:54.954772 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c2d09-da1c-4479-b2f4-3a891609990f None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:54.955052 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c2d09-da1c-4479-b2f4-3a891609990f None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:54.955323 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c2d09-da1c-4479-b2f4-3a891609990f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:54.962484 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7c2d09-da1c-4479-b2f4-3a891609990f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:54.963845 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdff8ce9-318d-4ded-bc27-30f76183a72c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:54.964070 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7c2d09-da1c-4479-b2f4-3a891609990f None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:54.964471 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdff8ce9-318d-4ded-bc27-30f76183a72c None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:54.964750 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdff8ce9-318d-4ded-bc27-30f76183a72c None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:54.965019 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdff8ce9-318d-4ded-bc27-30f76183a72c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:54.975610 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdff8ce9-318d-4ded-bc27-30f76183a72c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:54.975930 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-2d7c2d09-da1c-4479-b2f4-3a891609990f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 09:50:54.975930 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:50:54.975930 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:50:54.975930 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:50:54.975930 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:50:54.975930 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:50:54.975930 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:50:54.975930 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:50:54.975930 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:50:54.975930 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:50:54.975930 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:50:54.975930 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:50:54.975930 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 09:50:54.975930 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 09:50:54.975930 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 09:50:54.976771 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 09:50:54.976771 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:50:54.976771 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:50:54.976771 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:50:54.976771 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:50:54.976771 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:50:54.976771 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:50:54.976771 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:50:54.976771 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:50:54.976771 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:50:54.976771 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:50:54.976771 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:50:54.976771 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:50:54.976771 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:50:54.976771 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:50:54.976771 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:50:54.976771 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:50:54.977978 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 09:50:54.977978 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 09:50:54.977978 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 09:50:54.977978 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 09:50:54.977978 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 09:50:54.977978 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 09:50:54.977978 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 09:50:54.977978 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:50:54.977978 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 297/586] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 10 09:50:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:50:54.978468 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdff8ce9-318d-4ded-bc27-30f76183a72c None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:54.982563 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7c2d09-da1c-4479-b2f4-3a891609990f None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:54.995604 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-bdff8ce9-318d-4ded-bc27-30f76183a72c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:50:54.995604 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:50:54.995604 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:50:54.995604 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:50:54.995604 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:50:54.995604 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:50:54.995604 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:50:54.995604 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:50:54.995604 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:50:54.995604 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:50:54.995604 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:50:54.995604 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:50:54.995604 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 09:50:54.995604 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 09:50:54.995604 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 09:50:54.995604 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 09:50:54.996561 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:50:54.996561 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:50:54.996561 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:50:54.996561 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:50:54.996561 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:50:54.996561 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:50:54.996561 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:50:54.996561 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:50:54.996561 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:50:54.996561 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:50:54.996561 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:50:54.996561 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:50:54.996561 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:50:54.996561 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:50:54.996561 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:50:54.996561 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:50:54.996561 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 09:50:54.997830 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 09:50:54.997830 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:50:54.997830 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:50:54.997830 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 290/587] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 10 09:50:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:50:54.997830 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdff8ce9-318d-4ded-bc27-30f76183a72c None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:55.013924 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:55.095053 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7c2d09-da1c-4479-b2f4-3a891609990f None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:55.098327 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdff8ce9-318d-4ded-bc27-30f76183a72c None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:55.104804 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:55.131955 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702c58a5-f696-4148-8892-23b9b7515723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:55.132568 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c58a5-f696-4148-8892-23b9b7515723 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:55.132849 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c58a5-f696-4148-8892-23b9b7515723 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:55.133151 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c58a5-f696-4148-8892-23b9b7515723 None admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:55.133889 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702c58a5-f696-4148-8892-23b9b7515723 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:55.134195 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702c58a5-f696-4148-8892-23b9b7515723 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:55.135660 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702c58a5-f696-4148-8892-23b9b7515723 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:55.139345 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb99178-9812-4abc-8389-17b93dfa0312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:55.140003 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb99178-9812-4abc-8389-17b93dfa0312 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:55.140283 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb99178-9812-4abc-8389-17b93dfa0312 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:55.140555 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb99178-9812-4abc-8389-17b93dfa0312 None admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:55.141281 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb99178-9812-4abc-8389-17b93dfa0312 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:55.141587 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb99178-9812-4abc-8389-17b93dfa0312 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:55.143307 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb99178-9812-4abc-8389-17b93dfa0312 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:55.152859 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 298/588] 10.222.0.27 () {56 vars in 1137 bytes} [Wed Aug 10 09:50:54 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:55.153723 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702c58a5-f696-4148-8892-23b9b7515723 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:55.162543 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 291/589] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 10 09:50:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:55.163344 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb99178-9812-4abc-8389-17b93dfa0312 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:55.243008 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:55.259757 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702c58a5-f696-4148-8892-23b9b7515723 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:55.270489 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb99178-9812-4abc-8389-17b93dfa0312 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:55.295013 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182ddce1-87b1-4b02-bc53-cf69437a818c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:55.295701 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182ddce1-87b1-4b02-bc53-cf69437a818c None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:55.295981 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182ddce1-87b1-4b02-bc53-cf69437a818c None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:55.296252 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182ddce1-87b1-4b02-bc53-cf69437a818c None admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:55.296938 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182ddce1-87b1-4b02-bc53-cf69437a818c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:55.297277 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182ddce1-87b1-4b02-bc53-cf69437a818c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:55.298715 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182ddce1-87b1-4b02-bc53-cf69437a818c None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:55.306203 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219ff358-44b2-4646-9631-709ff847ba82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:55.306807 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219ff358-44b2-4646-9631-709ff847ba82 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:55.307087 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219ff358-44b2-4646-9631-709ff847ba82 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:55.307533 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219ff358-44b2-4646-9631-709ff847ba82 None admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:55.307993 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219ff358-44b2-4646-9631-709ff847ba82 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:55.308297 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219ff358-44b2-4646-9631-709ff847ba82 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:55.309733 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219ff358-44b2-4646-9631-709ff847ba82 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:55.315370 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 299/590] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Aug 10 09:50:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:55.315370 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182ddce1-87b1-4b02-bc53-cf69437a818c None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:55.331398 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 292/591] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 10 09:50:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:55.331398 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219ff358-44b2-4646-9631-709ff847ba82 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:55.345933 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:55.425963 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182ddce1-87b1-4b02-bc53-cf69437a818c None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:55.432474 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219ff358-44b2-4646-9631-709ff847ba82 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:55.461458 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0857f632-8097-46b5-bc50-3154cb75df9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:55.462082 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0857f632-8097-46b5-bc50-3154cb75df9f None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:55.462361 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0857f632-8097-46b5-bc50-3154cb75df9f None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:55.462637 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0857f632-8097-46b5-bc50-3154cb75df9f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:55.466642 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f71e30f-ada5-44fc-91ae-79e37b5635b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:55.467268 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f71e30f-ada5-44fc-91ae-79e37b5635b2 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:55.467546 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f71e30f-ada5-44fc-91ae-79e37b5635b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:55.467814 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f71e30f-ada5-44fc-91ae-79e37b5635b2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:55.470167 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:55.473743 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0857f632-8097-46b5-bc50-3154cb75df9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:55.475398 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0857f632-8097-46b5-bc50-3154cb75df9f None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:55.476340 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f71e30f-ada5-44fc-91ae-79e37b5635b2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:55.478368 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f71e30f-ada5-44fc-91ae-79e37b5635b2 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:55.489507 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-6f71e30f-ada5-44fc-91ae-79e37b5635b2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 09:50:55.489507 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:50:55.489507 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:50:55.489507 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:50:55.489507 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:50:55.489507 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:50:55.489507 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:50:55.489507 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:50:55.489507 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:50:55.489507 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:50:55.489507 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:50:55.489507 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:50:55.489507 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 09:50:55.489507 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 09:50:55.489507 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 09:50:55.490396 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 09:50:55.490396 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:50:55.490396 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:50:55.490396 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:50:55.490396 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:50:55.490396 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:50:55.490396 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:50:55.490396 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:50:55.490396 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:50:55.490396 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:50:55.490396 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:50:55.490396 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:50:55.490396 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:50:55.490396 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:50:55.490396 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:50:55.490396 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:50:55.490396 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:50:55.499949 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 09:50:55.499949 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 09:50:55.499949 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 09:50:55.499949 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 09:50:55.499949 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 09:50:55.499949 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 09:50:55.499949 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 09:50:55.499949 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:50:55.500398 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-0857f632-8097-46b5-bc50-3154cb75df9f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:50:55.500398 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:50:55.500398 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:50:55.500398 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:50:55.500398 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:50:55.500398 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:50:55.500398 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:50:55.500398 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:50:55.500398 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:50:55.500398 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:50:55.500398 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:50:55.500398 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:50:55.500398 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 09:50:55.500398 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 09:50:55.500398 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 09:50:55.500398 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 09:50:55.501471 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:50:55.501471 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:50:55.501471 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:50:55.501471 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:50:55.501471 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:50:55.501471 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:50:55.501471 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:50:55.501471 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:50:55.501471 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:50:55.501471 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:50:55.501471 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:50:55.501471 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:50:55.501471 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:50:55.501471 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:50:55.501471 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:50:55.501471 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:50:55.501471 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 09:50:55.502512 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 09:50:55.502512 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:50:55.502512 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:50:55.502688 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 293/592] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 10 09:50:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:50:55.502757 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 300/593] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 10 09:50:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:50:55.502822 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f71e30f-ada5-44fc-91ae-79e37b5635b2 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:55.502889 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0857f632-8097-46b5-bc50-3154cb75df9f None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:55.572757 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:55.594399 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0857f632-8097-46b5-bc50-3154cb75df9f None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:55.596118 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f71e30f-ada5-44fc-91ae-79e37b5635b2 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:55.626954 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e38242-adec-4c1b-816f-9fbcf7e356c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:55.627575 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e38242-adec-4c1b-816f-9fbcf7e356c4 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:55.627853 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e38242-adec-4c1b-816f-9fbcf7e356c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:55.628121 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e38242-adec-4c1b-816f-9fbcf7e356c4 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:55.628226 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f47a39-3aa1-485a-a260-05adac6b00b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:55.628865 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f47a39-3aa1-485a-a260-05adac6b00b8 None admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:55.629176 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f47a39-3aa1-485a-a260-05adac6b00b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:55.629451 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f47a39-3aa1-485a-a260-05adac6b00b8 None admin] PATH_INFO: `/v3/projects/d47d5b72a00642a1a239b785110643ef/users/dd8580888cba41a88566da4540b1130c/roles/c0cf832e3b184857b8eaed2f68da1532` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:55.635454 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e38242-adec-4c1b-816f-9fbcf7e356c4 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:55.636900 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e38242-adec-4c1b-816f-9fbcf7e356c4 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:55.643293 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f47a39-3aa1-485a-a260-05adac6b00b8 None admin] RBAC: Authorizing `identity:create_grant(project_id=d47d5b72a00642a1a239b785110643ef, user_id=dd8580888cba41a88566da4540b1130c, role_id=c0cf832e3b184857b8eaed2f68da1532)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:55.644733 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f47a39-3aa1-485a-a260-05adac6b00b8 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:55.648102 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-03e38242-adec-4c1b-816f-9fbcf7e356c4 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 10 09:50:55.648102 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:50:55.648102 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:50:55.648102 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:50:55.648102 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:50:55.648102 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:50:55.648102 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:50:55.648102 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:50:55.648102 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:50:55.648102 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:50:55.648102 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:50:55.648102 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:50:55.648102 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 09:50:55.648102 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 09:50:55.648102 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 09:50:55.648102 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 09:50:55.649375 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:50:55.649375 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:50:55.649375 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 09:50:55.649375 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 09:50:55.649375 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 09:50:55.649375 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 09:50:55.649375 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:50:55.649375 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:50:55.649375 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:50:55.649375 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:50:55.649375 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:50:55.649375 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:50:55.649375 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:50:55.649375 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:50:55.649375 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:50:55.649375 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:50:55.649375 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:50:55.649375 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:50:55.651021 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:50:55.651021 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:50:55.651021 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 09:50:55.651021 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 09:50:55.651021 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 09:50:55.651021 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 09:50:55.651021 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 09:50:55.651021 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 09:50:55.651021 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 10 09:50:55.651021 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:50:55.651021 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 301/594] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Aug 10 09:50:55 2022] GET /identity/v3/users/neutron => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:50:55.651021 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125bc179-f64e-47e4-9fe5-029fe3008c8a None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:55.651021 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125bc179-f64e-47e4-9fe5-029fe3008c8a None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:55.651864 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125bc179-f64e-47e4-9fe5-029fe3008c8a None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:55.652262 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 302/595] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:50:55 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:50:55.652940 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125bc179-f64e-47e4-9fe5-029fe3008c8a None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:55.665292 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 294/596] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Aug 10 09:50:55 2022] PUT /identity/v3/projects/d47d5b72a00642a1a239b785110643ef/users/dd8580888cba41a88566da4540b1130c/roles/c0cf832e3b184857b8eaed2f68da1532 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 09:50:55.666119 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f47a39-3aa1-485a-a260-05adac6b00b8 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:55.721922 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:55.780310 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125bc179-f64e-47e4-9fe5-029fe3008c8a None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:55.782770 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f47a39-3aa1-485a-a260-05adac6b00b8 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:55.816363 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7408998f-5823-4718-a67e-1c5858db432b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:55.816980 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7408998f-5823-4718-a67e-1c5858db432b None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:55.817278 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7408998f-5823-4718-a67e-1c5858db432b None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:55.817548 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7408998f-5823-4718-a67e-1c5858db432b None admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:55.818252 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7408998f-5823-4718-a67e-1c5858db432b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:55.818905 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7408998f-5823-4718-a67e-1c5858db432b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:55.820481 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7408998f-5823-4718-a67e-1c5858db432b None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:55.824290 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0238e113-31cd-4216-86ee-4e2e2d854f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:55.824907 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0238e113-31cd-4216-86ee-4e2e2d854f45 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:55.825218 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0238e113-31cd-4216-86ee-4e2e2d854f45 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:55.825531 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0238e113-31cd-4216-86ee-4e2e2d854f45 None admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:55.826141 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0238e113-31cd-4216-86ee-4e2e2d854f45 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:55.826457 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0238e113-31cd-4216-86ee-4e2e2d854f45 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:55.827823 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0238e113-31cd-4216-86ee-4e2e2d854f45 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:55.829315 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:55.835076 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 303/597] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Aug 10 09:50:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:55.836232 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7408998f-5823-4718-a67e-1c5858db432b None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:55.842150 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 295/598] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 10 09:50:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:55.843363 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2135d0a6-edaa-4d92-947c-fcbc3cd13e0f None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:55.843651 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2135d0a6-edaa-4d92-947c-fcbc3cd13e0f None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:55.843922 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2135d0a6-edaa-4d92-947c-fcbc3cd13e0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:55.863298 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-2135d0a6-edaa-4d92-947c-fcbc3cd13e0f None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:50:55.864504 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-2135d0a6-edaa-4d92-947c-fcbc3cd13e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:50:55.933117 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 296/599] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:50:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 09:50:55.933117 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2135d0a6-edaa-4d92-947c-fcbc3cd13e0f None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:55.947179 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7408998f-5823-4718-a67e-1c5858db432b None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:55.975040 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:55.986126 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d6e113-311f-45ca-a751-f744460997a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:55.986966 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d6e113-311f-45ca-a751-f744460997a4 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:55.987383 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d6e113-311f-45ca-a751-f744460997a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:55.987792 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d6e113-311f-45ca-a751-f744460997a4 None admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:55.988695 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d6e113-311f-45ca-a751-f744460997a4 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:55.989185 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d6e113-311f-45ca-a751-f744460997a4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:55.990754 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d6e113-311f-45ca-a751-f744460997a4 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:56.009373 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 304/600] 10.222.0.27 () {56 vars in 1139 bytes} [Wed Aug 10 09:50:55 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:56.010549 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d6e113-311f-45ca-a751-f744460997a4 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:56.047877 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2135d0a6-edaa-4d92-947c-fcbc3cd13e0f None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:56.070870 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:56.084724 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78483a67-06ea-4ecc-aad4-6c7e99290998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:56.085492 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78483a67-06ea-4ecc-aad4-6c7e99290998 None admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:56.085765 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78483a67-06ea-4ecc-aad4-6c7e99290998 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:56.086035 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78483a67-06ea-4ecc-aad4-6c7e99290998 None admin] PATH_INFO: `/v3/projects/d47d5b72a00642a1a239b785110643ef/users/f9e7f1ec6ad64b978f8817a5d2a73757/roles/c0cf832e3b184857b8eaed2f68da1532` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:56.100641 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78483a67-06ea-4ecc-aad4-6c7e99290998 None admin] RBAC: Authorizing `identity:create_grant(project_id=d47d5b72a00642a1a239b785110643ef, user_id=f9e7f1ec6ad64b978f8817a5d2a73757, role_id=c0cf832e3b184857b8eaed2f68da1532)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:56.102189 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78483a67-06ea-4ecc-aad4-6c7e99290998 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:56.116986 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 297/601] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Aug 10 09:50:55 2022] PUT /identity/v3/projects/d47d5b72a00642a1a239b785110643ef/users/f9e7f1ec6ad64b978f8817a5d2a73757/roles/c0cf832e3b184857b8eaed2f68da1532 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 09:50:56.117860 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d6e113-311f-45ca-a751-f744460997a4 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:56.118392 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78483a67-06ea-4ecc-aad4-6c7e99290998 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:56.173333 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f1767f-de9c-46d8-b3a2-8d76dc15b57c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:56.174727 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f1767f-de9c-46d8-b3a2-8d76dc15b57c None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:56.175393 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f1767f-de9c-46d8-b3a2-8d76dc15b57c None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:56.176032 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f1767f-de9c-46d8-b3a2-8d76dc15b57c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:56.194459 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f1767f-de9c-46d8-b3a2-8d76dc15b57c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:56.198126 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f1767f-de9c-46d8-b3a2-8d76dc15b57c None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:56.218454 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-29f1767f-de9c-46d8-b3a2-8d76dc15b57c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 09:50:56.218454 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:50:56.218454 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:50:56.218454 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:50:56.218454 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:50:56.218454 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:50:56.218454 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:50:56.218454 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:50:56.218454 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:50:56.218454 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:50:56.218454 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:50:56.218454 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:50:56.218454 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 09:50:56.218454 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 09:50:56.218454 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 09:50:56.219435 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 09:50:56.219435 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:50:56.219435 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:50:56.219435 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:50:56.219435 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:50:56.219435 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:50:56.219435 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:50:56.219435 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:50:56.219435 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:50:56.219435 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:50:56.219435 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:50:56.219435 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:50:56.219435 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:50:56.219435 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:50:56.219435 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:50:56.219435 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:50:56.219435 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:50:56.220651 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 09:50:56.220651 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 09:50:56.220651 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 09:50:56.220651 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 09:50:56.220651 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 09:50:56.220651 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 09:50:56.220651 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 09:50:56.220651 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:50:56.223986 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 305/602] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 10 09:50:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:50:56.224976 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f1767f-de9c-46d8-b3a2-8d76dc15b57c None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:56.261490 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:56.285421 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78483a67-06ea-4ecc-aad4-6c7e99290998 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:56.326148 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dde138-3d7f-4286-ab39-8a0c82c5f3d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:56.326616 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dde138-3d7f-4286-ab39-8a0c82c5f3d0 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:56.326898 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dde138-3d7f-4286-ab39-8a0c82c5f3d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:56.327169 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dde138-3d7f-4286-ab39-8a0c82c5f3d0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:56.338086 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dde138-3d7f-4286-ab39-8a0c82c5f3d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 09:50:56.343157 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-a3dde138-3d7f-4286-ab39-8a0c82c5f3d0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 09:50:56.343157 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:50:56.343157 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:50:56.343157 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:50:56.343157 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:50:56.343157 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:50:56.343157 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:50:56.343157 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:50:56.343157 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:50:56.343157 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:50:56.343157 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:50:56.343157 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:50:56.343157 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 09:50:56.343157 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 09:50:56.343157 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 09:50:56.343157 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 09:50:56.344282 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 09:50:56.344282 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 09:50:56.344282 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 09:50:56.344282 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 09:50:56.344282 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:50:56.344282 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:50:56.344282 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:50:56.344282 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:50:56.344282 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:50:56.344282 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:50:56.344282 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:50:56.344282 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:50:56.344282 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:50:56.344282 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:50:56.344282 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:50:56.344282 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:50:56.345430 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:50:56.345430 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:50:56.345430 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:50:56.345430 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:50:56.345430 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 09:50:56.345430 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 09:50:56.345430 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 09:50:56.345430 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 09:50:56.345430 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 09:50:56.345430 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 09:50:56.345430 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 09:50:56.345430 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:50:56.345430 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 298/603] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Aug 10 09:50:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:50:56.345430 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dde138-3d7f-4286-ab39-8a0c82c5f3d0 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:56.353690 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f1767f-de9c-46d8-b3a2-8d76dc15b57c None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:56.375474 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:56.396849 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3527bb13-13e2-4dac-9451-f3204dfa5ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:56.397545 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3527bb13-13e2-4dac-9451-f3204dfa5ad8 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:56.397821 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3527bb13-13e2-4dac-9451-f3204dfa5ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:56.398087 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3527bb13-13e2-4dac-9451-f3204dfa5ad8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:56.410209 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3527bb13-13e2-4dac-9451-f3204dfa5ad8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:56.411665 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3527bb13-13e2-4dac-9451-f3204dfa5ad8 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:56.427734 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-3527bb13-13e2-4dac-9451-f3204dfa5ad8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:50:56.427734 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:50:56.427734 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:50:56.427734 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:50:56.427734 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:50:56.427734 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:50:56.427734 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:50:56.427734 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:50:56.427734 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:50:56.427734 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:50:56.427734 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:50:56.427734 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:50:56.427734 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 09:50:56.427734 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 09:50:56.427734 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 09:50:56.427734 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 09:50:56.428748 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:50:56.428748 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:50:56.428748 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:50:56.428748 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:50:56.428748 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:50:56.428748 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:50:56.428748 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:50:56.428748 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:50:56.428748 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:50:56.428748 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:50:56.428748 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:50:56.428748 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:50:56.428748 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:50:56.428748 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:50:56.428748 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:50:56.428748 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:50:56.428748 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 09:50:56.430337 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 09:50:56.430337 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:50:56.430337 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:50:56.430337 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 306/604] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 10 09:50:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:50:56.430337 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3527bb13-13e2-4dac-9451-f3204dfa5ad8 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:56.477788 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dde138-3d7f-4286-ab39-8a0c82c5f3d0 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:56.514385 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0b0e38-f6db-4e0a-8ccc-7b6f80234a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:56.515145 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b0e38-f6db-4e0a-8ccc-7b6f80234a74 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:56.515427 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b0e38-f6db-4e0a-8ccc-7b6f80234a74 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:56.515696 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b0e38-f6db-4e0a-8ccc-7b6f80234a74 None admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:56.516392 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0b0e38-f6db-4e0a-8ccc-7b6f80234a74 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:56.516707 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0b0e38-f6db-4e0a-8ccc-7b6f80234a74 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:56.519107 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0b0e38-f6db-4e0a-8ccc-7b6f80234a74 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:56.537177 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 299/605] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Aug 10 09:50:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:56.538574 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0b0e38-f6db-4e0a-8ccc-7b6f80234a74 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:56.548884 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:56.562245 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3527bb13-13e2-4dac-9451-f3204dfa5ad8 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:56.600948 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f15a7f7-4442-49b8-b8a2-fcefb296b4db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:56.602431 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f15a7f7-4442-49b8-b8a2-fcefb296b4db None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:56.602988 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f15a7f7-4442-49b8-b8a2-fcefb296b4db None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:56.603570 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f15a7f7-4442-49b8-b8a2-fcefb296b4db None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:56.604541 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f15a7f7-4442-49b8-b8a2-fcefb296b4db None admin] RBAC: Adding query filter params (name=service) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:56.605037 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f15a7f7-4442-49b8-b8a2-fcefb296b4db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:56.606634 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f15a7f7-4442-49b8-b8a2-fcefb296b4db None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:56.615491 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 307/606] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Aug 10 09:50:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:56.616339 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f15a7f7-4442-49b8-b8a2-fcefb296b4db None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:56.647620 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:56.652407 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0b0e38-f6db-4e0a-8ccc-7b6f80234a74 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:56.719560 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaea192-a603-4018-a951-68c869f0481b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:56.720543 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaea192-a603-4018-a951-68c869f0481b None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:56.720999 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaea192-a603-4018-a951-68c869f0481b None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:56.721439 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaea192-a603-4018-a951-68c869f0481b None admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:56.722242 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaea192-a603-4018-a951-68c869f0481b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:56.722693 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaea192-a603-4018-a951-68c869f0481b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:56.724286 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaea192-a603-4018-a951-68c869f0481b None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:56.745942 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 300/607] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 10 09:50:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:56.747686 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaea192-a603-4018-a951-68c869f0481b None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:56.759604 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f15a7f7-4442-49b8-b8a2-fcefb296b4db None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:56.832958 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf08f9b-7eed-4bed-9345-bddf59821ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:56.833676 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf08f9b-7eed-4bed-9345-bddf59821ddb None admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:56.833955 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf08f9b-7eed-4bed-9345-bddf59821ddb None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:56.834229 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf08f9b-7eed-4bed-9345-bddf59821ddb None admin] PATH_INFO: `/v3/projects/d47d5b72a00642a1a239b785110643ef/users/bbf8e725cbe0403d943b136235eac057/roles/c0cf832e3b184857b8eaed2f68da1532` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:56.858062 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf08f9b-7eed-4bed-9345-bddf59821ddb None admin] RBAC: Authorizing `identity:create_grant(project_id=d47d5b72a00642a1a239b785110643ef, user_id=bbf8e725cbe0403d943b136235eac057, role_id=c0cf832e3b184857b8eaed2f68da1532)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:56.859518 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf08f9b-7eed-4bed-9345-bddf59821ddb None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:56.884840 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:56.893227 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 308/608] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Aug 10 09:50:56 2022] PUT /identity/v3/projects/d47d5b72a00642a1a239b785110643ef/users/bbf8e725cbe0403d943b136235eac057/roles/c0cf832e3b184857b8eaed2f68da1532 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 09:50:56.894292 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf08f9b-7eed-4bed-9345-bddf59821ddb None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:56.897800 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaea192-a603-4018-a951-68c869f0481b None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:56.940207 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffed1fa9-18ee-4677-ae84-ba1d6b30e301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:56.942147 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffed1fa9-18ee-4677-ae84-ba1d6b30e301 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:56.942678 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffed1fa9-18ee-4677-ae84-ba1d6b30e301 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:56.943144 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffed1fa9-18ee-4677-ae84-ba1d6b30e301 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:56.959694 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffed1fa9-18ee-4677-ae84-ba1d6b30e301 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:56.962109 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffed1fa9-18ee-4677-ae84-ba1d6b30e301 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:56.983862 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-ffed1fa9-18ee-4677-ae84-ba1d6b30e301 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:50:56.983862 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:50:56.983862 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:50:56.983862 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:50:56.983862 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:50:56.983862 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:50:56.983862 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:50:56.983862 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:50:56.983862 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:50:56.983862 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:50:56.983862 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:50:56.983862 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:50:56.983862 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 09:50:56.983862 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 09:50:56.983862 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 09:50:56.983862 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 09:50:56.984897 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:50:56.984897 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:50:56.984897 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:50:56.984897 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:50:56.984897 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:50:56.984897 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:50:56.984897 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:50:56.984897 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:50:56.984897 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:50:56.984897 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:50:56.984897 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:50:56.984897 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:50:56.984897 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:50:56.984897 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:50:56.984897 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:50:56.984897 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:50:56.984897 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 09:50:56.986078 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 09:50:56.986078 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:50:56.986078 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:50:56.990064 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 301/609] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 10 09:50:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:50:56.994154 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffed1fa9-18ee-4677-ae84-ba1d6b30e301 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:57.148436 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffed1fa9-18ee-4677-ae84-ba1d6b30e301 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:57.177513 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:57.195492 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:57.208552 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dee908-0171-452f-8c86-f58e89c5af5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:57.210566 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dee908-0171-452f-8c86-f58e89c5af5a None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:57.211054 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dee908-0171-452f-8c86-f58e89c5af5a None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:57.211858 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dee908-0171-452f-8c86-f58e89c5af5a None admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:57.213955 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dee908-0171-452f-8c86-f58e89c5af5a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:57.215500 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dee908-0171-452f-8c86-f58e89c5af5a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:57.217626 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dee908-0171-452f-8c86-f58e89c5af5a None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:57.243918 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 302/610] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 10 09:50:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:57.249583 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dee908-0171-452f-8c86-f58e89c5af5a None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:57.250984 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf08f9b-7eed-4bed-9345-bddf59821ddb None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:57.302038 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a00a5e-f644-48a6-9dc1-c08c18a4164c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:57.303744 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a00a5e-f644-48a6-9dc1-c08c18a4164c None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:57.304361 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a00a5e-f644-48a6-9dc1-c08c18a4164c None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:57.304834 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a00a5e-f644-48a6-9dc1-c08c18a4164c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:57.319730 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a00a5e-f644-48a6-9dc1-c08c18a4164c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:57.322264 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a00a5e-f644-48a6-9dc1-c08c18a4164c None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:57.345550 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-60a00a5e-f644-48a6-9dc1-c08c18a4164c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 09:50:57.345550 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:50:57.345550 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:50:57.345550 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:50:57.345550 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:50:57.345550 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:50:57.345550 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:50:57.345550 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:50:57.345550 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:50:57.345550 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:50:57.345550 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:50:57.345550 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:50:57.345550 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 09:50:57.345550 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 09:50:57.345550 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 09:50:57.346528 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 09:50:57.346528 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:50:57.346528 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:50:57.346528 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:50:57.346528 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:50:57.346528 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:50:57.346528 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:50:57.346528 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:50:57.346528 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:50:57.346528 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:50:57.346528 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:50:57.346528 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:50:57.346528 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:50:57.346528 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:50:57.346528 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:50:57.346528 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:50:57.346528 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:50:57.347405 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 09:50:57.347405 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 09:50:57.347405 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 09:50:57.347405 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 09:50:57.347405 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 09:50:57.347405 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 09:50:57.347405 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 09:50:57.347405 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:50:57.356398 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 309/611] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 10 09:50:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 463 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:50:57.361933 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a00a5e-f644-48a6-9dc1-c08c18a4164c None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:57.399638 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dee908-0171-452f-8c86-f58e89c5af5a None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:57.438236 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce3af7d-e479-40e2-8c74-23f2c1af43c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:57.439257 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce3af7d-e479-40e2-8c74-23f2c1af43c9 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:57.439747 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce3af7d-e479-40e2-8c74-23f2c1af43c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:57.440235 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce3af7d-e479-40e2-8c74-23f2c1af43c9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:57.448435 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce3af7d-e479-40e2-8c74-23f2c1af43c9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:57.450195 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce3af7d-e479-40e2-8c74-23f2c1af43c9 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:57.462513 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-4ce3af7d-e479-40e2-8c74-23f2c1af43c9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 10 09:50:57.462513 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:50:57.462513 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:50:57.462513 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:50:57.462513 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:50:57.462513 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:50:57.462513 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:50:57.462513 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:50:57.462513 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:50:57.462513 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:50:57.462513 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:50:57.462513 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:50:57.462513 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 09:50:57.462513 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 09:50:57.462513 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 09:50:57.462513 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 09:50:57.463490 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:50:57.463490 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:50:57.463490 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 09:50:57.463490 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 09:50:57.463490 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 09:50:57.463490 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 09:50:57.463490 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:50:57.463490 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:50:57.463490 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:50:57.463490 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:50:57.463490 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:50:57.463490 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:50:57.463490 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:50:57.463490 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:50:57.463490 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:50:57.463490 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:50:57.463490 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:50:57.463490 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:50:57.464435 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:50:57.464435 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:50:57.464435 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 09:50:57.464435 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 09:50:57.464435 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 09:50:57.464435 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 09:50:57.464435 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 09:50:57.464435 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 09:50:57.464435 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 10 09:50:57.464435 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:50:57.466751 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 303/612] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Aug 10 09:50:57 2022] GET /identity/v3/users/swift => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 09:50:57.477146 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce3af7d-e479-40e2-8c74-23f2c1af43c9 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:57.537464 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:57.576566 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a00a5e-f644-48a6-9dc1-c08c18a4164c None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:57.626487 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa219a9-4bd4-4f91-9cc2-cadcc678f033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:57.627183 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa219a9-4bd4-4f91-9cc2-cadcc678f033 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:57.627419 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa219a9-4bd4-4f91-9cc2-cadcc678f033 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:57.627627 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa219a9-4bd4-4f91-9cc2-cadcc678f033 None admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:57.628323 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa219a9-4bd4-4f91-9cc2-cadcc678f033 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:57.628625 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa219a9-4bd4-4f91-9cc2-cadcc678f033 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:57.630093 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa219a9-4bd4-4f91-9cc2-cadcc678f033 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:57.643071 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 310/613] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Aug 10 09:50:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 09:50:57.643527 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:57.649163 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa219a9-4bd4-4f91-9cc2-cadcc678f033 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:57.665141 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce3af7d-e479-40e2-8c74-23f2c1af43c9 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:57.728572 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180080fc-879e-40ad-912d-d7c34ad8886b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:57.729263 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180080fc-879e-40ad-912d-d7c34ad8886b None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:57.729627 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180080fc-879e-40ad-912d-d7c34ad8886b None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:57.729895 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180080fc-879e-40ad-912d-d7c34ad8886b None admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:57.730639 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180080fc-879e-40ad-912d-d7c34ad8886b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:57.730944 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180080fc-879e-40ad-912d-d7c34ad8886b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:57.732388 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180080fc-879e-40ad-912d-d7c34ad8886b None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:57.755844 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 304/614] 10.222.0.27 () {56 vars in 1135 bytes} [Wed Aug 10 09:50:57 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:57.761128 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4d5887-257a-418b-a1ca-b7469be6f24f None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:57.761652 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4d5887-257a-418b-a1ca-b7469be6f24f None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:57.762900 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4d5887-257a-418b-a1ca-b7469be6f24f None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:57.764374 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 305/615] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:50:57 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:50:57.767867 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4d5887-257a-418b-a1ca-b7469be6f24f None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:57.800528 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa219a9-4bd4-4f91-9cc2-cadcc678f033 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:57.844308 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca541e9-363f-4683-877c-34ef68503b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:57.844972 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca541e9-363f-4683-877c-34ef68503b5d None admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:57.845295 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca541e9-363f-4683-877c-34ef68503b5d None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:57.845566 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca541e9-363f-4683-877c-34ef68503b5d None admin] PATH_INFO: `/v3/projects/d47d5b72a00642a1a239b785110643ef/users/4294c170df354fe892831281acd4ea7d/roles/c0cf832e3b184857b8eaed2f68da1532` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:57.863525 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca541e9-363f-4683-877c-34ef68503b5d None admin] RBAC: Authorizing `identity:create_grant(project_id=d47d5b72a00642a1a239b785110643ef, user_id=4294c170df354fe892831281acd4ea7d, role_id=c0cf832e3b184857b8eaed2f68da1532)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:57.864380 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca541e9-363f-4683-877c-34ef68503b5d None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:57.885566 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 311/616] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Aug 10 09:50:57 2022] PUT /identity/v3/projects/d47d5b72a00642a1a239b785110643ef/users/4294c170df354fe892831281acd4ea7d/roles/c0cf832e3b184857b8eaed2f68da1532 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 09:50:57.887142 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67ae450-58f3-4498-a6fa-3de0c201ea9c None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:57.887480 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67ae450-58f3-4498-a6fa-3de0c201ea9c None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:57.887763 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67ae450-58f3-4498-a6fa-3de0c201ea9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:57.895709 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:57.902141 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4d5887-257a-418b-a1ca-b7469be6f24f None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:57.924029 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-d67ae450-58f3-4498-a6fa-3de0c201ea9c None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:50:57.925350 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-d67ae450-58f3-4498-a6fa-3de0c201ea9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:50:57.942754 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1398b3e8-1f18-4d6e-82b2-458955372435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:57.944123 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1398b3e8-1f18-4d6e-82b2-458955372435 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:57.944812 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1398b3e8-1f18-4d6e-82b2-458955372435 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:57.945316 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1398b3e8-1f18-4d6e-82b2-458955372435 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:57.957022 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1398b3e8-1f18-4d6e-82b2-458955372435 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:57.958978 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1398b3e8-1f18-4d6e-82b2-458955372435 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:57.975264 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-1398b3e8-1f18-4d6e-82b2-458955372435 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:50:57.975264 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:50:57.975264 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:50:57.975264 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:50:57.975264 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:50:57.975264 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:50:57.975264 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:50:57.975264 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:50:57.975264 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:50:57.975264 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:50:57.975264 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:50:57.975264 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:50:57.975264 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 09:50:57.975264 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 09:50:57.975264 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 09:50:57.975264 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 09:50:57.976374 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:50:57.976374 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:50:57.976374 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:50:57.976374 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:50:57.976374 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:50:57.976374 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:50:57.976374 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:50:57.976374 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:50:57.976374 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:50:57.976374 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:50:57.976374 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:50:57.976374 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:50:57.976374 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:50:57.976374 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:50:57.976374 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:50:57.976374 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:50:57.976374 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 09:50:57.977298 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 09:50:57.977298 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:50:57.977298 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:50:57.979699 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 306/617] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 10 09:50:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:50:57.987194 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1398b3e8-1f18-4d6e-82b2-458955372435 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:58.003479 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:58.031309 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 312/618] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:50:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 09:50:58.094647 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67ae450-58f3-4498-a6fa-3de0c201ea9c None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:58.157750 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1398b3e8-1f18-4d6e-82b2-458955372435 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:58.194561 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7973e7-8165-422d-94e6-357c03e00806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:58.195413 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7973e7-8165-422d-94e6-357c03e00806 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:58.195837 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7973e7-8165-422d-94e6-357c03e00806 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:58.196252 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7973e7-8165-422d-94e6-357c03e00806 None admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:58.198738 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7973e7-8165-422d-94e6-357c03e00806 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:58.199276 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7973e7-8165-422d-94e6-357c03e00806 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:58.200852 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7973e7-8165-422d-94e6-357c03e00806 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:58.214205 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 307/619] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 10 09:50:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:58.220049 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7973e7-8165-422d-94e6-357c03e00806 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:58.225695 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67ae450-58f3-4498-a6fa-3de0c201ea9c None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:58.230443 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:58.266256 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a132ed-6433-4299-94f1-966523f9c79f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:58.267273 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a132ed-6433-4299-94f1-966523f9c79f None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:58.267825 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a132ed-6433-4299-94f1-966523f9c79f None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:58.268315 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a132ed-6433-4299-94f1-966523f9c79f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:58.281173 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a132ed-6433-4299-94f1-966523f9c79f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 09:50:58.287221 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-82a132ed-6433-4299-94f1-966523f9c79f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 09:50:58.287221 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:50:58.287221 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:50:58.287221 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:50:58.287221 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:50:58.287221 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:50:58.287221 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:50:58.287221 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:50:58.287221 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:50:58.287221 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:50:58.287221 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:50:58.287221 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:50:58.287221 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 09:50:58.287221 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 09:50:58.287221 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 09:50:58.287221 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 09:50:58.288178 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 09:50:58.288178 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 09:50:58.288178 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 09:50:58.288178 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 09:50:58.288178 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:50:58.288178 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:50:58.288178 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:50:58.288178 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:50:58.288178 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:50:58.288178 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:50:58.288178 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:50:58.288178 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:50:58.288178 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:50:58.288178 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:50:58.288178 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:50:58.288178 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:50:58.289864 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:50:58.289864 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:50:58.289864 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:50:58.289864 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:50:58.289864 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 09:50:58.289864 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 09:50:58.289864 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 09:50:58.289864 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 09:50:58.289864 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 09:50:58.289864 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 09:50:58.289864 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 09:50:58.289864 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:50:58.292340 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 313/620] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Aug 10 09:50:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 09:50:58.298646 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a132ed-6433-4299-94f1-966523f9c79f None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:58.334384 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7973e7-8165-422d-94e6-357c03e00806 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:58.345810 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:58.374399 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6517ce5a-fc8e-42ea-a944-bbc7cf00957e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:58.374814 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6517ce5a-fc8e-42ea-a944-bbc7cf00957e None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:58.374985 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6517ce5a-fc8e-42ea-a944-bbc7cf00957e None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:58.375238 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6517ce5a-fc8e-42ea-a944-bbc7cf00957e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:58.382928 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6517ce5a-fc8e-42ea-a944-bbc7cf00957e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:58.384416 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6517ce5a-fc8e-42ea-a944-bbc7cf00957e None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:58.404109 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-6517ce5a-fc8e-42ea-a944-bbc7cf00957e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 09:50:58.404109 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:50:58.404109 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:50:58.404109 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:50:58.404109 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:50:58.404109 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:50:58.404109 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:50:58.404109 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:50:58.404109 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:50:58.404109 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:50:58.404109 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:50:58.404109 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:50:58.404109 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 09:50:58.404109 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 09:50:58.404109 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 09:50:58.405120 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 09:50:58.405120 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:50:58.405120 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:50:58.405120 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:50:58.405120 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:50:58.405120 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:50:58.405120 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:50:58.405120 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:50:58.405120 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:50:58.405120 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:50:58.405120 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:50:58.405120 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:50:58.405120 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:50:58.405120 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:50:58.405120 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:50:58.405120 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:50:58.405120 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:50:58.406020 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 09:50:58.406020 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 09:50:58.406020 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 09:50:58.406020 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 09:50:58.406020 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 09:50:58.406020 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 09:50:58.406020 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 09:50:58.406020 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:50:58.413646 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 308/621] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 10 09:50:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 09:50:58.414102 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a132ed-6433-4299-94f1-966523f9c79f None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:58.419706 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6517ce5a-fc8e-42ea-a944-bbc7cf00957e None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:58.457421 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf82649-7838-4638-9875-e9302231fbdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:58.458632 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf82649-7838-4638-9875-e9302231fbdd None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:58.459521 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf82649-7838-4638-9875-e9302231fbdd None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:58.460208 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf82649-7838-4638-9875-e9302231fbdd None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:58.461160 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf82649-7838-4638-9875-e9302231fbdd None admin] RBAC: Adding query filter params (name=service) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:58.461877 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf82649-7838-4638-9875-e9302231fbdd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:58.464104 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf82649-7838-4638-9875-e9302231fbdd None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:58.475375 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 314/622] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Aug 10 09:50:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:58.481097 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f085ff-dbea-48e8-92b5-5e9f5a834009 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:58.481097 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f085ff-dbea-48e8-92b5-5e9f5a834009 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:58.481097 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f085ff-dbea-48e8-92b5-5e9f5a834009 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:58.485150 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 315/623] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:50:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:50:58.486608 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f085ff-dbea-48e8-92b5-5e9f5a834009 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:58.517004 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:58.563935 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6517ce5a-fc8e-42ea-a944-bbc7cf00957e None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:58.608189 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a53e107-ee90-4648-a103-e69cdac77746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:58.608841 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f085ff-dbea-48e8-92b5-5e9f5a834009 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:58.609449 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a53e107-ee90-4648-a103-e69cdac77746 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:58.609928 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a53e107-ee90-4648-a103-e69cdac77746 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:58.610502 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:58.610887 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a53e107-ee90-4648-a103-e69cdac77746 None admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:58.612160 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a53e107-ee90-4648-a103-e69cdac77746 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:58.612666 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a53e107-ee90-4648-a103-e69cdac77746 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:58.614344 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a53e107-ee90-4648-a103-e69cdac77746 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:58.628348 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 309/624] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Aug 10 09:50:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 09:50:58.629871 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00678720-7c2e-47e9-9b26-1fc9acd68cbd None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:58.630380 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00678720-7c2e-47e9-9b26-1fc9acd68cbd None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:58.630876 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00678720-7c2e-47e9-9b26-1fc9acd68cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:58.646730 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d806e992-b6a3-4584-bafa-0caee5a2f1c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:58.648011 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d806e992-b6a3-4584-bafa-0caee5a2f1c7 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:58.648478 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d806e992-b6a3-4584-bafa-0caee5a2f1c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:58.648805 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-00678720-7c2e-47e9-9b26-1fc9acd68cbd None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:50:58.649101 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d806e992-b6a3-4584-bafa-0caee5a2f1c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:58.650376 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-00678720-7c2e-47e9-9b26-1fc9acd68cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:50:58.660577 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d806e992-b6a3-4584-bafa-0caee5a2f1c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:58.662447 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d806e992-b6a3-4584-bafa-0caee5a2f1c7 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:58.680477 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-d806e992-b6a3-4584-bafa-0caee5a2f1c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:50:58.680477 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:50:58.680477 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:50:58.680477 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:50:58.680477 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:50:58.680477 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:50:58.680477 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:50:58.680477 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:50:58.680477 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:50:58.680477 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:50:58.680477 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:50:58.680477 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:50:58.680477 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 09:50:58.680477 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 09:50:58.680477 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 09:50:58.680477 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 09:50:58.681683 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:50:58.681683 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:50:58.681683 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:50:58.681683 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:50:58.681683 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:50:58.681683 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:50:58.681683 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:50:58.681683 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:50:58.681683 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:50:58.681683 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:50:58.681683 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:50:58.681683 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:50:58.681683 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:50:58.681683 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:50:58.681683 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:50:58.681683 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:50:58.681683 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 09:50:58.682732 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 09:50:58.682732 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:50:58.682732 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:50:58.684881 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 316/625] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 10 09:50:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:50:58.685878 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d806e992-b6a3-4584-bafa-0caee5a2f1c7 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:58.730776 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 310/626] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:50:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 09:50:58.732304 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00678720-7c2e-47e9-9b26-1fc9acd68cbd None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:58.804909 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:58.831464 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d806e992-b6a3-4584-bafa-0caee5a2f1c7 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:58.855300 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00678720-7c2e-47e9-9b26-1fc9acd68cbd None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:58.880432 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6aa071-23f3-4dea-bc82-b2d1ec71c853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:58.881548 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6aa071-23f3-4dea-bc82-b2d1ec71c853 None admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:58.881996 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6aa071-23f3-4dea-bc82-b2d1ec71c853 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:58.882364 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6aa071-23f3-4dea-bc82-b2d1ec71c853 None admin] PATH_INFO: `/v3/projects/d47d5b72a00642a1a239b785110643ef/users/b801551d29ff4687ab8c1ce8cfa51614/roles/c0cf832e3b184857b8eaed2f68da1532` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:58.895610 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb1aa63-129c-4c4d-bdec-da3171913ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:58.896439 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb1aa63-129c-4c4d-bdec-da3171913ffa None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:58.896943 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb1aa63-129c-4c4d-bdec-da3171913ffa None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:58.897435 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb1aa63-129c-4c4d-bdec-da3171913ffa None admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:58.898315 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb1aa63-129c-4c4d-bdec-da3171913ffa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:58.898793 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb1aa63-129c-4c4d-bdec-da3171913ffa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:58.900320 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb1aa63-129c-4c4d-bdec-da3171913ffa None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:58.900939 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6aa071-23f3-4dea-bc82-b2d1ec71c853 None admin] RBAC: Authorizing `identity:create_grant(project_id=d47d5b72a00642a1a239b785110643ef, user_id=b801551d29ff4687ab8c1ce8cfa51614, role_id=c0cf832e3b184857b8eaed2f68da1532)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:58.902777 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6aa071-23f3-4dea-bc82-b2d1ec71c853 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:58.914538 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 311/627] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 10 09:50:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:58.915751 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb1aa63-129c-4c4d-bdec-da3171913ffa None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:58.926628 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 317/628] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Aug 10 09:50:58 2022] PUT /identity/v3/projects/d47d5b72a00642a1a239b785110643ef/users/b801551d29ff4687ab8c1ce8cfa51614/roles/c0cf832e3b184857b8eaed2f68da1532 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 09:50:58.927607 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6aa071-23f3-4dea-bc82-b2d1ec71c853 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:58.934539 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:59.048549 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6aa071-23f3-4dea-bc82-b2d1ec71c853 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:59.054811 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb1aa63-129c-4c4d-bdec-da3171913ffa None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:59.093405 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:59.115210 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bb2c9e-2078-4810-b67c-9bb59fdbb67b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:59.115869 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bb2c9e-2078-4810-b67c-9bb59fdbb67b None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:59.116235 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bb2c9e-2078-4810-b67c-9bb59fdbb67b None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:59.116512 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bb2c9e-2078-4810-b67c-9bb59fdbb67b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:59.122586 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd1a9f4-8401-429f-a7d7-33bb9589dc7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:59.123240 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd1a9f4-8401-429f-a7d7-33bb9589dc7e None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:59.123520 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd1a9f4-8401-429f-a7d7-33bb9589dc7e None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:59.125395 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd1a9f4-8401-429f-a7d7-33bb9589dc7e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:59.135771 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bb2c9e-2078-4810-b67c-9bb59fdbb67b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:59.137292 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bb2c9e-2078-4810-b67c-9bb59fdbb67b None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:59.154949 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd1a9f4-8401-429f-a7d7-33bb9589dc7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 09:50:59.156886 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-90bb2c9e-2078-4810-b67c-9bb59fdbb67b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 10 09:50:59.156886 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:50:59.156886 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:50:59.156886 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:50:59.156886 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:50:59.156886 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:50:59.156886 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:50:59.156886 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:50:59.156886 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:50:59.156886 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:50:59.156886 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:50:59.156886 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:50:59.156886 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 09:50:59.156886 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 09:50:59.156886 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 09:50:59.156886 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 09:50:59.157924 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:50:59.157924 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:50:59.157924 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 09:50:59.157924 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 09:50:59.157924 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 09:50:59.157924 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 09:50:59.157924 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:50:59.157924 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:50:59.157924 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:50:59.157924 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:50:59.157924 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:50:59.157924 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:50:59.157924 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:50:59.157924 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:50:59.157924 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:50:59.157924 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:50:59.157924 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:50:59.157924 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:50:59.158853 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:50:59.158853 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:50:59.158853 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 09:50:59.158853 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 09:50:59.158853 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 09:50:59.158853 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 09:50:59.158853 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 09:50:59.158853 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 09:50:59.158853 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 10 09:50:59.158853 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:50:59.158853 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 318/629] 10.222.0.27 () {56 vars in 1093 bytes} [Wed Aug 10 09:50:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:50:59.160255 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-5dd1a9f4-8401-429f-a7d7-33bb9589dc7e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 09:50:59.160255 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:50:59.160255 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:50:59.160255 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:50:59.160255 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:50:59.160255 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:50:59.160255 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:50:59.160255 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:50:59.160255 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:50:59.160255 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:50:59.160255 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:50:59.160255 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:50:59.160255 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 09:50:59.160255 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 09:50:59.160255 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 09:50:59.160255 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 09:50:59.161287 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 09:50:59.161287 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 09:50:59.161287 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 09:50:59.161287 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 09:50:59.161287 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:50:59.161287 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:50:59.161287 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:50:59.161287 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:50:59.161287 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:50:59.161287 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:50:59.161287 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:50:59.161287 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:50:59.161287 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:50:59.161287 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:50:59.161287 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:50:59.161287 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:50:59.162163 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:50:59.162163 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:50:59.162163 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:50:59.162163 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:50:59.162163 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 09:50:59.162163 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 09:50:59.162163 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 09:50:59.162163 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 09:50:59.162163 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 09:50:59.162163 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 09:50:59.162163 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 09:50:59.162163 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:50:59.165198 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bb2c9e-2078-4810-b67c-9bb59fdbb67b None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:59.168548 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 312/630] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Aug 10 09:50:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:50:59.175245 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd1a9f4-8401-429f-a7d7-33bb9589dc7e None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:59.246349 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:59.305309 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bb2c9e-2078-4810-b67c-9bb59fdbb67b None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:59.335881 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd1a9f4-8401-429f-a7d7-33bb9589dc7e None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:59.367774 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067946a0-e8ef-4646-8083-36f1ad14d5e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:59.368393 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067946a0-e8ef-4646-8083-36f1ad14d5e0 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:59.368664 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067946a0-e8ef-4646-8083-36f1ad14d5e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:59.368932 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067946a0-e8ef-4646-8083-36f1ad14d5e0 None admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:59.369702 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067946a0-e8ef-4646-8083-36f1ad14d5e0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:59.369999 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067946a0-e8ef-4646-8083-36f1ad14d5e0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:59.371444 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067946a0-e8ef-4646-8083-36f1ad14d5e0 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:59.397613 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54f14d2-d435-465f-99d0-0dc6bf224654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:59.398221 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54f14d2-d435-465f-99d0-0dc6bf224654 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:59.398659 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54f14d2-d435-465f-99d0-0dc6bf224654 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:59.398933 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54f14d2-d435-465f-99d0-0dc6bf224654 None admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:59.399621 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54f14d2-d435-465f-99d0-0dc6bf224654 None admin] RBAC: Adding query filter params (name=service) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:59.399914 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54f14d2-d435-465f-99d0-0dc6bf224654 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:59.401326 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54f14d2-d435-465f-99d0-0dc6bf224654 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:59.404605 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 319/631] 10.222.0.27 () {56 vars in 1133 bytes} [Wed Aug 10 09:50:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:59.410022 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067946a0-e8ef-4646-8083-36f1ad14d5e0 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:59.416051 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 313/632] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Aug 10 09:50:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 09:50:59.421280 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54f14d2-d435-465f-99d0-0dc6bf224654 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:59.466279 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:59.531489 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54f14d2-d435-465f-99d0-0dc6bf224654 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:59.532289 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067946a0-e8ef-4646-8083-36f1ad14d5e0 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:59.571498 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab4a6b6-1fac-40ec-afc7-a7c66d1e8a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:59.572639 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab4a6b6-1fac-40ec-afc7-a7c66d1e8a2f None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:59.573240 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab4a6b6-1fac-40ec-afc7-a7c66d1e8a2f None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:59.573703 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab4a6b6-1fac-40ec-afc7-a7c66d1e8a2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:59.574973 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f5659e-6485-4c00-a015-4da72dc2e559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:59.575585 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f5659e-6485-4c00-a015-4da72dc2e559 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:59.575871 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f5659e-6485-4c00-a015-4da72dc2e559 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:59.576146 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f5659e-6485-4c00-a015-4da72dc2e559 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:59.579334 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:59.585716 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab4a6b6-1fac-40ec-afc7-a7c66d1e8a2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:59.587648 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab4a6b6-1fac-40ec-afc7-a7c66d1e8a2f None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:59.652786 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f5659e-6485-4c00-a015-4da72dc2e559 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:59.654334 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f5659e-6485-4c00-a015-4da72dc2e559 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:59.739929 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-2ab4a6b6-1fac-40ec-afc7-a7c66d1e8a2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:50:59.739929 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:50:59.739929 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:50:59.739929 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:50:59.739929 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:50:59.739929 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:50:59.739929 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:50:59.739929 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:50:59.739929 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:50:59.739929 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:50:59.739929 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:50:59.739929 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:50:59.739929 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 09:50:59.739929 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 09:50:59.739929 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 09:50:59.739929 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 09:50:59.741386 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:50:59.741386 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:50:59.741386 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:50:59.741386 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:50:59.741386 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:50:59.741386 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:50:59.741386 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:50:59.741386 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:50:59.741386 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:50:59.741386 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:50:59.741386 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:50:59.741386 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:50:59.741386 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:50:59.741386 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:50:59.741386 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:50:59.741386 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:50:59.741386 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 09:50:59.742477 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 09:50:59.742477 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:50:59.742477 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:50:59.744204 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 314/633] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 10 09:50:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 09:50:59.745550 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a4c8e1-54cb-4687-bc00-fdac9d1e7c0b None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:59.745970 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a4c8e1-54cb-4687-bc00-fdac9d1e7c0b None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:59.746377 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a4c8e1-54cb-4687-bc00-fdac9d1e7c0b None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:59.752001 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 315/634] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:50:59 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:50:59.752924 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a4c8e1-54cb-4687-bc00-fdac9d1e7c0b None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:59.771305 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 320/635] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 10 09:50:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 10 09:50:59.772793 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab80c8b-d7e0-4892-8871-a7b36e55e56a None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:59.773093 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab80c8b-d7e0-4892-8871-a7b36e55e56a None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:59.773376 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab80c8b-d7e0-4892-8871-a7b36e55e56a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:59.793554 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-2ab80c8b-d7e0-4892-8871-a7b36e55e56a None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:50:59.794742 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-2ab80c8b-d7e0-4892-8871-a7b36e55e56a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:50:59.812933 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:59.850034 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:50:59.867975 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a4c8e1-54cb-4687-bc00-fdac9d1e7c0b None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:50:59.877328 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 321/636] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:50:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 09:50:59.878489 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab80c8b-d7e0-4892-8871-a7b36e55e56a None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:50:59.906513 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18edcc9-f068-43e4-b809-ea542b56afab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:50:59.907534 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18edcc9-f068-43e4-b809-ea542b56afab None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:50:59.907645 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18edcc9-f068-43e4-b809-ea542b56afab None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:50:59.907891 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18edcc9-f068-43e4-b809-ea542b56afab None admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:50:59.908682 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18edcc9-f068-43e4-b809-ea542b56afab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:50:59.908983 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18edcc9-f068-43e4-b809-ea542b56afab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:50:59.910596 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18edcc9-f068-43e4-b809-ea542b56afab None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:50:59.930234 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 316/637] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 10 09:50:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:50:59.930234 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18edcc9-f068-43e4-b809-ea542b56afab None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:00.013561 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab80c8b-d7e0-4892-8871-a7b36e55e56a None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:00.035214 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18edcc9-f068-43e4-b809-ea542b56afab None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:00.056509 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a60792-66d3-45b8-8df8-4c2836bb6461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:00.057187 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a60792-66d3-45b8-8df8-4c2836bb6461 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:00.057468 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a60792-66d3-45b8-8df8-4c2836bb6461 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:00.057737 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a60792-66d3-45b8-8df8-4c2836bb6461 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:00.071937 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a60792-66d3-45b8-8df8-4c2836bb6461 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:00.073446 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a60792-66d3-45b8-8df8-4c2836bb6461 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:00.074287 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7c5dc7-62d5-4706-9c35-74907ad009d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:00.075234 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c5dc7-62d5-4706-9c35-74907ad009d8 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:00.075729 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c5dc7-62d5-4706-9c35-74907ad009d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:00.076247 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c5dc7-62d5-4706-9c35-74907ad009d8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:00.087925 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7c5dc7-62d5-4706-9c35-74907ad009d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 09:51:00.090731 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-e6a60792-66d3-45b8-8df8-4c2836bb6461 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:51:00.090731 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:00.090731 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:00.090731 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:00.090731 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:00.090731 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:00.090731 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:00.090731 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:00.090731 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:00.090731 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:00.090731 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:00.090731 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:00.090731 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 09:51:00.090731 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 09:51:00.090731 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 09:51:00.090731 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 09:51:00.091658 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:00.091658 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:00.091658 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:00.091658 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:00.091658 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:00.091658 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:00.091658 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:00.091658 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:00.091658 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:00.091658 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:00.091658 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:00.091658 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:00.091658 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:00.091658 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:00.091658 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:00.091658 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:00.091658 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 09:51:00.092546 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 09:51:00.092546 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:51:00.092546 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:51:00.092546 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 322/638] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 10 09:50:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:51:00.092766 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a60792-66d3-45b8-8df8-4c2836bb6461 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:00.095958 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-df7c5dc7-62d5-4706-9c35-74907ad009d8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 09:51:00.095958 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:00.095958 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:00.095958 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:00.095958 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:00.095958 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:00.095958 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:00.095958 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:00.095958 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:00.095958 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:00.095958 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:00.095958 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:00.095958 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 09:51:00.095958 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 09:51:00.095958 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 09:51:00.095958 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 09:51:00.096931 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 09:51:00.096931 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 09:51:00.096931 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 09:51:00.096931 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 09:51:00.096931 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:00.096931 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:00.096931 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:00.096931 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:00.096931 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:00.096931 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:00.096931 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:00.096931 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:00.096931 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:00.096931 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:00.096931 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:00.096931 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:00.098080 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:00.098080 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:00.098080 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:00.098080 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:00.098080 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 09:51:00.098080 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 09:51:00.098080 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 09:51:00.098080 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 09:51:00.098080 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 09:51:00.098080 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 09:51:00.098080 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 09:51:00.098080 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:51:00.105252 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 317/639] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Aug 10 09:50:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:51:00.106535 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:00.107515 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7c5dc7-62d5-4706-9c35-74907ad009d8 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:00.122404 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:00.217832 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7c5dc7-62d5-4706-9c35-74907ad009d8 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:00.228011 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a60792-66d3-45b8-8df8-4c2836bb6461 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:00.254167 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c46d1e-f075-4133-a060-1d9204aaa948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:00.254929 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c46d1e-f075-4133-a060-1d9204aaa948 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:00.255220 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c46d1e-f075-4133-a060-1d9204aaa948 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:00.255488 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c46d1e-f075-4133-a060-1d9204aaa948 None admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:00.256156 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c46d1e-f075-4133-a060-1d9204aaa948 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:00.256492 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c46d1e-f075-4133-a060-1d9204aaa948 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:00.258086 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c46d1e-f075-4133-a060-1d9204aaa948 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:00.266183 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f381b85-d0a6-483a-b981-6d99d1967d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:00.267279 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f381b85-d0a6-483a-b981-6d99d1967d6e None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:00.267279 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f381b85-d0a6-483a-b981-6d99d1967d6e None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:00.267453 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f381b85-d0a6-483a-b981-6d99d1967d6e None admin] PATH_INFO: `/v3/users/glance` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:00.273886 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 318/640] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 10 09:51:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:00.275071 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c46d1e-f075-4133-a060-1d9204aaa948 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:00.276443 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f381b85-d0a6-483a-b981-6d99d1967d6e None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:00.278109 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f381b85-d0a6-483a-b981-6d99d1967d6e None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:00.290073 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-8f381b85-d0a6-483a-b981-6d99d1967d6e None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 10 09:51:00.290073 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:00.290073 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:00.290073 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:00.290073 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:00.290073 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:00.290073 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:00.290073 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:00.290073 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:00.290073 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:00.290073 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:00.290073 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:00.290073 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 09:51:00.290073 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 09:51:00.290073 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 09:51:00.290073 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 09:51:00.291118 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:00.291118 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:00.291118 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 09:51:00.291118 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 09:51:00.291118 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 09:51:00.291118 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 09:51:00.291118 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:00.291118 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:00.291118 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:00.291118 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:00.291118 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:00.291118 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:00.291118 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:00.291118 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:00.291118 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:00.291118 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:00.291118 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:00.291118 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:00.292060 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:00.292060 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:00.292060 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 09:51:00.292060 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 09:51:00.292060 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 09:51:00.292060 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 09:51:00.292060 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 09:51:00.292060 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 09:51:00.292060 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 10 09:51:00.292060 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:51:00.292060 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 323/641] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 10 09:51:00 2022] GET /identity/v3/users/glance => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:51:00.292651 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79925ed8-6cb6-446a-9ecd-029567b9817a None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:00.292651 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79925ed8-6cb6-446a-9ecd-029567b9817a None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:00.293446 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79925ed8-6cb6-446a-9ecd-029567b9817a None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:00.294331 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 324/642] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:51:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:51:00.299059 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79925ed8-6cb6-446a-9ecd-029567b9817a None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:00.356295 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:00.363685 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:00.391757 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c46d1e-f075-4133-a060-1d9204aaa948 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:00.403429 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79925ed8-6cb6-446a-9ecd-029567b9817a None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:00.426222 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6aaf00-dbd7-458d-809b-f88dcf1d7eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:00.426830 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6aaf00-dbd7-458d-809b-f88dcf1d7eb6 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:00.427106 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6aaf00-dbd7-458d-809b-f88dcf1d7eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:00.427377 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6aaf00-dbd7-458d-809b-f88dcf1d7eb6 None admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:00.428070 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6aaf00-dbd7-458d-809b-f88dcf1d7eb6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:00.428374 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6aaf00-dbd7-458d-809b-f88dcf1d7eb6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:00.429837 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6aaf00-dbd7-458d-809b-f88dcf1d7eb6 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:00.441226 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 319/643] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Aug 10 09:51:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:00.441226 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6aaf00-dbd7-458d-809b-f88dcf1d7eb6 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:00.443889 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f586360-2a9f-4e67-8873-58a18de15bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:00.444561 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f586360-2a9f-4e67-8873-58a18de15bd7 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:00.444834 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f586360-2a9f-4e67-8873-58a18de15bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:00.445122 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f586360-2a9f-4e67-8873-58a18de15bd7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:00.451900 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f586360-2a9f-4e67-8873-58a18de15bd7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:00.453410 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f586360-2a9f-4e67-8873-58a18de15bd7 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:00.464602 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-8f586360-2a9f-4e67-8873-58a18de15bd7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 09:51:00.464602 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:00.464602 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:00.464602 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:00.464602 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:00.464602 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:00.464602 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:00.464602 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:00.464602 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:00.464602 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:00.464602 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:00.464602 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:00.464602 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 09:51:00.464602 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 09:51:00.464602 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 09:51:00.465530 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 09:51:00.465530 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:00.465530 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:00.465530 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:00.465530 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:00.465530 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:00.465530 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:00.465530 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:00.465530 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:00.465530 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:00.465530 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:00.465530 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:00.465530 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:00.465530 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:00.465530 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:00.465530 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:00.465530 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:00.466490 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 09:51:00.466490 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 09:51:00.466490 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 09:51:00.466490 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 09:51:00.466490 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 09:51:00.466490 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 09:51:00.466490 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 09:51:00.466490 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:51:00.466490 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 325/644] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 10 09:51:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:51:00.467057 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5ad66b-9595-40a0-9a74-1a8643b27d37 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:00.467125 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5ad66b-9595-40a0-9a74-1a8643b27d37 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:00.467795 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5ad66b-9595-40a0-9a74-1a8643b27d37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:00.485415 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-1f5ad66b-9595-40a0-9a74-1a8643b27d37 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:51:00.486603 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-1f5ad66b-9595-40a0-9a74-1a8643b27d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:51:00.549919 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6aaf00-dbd7-458d-809b-f88dcf1d7eb6 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:00.557121 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 326/645] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:51:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 09:51:00.558179 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5ad66b-9595-40a0-9a74-1a8643b27d37 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:00.588699 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:00.594725 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e52700-cb06-4ac2-9a56-5e1a1173e9b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:00.595709 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e52700-cb06-4ac2-9a56-5e1a1173e9b3 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:00.596078 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e52700-cb06-4ac2-9a56-5e1a1173e9b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:00.596360 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e52700-cb06-4ac2-9a56-5e1a1173e9b3 None admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:00.597690 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e52700-cb06-4ac2-9a56-5e1a1173e9b3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:00.597690 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e52700-cb06-4ac2-9a56-5e1a1173e9b3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:00.598896 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e52700-cb06-4ac2-9a56-5e1a1173e9b3 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:00.619234 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 320/646] 10.222.0.27 () {56 vars in 1137 bytes} [Wed Aug 10 09:51:00 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:00.620239 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e52700-cb06-4ac2-9a56-5e1a1173e9b3 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:00.624204 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:00.672771 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5ad66b-9595-40a0-9a74-1a8643b27d37 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:00.713816 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15581702-5c60-466a-80b1-630e64a64afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:00.714500 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15581702-5c60-466a-80b1-630e64a64afd None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:00.714725 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15581702-5c60-466a-80b1-630e64a64afd None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:00.714994 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15581702-5c60-466a-80b1-630e64a64afd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:00.725505 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15581702-5c60-466a-80b1-630e64a64afd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:00.726955 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15581702-5c60-466a-80b1-630e64a64afd None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:00.727072 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e52700-cb06-4ac2-9a56-5e1a1173e9b3 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:00.742738 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-15581702-5c60-466a-80b1-630e64a64afd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:51:00.742738 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:00.742738 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:00.742738 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:00.742738 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:00.742738 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:00.742738 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:00.742738 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:00.742738 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:00.742738 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:00.742738 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:00.742738 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:00.742738 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 09:51:00.742738 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 09:51:00.742738 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 09:51:00.742738 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 09:51:00.743910 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:00.743910 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:00.743910 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:00.743910 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:00.743910 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:00.743910 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:00.743910 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:00.743910 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:00.743910 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:00.743910 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:00.743910 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:00.743910 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:00.743910 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:00.743910 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:00.743910 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:00.743910 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:00.743910 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 09:51:00.744991 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 09:51:00.744991 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:51:00.744991 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:51:00.750129 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 327/647] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 10 09:51:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:51:00.750129 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15581702-5c60-466a-80b1-630e64a64afd None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:00.772148 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7546f299-07c3-487c-ad72-d9452d1e77f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:00.772987 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7546f299-07c3-487c-ad72-d9452d1e77f9 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:00.773383 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7546f299-07c3-487c-ad72-d9452d1e77f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:00.773383 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7546f299-07c3-487c-ad72-d9452d1e77f9 None admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:00.774116 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7546f299-07c3-487c-ad72-d9452d1e77f9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:00.774451 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7546f299-07c3-487c-ad72-d9452d1e77f9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:00.775856 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7546f299-07c3-487c-ad72-d9452d1e77f9 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:00.792338 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 321/648] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Aug 10 09:51:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:00.792338 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7546f299-07c3-487c-ad72-d9452d1e77f9 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:00.840463 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:00.856559 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15581702-5c60-466a-80b1-630e64a64afd None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:00.863743 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:00.894068 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7546f299-07c3-487c-ad72-d9452d1e77f9 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:00.895158 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643955c4-f1cf-4e33-8eef-22bd5e87111e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:00.896014 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643955c4-f1cf-4e33-8eef-22bd5e87111e None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:00.896358 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643955c4-f1cf-4e33-8eef-22bd5e87111e None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:00.897437 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643955c4-f1cf-4e33-8eef-22bd5e87111e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:00.915038 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643955c4-f1cf-4e33-8eef-22bd5e87111e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 09:51:00.922133 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-643955c4-f1cf-4e33-8eef-22bd5e87111e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 09:51:00.922133 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:00.922133 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:00.922133 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:00.922133 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:00.922133 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:00.922133 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:00.922133 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:00.922133 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:00.922133 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:00.922133 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:00.922133 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:00.922133 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 09:51:00.922133 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 09:51:00.922133 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 09:51:00.922133 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 09:51:00.923223 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 09:51:00.923223 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 09:51:00.923223 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 09:51:00.923223 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 09:51:00.923223 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:00.923223 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:00.923223 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:00.923223 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:00.923223 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:00.923223 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:00.923223 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:00.923223 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:00.923223 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:00.923223 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:00.923223 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:00.923223 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:00.924281 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:00.924281 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:00.924281 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:00.924281 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:00.924281 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 09:51:00.924281 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 09:51:00.924281 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 09:51:00.924281 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 09:51:00.924281 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 09:51:00.924281 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 09:51:00.924281 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 09:51:00.924281 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:51:00.925106 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 328/649] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Aug 10 09:51:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:51:00.925640 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643955c4-f1cf-4e33-8eef-22bd5e87111e None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:00.937776 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47609fef-f8df-47c8-953b-d92e7eef8c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:00.938770 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47609fef-f8df-47c8-953b-d92e7eef8c4a None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:00.939193 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47609fef-f8df-47c8-953b-d92e7eef8c4a None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:00.939474 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47609fef-f8df-47c8-953b-d92e7eef8c4a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:01.014434 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47609fef-f8df-47c8-953b-d92e7eef8c4a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:01.016053 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47609fef-f8df-47c8-953b-d92e7eef8c4a None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:01.028946 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643955c4-f1cf-4e33-8eef-22bd5e87111e None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:01.064948 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9098d7-82dd-4a19-9ff0-a63fca130749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:01.065815 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9098d7-82dd-4a19-9ff0-a63fca130749 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:01.066241 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9098d7-82dd-4a19-9ff0-a63fca130749 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:01.066386 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:01.066789 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9098d7-82dd-4a19-9ff0-a63fca130749 None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:01.067659 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9098d7-82dd-4a19-9ff0-a63fca130749 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:01.068178 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9098d7-82dd-4a19-9ff0-a63fca130749 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:01.070247 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9098d7-82dd-4a19-9ff0-a63fca130749 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:01.082162 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 329/650] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 10 09:51:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:01.082969 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9098d7-82dd-4a19-9ff0-a63fca130749 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:01.114064 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:01.124522 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 322/651] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 10 09:51:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 09:51:01.125612 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47609fef-f8df-47c8-953b-d92e7eef8c4a None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:01.186868 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9098d7-82dd-4a19-9ff0-a63fca130749 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:01.223161 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850047d9-4c9e-4721-95a5-330295af25a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:01.223769 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850047d9-4c9e-4721-95a5-330295af25a5 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:01.224051 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850047d9-4c9e-4721-95a5-330295af25a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:01.224322 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850047d9-4c9e-4721-95a5-330295af25a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:01.225051 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850047d9-4c9e-4721-95a5-330295af25a5 None admin] RBAC: Adding query filter params (role.id=c0cf832e3b184857b8eaed2f68da1532, scope.project.id=d47d5b72a00642a1a239b785110643ef, user.id=dd8580888cba41a88566da4540b1130c) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:01.225389 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850047d9-4c9e-4721-95a5-330295af25a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:01.226382 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47609fef-f8df-47c8-953b-d92e7eef8c4a None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:01.226811 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850047d9-4c9e-4721-95a5-330295af25a5 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:01.232651 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 330/652] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 10 09:51:01 2022] GET /identity/v3/role_assignments?user.id=dd8580888cba41a88566da4540b1130c&scope.project.id=d47d5b72a00642a1a239b785110643ef&role.id=c0cf832e3b184857b8eaed2f68da1532 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:01.233562 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850047d9-4c9e-4721-95a5-330295af25a5 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:01.268973 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bc957f-bf9b-4578-8d0f-8a9e42040e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:01.269990 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bc957f-bf9b-4578-8d0f-8a9e42040e40 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:01.270729 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bc957f-bf9b-4578-8d0f-8a9e42040e40 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:01.272179 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bc957f-bf9b-4578-8d0f-8a9e42040e40 None admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:01.273247 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bc957f-bf9b-4578-8d0f-8a9e42040e40 None admin] RBAC: Adding query filter params (name=service) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:01.273765 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bc957f-bf9b-4578-8d0f-8a9e42040e40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:01.275353 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bc957f-bf9b-4578-8d0f-8a9e42040e40 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:01.290230 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 323/653] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Aug 10 09:51:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:01.292690 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bc957f-bf9b-4578-8d0f-8a9e42040e40 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:01.313951 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:01.338707 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:01.350688 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850047d9-4c9e-4721-95a5-330295af25a5 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:01.387809 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159af66a-5842-4b3b-b381-4e319b8ef846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:01.388959 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159af66a-5842-4b3b-b381-4e319b8ef846 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:01.388959 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159af66a-5842-4b3b-b381-4e319b8ef846 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:01.388959 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159af66a-5842-4b3b-b381-4e319b8ef846 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:01.398305 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159af66a-5842-4b3b-b381-4e319b8ef846 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:01.400108 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159af66a-5842-4b3b-b381-4e319b8ef846 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:01.416036 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-159af66a-5842-4b3b-b381-4e319b8ef846 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 10 09:51:01.416036 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:01.416036 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:01.416036 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:01.416036 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:01.416036 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:01.416036 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:01.416036 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:01.416036 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:01.416036 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:01.416036 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:01.416036 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:01.416036 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 09:51:01.416036 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 09:51:01.416036 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 09:51:01.416036 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 09:51:01.417001 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:01.417001 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:01.417001 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 09:51:01.417001 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 09:51:01.417001 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 09:51:01.417001 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 09:51:01.417001 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:01.417001 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:01.417001 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:01.417001 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:01.417001 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:01.417001 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:01.417001 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:01.417001 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:01.417001 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:01.417001 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:01.417001 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:01.417001 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:01.417987 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:01.417987 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:01.417987 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 09:51:01.417987 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 09:51:01.417987 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 09:51:01.417987 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 09:51:01.417987 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 09:51:01.417987 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 09:51:01.417987 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 10 09:51:01.417987 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:51:01.418571 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bc957f-bf9b-4578-8d0f-8a9e42040e40 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:01.418655 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 331/654] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 10 09:51:01 2022] GET /identity/v3/users/cinder => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:51:01.418655 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbf5d3f-ac38-4ef8-a3a6-88ec8e1125c5 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:01.418777 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbf5d3f-ac38-4ef8-a3a6-88ec8e1125c5 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:01.419024 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbf5d3f-ac38-4ef8-a3a6-88ec8e1125c5 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:01.420378 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 332/655] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:51:01 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:51:01.420963 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbf5d3f-ac38-4ef8-a3a6-88ec8e1125c5 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:01.457216 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37c743e-12e2-474e-ba1d-fa4cdeb1dff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:01.458368 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37c743e-12e2-474e-ba1d-fa4cdeb1dff5 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:01.458640 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37c743e-12e2-474e-ba1d-fa4cdeb1dff5 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:01.458915 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37c743e-12e2-474e-ba1d-fa4cdeb1dff5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:01.471336 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37c743e-12e2-474e-ba1d-fa4cdeb1dff5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:01.472831 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37c743e-12e2-474e-ba1d-fa4cdeb1dff5 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:01.487597 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-b37c743e-12e2-474e-ba1d-fa4cdeb1dff5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:51:01.487597 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:01.487597 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:01.487597 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:01.487597 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:01.487597 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:01.487597 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:01.487597 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:01.487597 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:01.487597 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:01.487597 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:01.487597 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:01.487597 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 09:51:01.487597 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 09:51:01.487597 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 09:51:01.487597 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 09:51:01.488575 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:01.488575 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:01.488575 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:01.488575 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:01.488575 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:01.488575 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:01.488575 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:01.488575 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:01.488575 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:01.488575 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:01.488575 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:01.488575 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:01.488575 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:01.488575 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:01.488575 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:01.488575 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:01.488575 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 09:51:01.490054 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 09:51:01.490054 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:51:01.490054 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:51:01.490054 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 324/656] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 10 09:51:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:51:01.490054 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37c743e-12e2-474e-ba1d-fa4cdeb1dff5 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:01.540968 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbf5d3f-ac38-4ef8-a3a6-88ec8e1125c5 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:01.555971 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:01.576801 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587c2207-2322-4a87-9574-864d2039ebe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:01.577454 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c2207-2322-4a87-9574-864d2039ebe7 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:01.577744 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c2207-2322-4a87-9574-864d2039ebe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:01.577990 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c2207-2322-4a87-9574-864d2039ebe7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:01.589259 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587c2207-2322-4a87-9574-864d2039ebe7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:01.590697 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587c2207-2322-4a87-9574-864d2039ebe7 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:01.597291 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37c743e-12e2-474e-ba1d-fa4cdeb1dff5 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:01.605293 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-587c2207-2322-4a87-9574-864d2039ebe7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:51:01.605293 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:01.605293 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:01.605293 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:01.605293 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:01.605293 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:01.605293 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:01.605293 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:01.605293 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:01.605293 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:01.605293 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:01.605293 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:01.605293 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 09:51:01.605293 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 09:51:01.605293 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 09:51:01.605293 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 09:51:01.606242 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:01.606242 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:01.606242 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:01.606242 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:01.606242 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:01.606242 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:01.606242 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:01.606242 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:01.606242 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:01.606242 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:01.606242 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:01.606242 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:01.606242 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:01.606242 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:01.606242 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:01.606242 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:01.606242 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 09:51:01.607129 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 09:51:01.607129 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:51:01.607129 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:51:01.607129 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 333/657] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 10 09:51:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:51:01.607787 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2421202b-88ad-4483-8d90-d9a88c4077ab None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:01.607950 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2421202b-88ad-4483-8d90-d9a88c4077ab None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:01.608418 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2421202b-88ad-4483-8d90-d9a88c4077ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:01.617715 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:01.631934 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-2421202b-88ad-4483-8d90-d9a88c4077ab None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:51:01.633847 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-2421202b-88ad-4483-8d90-d9a88c4077ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:51:01.638999 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb98a5b-89f0-476f-b2dc-a9d38ec6520c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:01.639635 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb98a5b-89f0-476f-b2dc-a9d38ec6520c None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:01.639891 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb98a5b-89f0-476f-b2dc-a9d38ec6520c None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:01.640178 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb98a5b-89f0-476f-b2dc-a9d38ec6520c None admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:01.640917 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb98a5b-89f0-476f-b2dc-a9d38ec6520c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:01.641256 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb98a5b-89f0-476f-b2dc-a9d38ec6520c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:01.642694 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb98a5b-89f0-476f-b2dc-a9d38ec6520c None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:01.666437 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 325/658] 10.222.0.27 () {56 vars in 1137 bytes} [Wed Aug 10 09:51:01 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:01.666437 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb98a5b-89f0-476f-b2dc-a9d38ec6520c None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:01.723040 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 334/659] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:51:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 09:51:01.723994 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2421202b-88ad-4483-8d90-d9a88c4077ab None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:01.787048 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb98a5b-89f0-476f-b2dc-a9d38ec6520c None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:01.809780 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:01.823520 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c643987f-24c0-47ca-9c60-f40deca5b6e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:01.824318 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c643987f-24c0-47ca-9c60-f40deca5b6e8 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:01.824598 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c643987f-24c0-47ca-9c60-f40deca5b6e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:01.824870 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c643987f-24c0-47ca-9c60-f40deca5b6e8 None admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:01.825544 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c643987f-24c0-47ca-9c60-f40deca5b6e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:01.825851 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c643987f-24c0-47ca-9c60-f40deca5b6e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:01.827220 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c643987f-24c0-47ca-9c60-f40deca5b6e8 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:01.828811 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2421202b-88ad-4483-8d90-d9a88c4077ab None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:01.838804 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 326/660] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 10 09:51:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:01.839619 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c643987f-24c0-47ca-9c60-f40deca5b6e8 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:01.864822 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:01.870793 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793fefca-dfef-4acb-85a8-f64ff074dc0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:01.871390 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793fefca-dfef-4acb-85a8-f64ff074dc0b None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:01.871663 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793fefca-dfef-4acb-85a8-f64ff074dc0b None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:01.871936 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793fefca-dfef-4acb-85a8-f64ff074dc0b None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:01.872707 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793fefca-dfef-4acb-85a8-f64ff074dc0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:01.873221 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793fefca-dfef-4acb-85a8-f64ff074dc0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:01.874542 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793fefca-dfef-4acb-85a8-f64ff074dc0b None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:01.891111 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 335/661] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 10 09:51:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:01.891111 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793fefca-dfef-4acb-85a8-f64ff074dc0b None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:01.945385 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c643987f-24c0-47ca-9c60-f40deca5b6e8 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:01.979845 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aada44-7062-49d9-bfc0-b364e5dd634c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:01.980388 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aada44-7062-49d9-bfc0-b364e5dd634c None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:01.980677 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aada44-7062-49d9-bfc0-b364e5dd634c None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:01.980923 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aada44-7062-49d9-bfc0-b364e5dd634c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:01.999762 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793fefca-dfef-4acb-85a8-f64ff074dc0b None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:02.035188 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23be1370-fc7b-47f6-af46-7c30f1e33a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:02.035815 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23be1370-fc7b-47f6-af46-7c30f1e33a80 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:02.036096 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23be1370-fc7b-47f6-af46-7c30f1e33a80 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:02.036372 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23be1370-fc7b-47f6-af46-7c30f1e33a80 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:02.037379 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:02.048437 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23be1370-fc7b-47f6-af46-7c30f1e33a80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 09:51:02.053604 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-23be1370-fc7b-47f6-af46-7c30f1e33a80 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 09:51:02.053604 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:02.053604 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:02.053604 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:02.053604 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:02.053604 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:02.053604 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:02.053604 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:02.053604 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:02.053604 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:02.053604 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:02.053604 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:02.053604 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 09:51:02.053604 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 09:51:02.053604 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 09:51:02.053604 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 09:51:02.054551 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 09:51:02.054551 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 09:51:02.054551 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 09:51:02.054551 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 09:51:02.054551 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:02.054551 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:02.054551 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:02.054551 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:02.054551 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:02.054551 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:02.054551 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:02.054551 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:02.054551 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:02.054551 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:02.054551 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:02.054551 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:02.055443 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:02.055443 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:02.055443 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:02.055443 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:02.055443 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 09:51:02.055443 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 09:51:02.055443 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 09:51:02.055443 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 09:51:02.055443 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 09:51:02.055443 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 09:51:02.055443 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 09:51:02.055443 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:51:02.055443 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 336/662] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Aug 10 09:51:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:51:02.056127 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23be1370-fc7b-47f6-af46-7c30f1e33a80 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:02.061707 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77aada44-7062-49d9-bfc0-b364e5dd634c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:02.063177 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77aada44-7062-49d9-bfc0-b364e5dd634c None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:02.112013 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:02.160654 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23be1370-fc7b-47f6-af46-7c30f1e33a80 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:02.164104 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 327/663] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 10 09:51:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 09:51:02.165136 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aada44-7062-49d9-bfc0-b364e5dd634c None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:02.199352 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae6bf5a-1fe4-44de-852c-27d3de9c6a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:02.200232 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae6bf5a-1fe4-44de-852c-27d3de9c6a6b None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:02.200512 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae6bf5a-1fe4-44de-852c-27d3de9c6a6b None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:02.201620 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae6bf5a-1fe4-44de-852c-27d3de9c6a6b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:02.209682 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae6bf5a-1fe4-44de-852c-27d3de9c6a6b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:02.211251 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae6bf5a-1fe4-44de-852c-27d3de9c6a6b None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:02.222538 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-dae6bf5a-1fe4-44de-852c-27d3de9c6a6b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 09:51:02.222538 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:02.222538 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:02.222538 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:02.222538 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:02.222538 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:02.222538 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:02.222538 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:02.222538 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:02.222538 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:02.222538 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:02.222538 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:02.222538 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 09:51:02.222538 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 09:51:02.222538 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 09:51:02.223592 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 09:51:02.223592 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:02.223592 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:02.223592 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:02.223592 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:02.223592 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:02.223592 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:02.223592 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:02.223592 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:02.223592 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:02.223592 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:02.223592 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:02.223592 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:02.223592 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:02.223592 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:02.223592 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:02.223592 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:02.224585 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 09:51:02.224585 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 09:51:02.224585 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 09:51:02.224585 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 09:51:02.224585 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 09:51:02.224585 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 09:51:02.224585 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 09:51:02.224585 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:51:02.224585 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 337/664] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 10 09:51:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:51:02.225083 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae6bf5a-1fe4-44de-852c-27d3de9c6a6b None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:02.253615 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:02.273768 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aada44-7062-49d9-bfc0-b364e5dd634c None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:02.308979 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e529916d-2ffb-4dfa-b20f-1b24536fe247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:02.309616 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e529916d-2ffb-4dfa-b20f-1b24536fe247 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:02.309895 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e529916d-2ffb-4dfa-b20f-1b24536fe247 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:02.310169 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e529916d-2ffb-4dfa-b20f-1b24536fe247 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:02.317353 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e529916d-2ffb-4dfa-b20f-1b24536fe247 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:02.319243 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e529916d-2ffb-4dfa-b20f-1b24536fe247 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:02.330964 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-e529916d-2ffb-4dfa-b20f-1b24536fe247 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 10 09:51:02.330964 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:02.330964 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:02.330964 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:02.330964 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:02.330964 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:02.330964 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:02.330964 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:02.330964 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:02.330964 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:02.330964 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:02.330964 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:02.330964 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 09:51:02.330964 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 09:51:02.330964 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 09:51:02.330964 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 09:51:02.331891 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:02.331891 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:02.331891 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 09:51:02.331891 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 09:51:02.331891 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 09:51:02.331891 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 09:51:02.331891 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:02.331891 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:02.331891 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:02.331891 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:02.331891 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:02.331891 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:02.331891 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:02.331891 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:02.331891 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:02.331891 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:02.331891 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:02.331891 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:02.332816 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:02.332816 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:02.332816 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 09:51:02.332816 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 09:51:02.332816 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 09:51:02.332816 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 09:51:02.332816 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 09:51:02.332816 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 09:51:02.332816 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 10 09:51:02.332816 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:51:02.332816 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 328/665] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Aug 10 09:51:02 2022] GET /identity/v3/users/neutron => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:51:02.332816 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e529916d-2ffb-4dfa-b20f-1b24536fe247 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:02.344082 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae6bf5a-1fe4-44de-852c-27d3de9c6a6b None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:02.359197 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:02.383694 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811cc931-1169-4f43-a61e-c29a124ff0b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:02.384337 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811cc931-1169-4f43-a61e-c29a124ff0b0 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:02.384588 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811cc931-1169-4f43-a61e-c29a124ff0b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:02.384871 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811cc931-1169-4f43-a61e-c29a124ff0b0 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:02.385562 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811cc931-1169-4f43-a61e-c29a124ff0b0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:02.385865 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811cc931-1169-4f43-a61e-c29a124ff0b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:02.387231 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811cc931-1169-4f43-a61e-c29a124ff0b0 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:02.395770 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 338/666] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Aug 10 09:51:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:02.396652 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811cc931-1169-4f43-a61e-c29a124ff0b0 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:02.450913 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e529916d-2ffb-4dfa-b20f-1b24536fe247 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:02.487132 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08e86fc-9d3a-4c48-bfa3-d84720785992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:02.487757 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08e86fc-9d3a-4c48-bfa3-d84720785992 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:02.488031 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08e86fc-9d3a-4c48-bfa3-d84720785992 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:02.488296 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08e86fc-9d3a-4c48-bfa3-d84720785992 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:02.500126 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08e86fc-9d3a-4c48-bfa3-d84720785992 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:02.501129 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811cc931-1169-4f43-a61e-c29a124ff0b0 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:02.501612 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08e86fc-9d3a-4c48-bfa3-d84720785992 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:02.504361 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:02.518245 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-f08e86fc-9d3a-4c48-bfa3-d84720785992 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:51:02.518245 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:02.518245 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:02.518245 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:02.518245 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:02.518245 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:02.518245 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:02.518245 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:02.518245 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:02.518245 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:02.518245 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:02.518245 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:02.518245 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 09:51:02.518245 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 09:51:02.518245 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 09:51:02.518245 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 09:51:02.519184 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:02.519184 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:02.519184 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:02.519184 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:02.519184 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:02.519184 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:02.519184 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:02.519184 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:02.519184 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:02.519184 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:02.519184 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:02.519184 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:02.519184 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:02.519184 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:02.519184 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:02.519184 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:02.519184 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 09:51:02.520088 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 09:51:02.520088 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:51:02.520088 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:51:02.520088 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 329/667] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 10 09:51:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:51:02.520317 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08e86fc-9d3a-4c48-bfa3-d84720785992 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:02.539452 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b1024b-7bfd-4b1b-972e-1dc4a04f029f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:02.540066 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b1024b-7bfd-4b1b-972e-1dc4a04f029f None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:02.540343 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b1024b-7bfd-4b1b-972e-1dc4a04f029f None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:02.540609 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b1024b-7bfd-4b1b-972e-1dc4a04f029f None admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:02.541360 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b1024b-7bfd-4b1b-972e-1dc4a04f029f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:02.541637 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b1024b-7bfd-4b1b-972e-1dc4a04f029f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:02.543057 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b1024b-7bfd-4b1b-972e-1dc4a04f029f None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:02.555412 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 339/668] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Aug 10 09:51:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:02.556186 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b1024b-7bfd-4b1b-972e-1dc4a04f029f None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:02.592499 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:02.629914 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08e86fc-9d3a-4c48-bfa3-d84720785992 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:02.660063 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b1024b-7bfd-4b1b-972e-1dc4a04f029f None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:02.663141 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2268c4-27d2-4d88-84eb-498cbabb7e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:02.663741 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2268c4-27d2-4d88-84eb-498cbabb7e5c None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:02.664019 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2268c4-27d2-4d88-84eb-498cbabb7e5c None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:02.664287 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2268c4-27d2-4d88-84eb-498cbabb7e5c None admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:02.665012 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2268c4-27d2-4d88-84eb-498cbabb7e5c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:02.665362 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2268c4-27d2-4d88-84eb-498cbabb7e5c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:02.666790 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2268c4-27d2-4d88-84eb-498cbabb7e5c None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:02.683864 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 330/669] 10.222.0.27 () {56 vars in 1139 bytes} [Wed Aug 10 09:51:02 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:02.684684 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2268c4-27d2-4d88-84eb-498cbabb7e5c None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:02.709090 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b631078f-7bfc-45a1-883d-627b9baf2429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:02.709954 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b631078f-7bfc-45a1-883d-627b9baf2429 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:02.710192 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b631078f-7bfc-45a1-883d-627b9baf2429 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:02.710434 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b631078f-7bfc-45a1-883d-627b9baf2429 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:02.721815 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b631078f-7bfc-45a1-883d-627b9baf2429 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:02.723258 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b631078f-7bfc-45a1-883d-627b9baf2429 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:02.738185 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:02.739024 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-b631078f-7bfc-45a1-883d-627b9baf2429 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:51:02.739024 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:02.739024 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:02.739024 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:02.739024 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:02.739024 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:02.739024 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:02.739024 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:02.739024 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:02.739024 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:02.739024 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:02.739024 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:02.739024 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 09:51:02.739024 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 09:51:02.739024 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 09:51:02.739024 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 09:51:02.739957 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:02.739957 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:02.739957 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:02.739957 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:02.739957 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:02.739957 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:02.739957 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:02.739957 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:02.739957 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:02.739957 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:02.739957 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:02.739957 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:02.739957 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:02.739957 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:02.739957 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:02.739957 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:02.739957 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 09:51:02.740874 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 09:51:02.740874 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:51:02.740874 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:51:02.740874 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 340/670] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 10 09:51:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:51:02.741268 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b631078f-7bfc-45a1-883d-627b9baf2429 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:02.791602 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2268c4-27d2-4d88-84eb-498cbabb7e5c None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:02.825588 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401e9452-6872-414e-995b-f742c38d1ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:02.826187 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401e9452-6872-414e-995b-f742c38d1ac8 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:02.826458 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401e9452-6872-414e-995b-f742c38d1ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:02.826720 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401e9452-6872-414e-995b-f742c38d1ac8 None admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:02.827457 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401e9452-6872-414e-995b-f742c38d1ac8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:02.827667 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401e9452-6872-414e-995b-f742c38d1ac8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:02.829029 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401e9452-6872-414e-995b-f742c38d1ac8 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:02.832086 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:02.845034 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 331/671] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 10 09:51:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:02.845034 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401e9452-6872-414e-995b-f742c38d1ac8 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:02.853964 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b631078f-7bfc-45a1-883d-627b9baf2429 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:02.890259 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aa5f3c-55c6-4568-ab24-306a74739008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:02.890870 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aa5f3c-55c6-4568-ab24-306a74739008 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:02.891146 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aa5f3c-55c6-4568-ab24-306a74739008 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:02.891418 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aa5f3c-55c6-4568-ab24-306a74739008 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:02.892143 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aa5f3c-55c6-4568-ab24-306a74739008 None admin] RBAC: Adding query filter params (role.id=c0cf832e3b184857b8eaed2f68da1532, scope.project.id=d47d5b72a00642a1a239b785110643ef, user.id=f9e7f1ec6ad64b978f8817a5d2a73757) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:02.892451 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aa5f3c-55c6-4568-ab24-306a74739008 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:02.893915 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aa5f3c-55c6-4568-ab24-306a74739008 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:02.899819 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 341/672] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 10 09:51:02 2022] GET /identity/v3/role_assignments?user.id=f9e7f1ec6ad64b978f8817a5d2a73757&scope.project.id=d47d5b72a00642a1a239b785110643ef&role.id=c0cf832e3b184857b8eaed2f68da1532 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:02.900603 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aa5f3c-55c6-4568-ab24-306a74739008 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:02.961570 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401e9452-6872-414e-995b-f742c38d1ac8 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:02.976393 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:03.002684 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733a3660-1c35-442d-8138-d809a0cf7a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:03.003465 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733a3660-1c35-442d-8138-d809a0cf7a2d None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:03.003836 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733a3660-1c35-442d-8138-d809a0cf7a2d None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:03.004201 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733a3660-1c35-442d-8138-d809a0cf7a2d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:03.020968 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aa5f3c-55c6-4568-ab24-306a74739008 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:03.059421 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22749537-eae1-4e25-8e23-abac668aedc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:03.060297 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22749537-eae1-4e25-8e23-abac668aedc4 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:03.060847 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22749537-eae1-4e25-8e23-abac668aedc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:03.061149 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22749537-eae1-4e25-8e23-abac668aedc4 None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:03.061940 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22749537-eae1-4e25-8e23-abac668aedc4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:03.062249 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22749537-eae1-4e25-8e23-abac668aedc4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:03.063778 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22749537-eae1-4e25-8e23-abac668aedc4 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:03.079605 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 342/673] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 10 09:51:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:03.080521 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22749537-eae1-4e25-8e23-abac668aedc4 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:03.096090 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:03.108094 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733a3660-1c35-442d-8138-d809a0cf7a2d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:03.109977 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733a3660-1c35-442d-8138-d809a0cf7a2d None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:03.197977 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22749537-eae1-4e25-8e23-abac668aedc4 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:03.221422 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 332/674] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 10 09:51:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 09:51:03.221422 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733a3660-1c35-442d-8138-d809a0cf7a2d None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:03.238013 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:03.242200 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c53f47-c401-40bf-89ff-bda0d242eeca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:03.242816 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c53f47-c401-40bf-89ff-bda0d242eeca None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:03.243093 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c53f47-c401-40bf-89ff-bda0d242eeca None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:03.243361 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c53f47-c401-40bf-89ff-bda0d242eeca None admin] PATH_INFO: `/v3/projects/service` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:03.251919 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c53f47-c401-40bf-89ff-bda0d242eeca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:03.253401 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c53f47-c401-40bf-89ff-bda0d242eeca None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:03.277916 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-c7c53f47-c401-40bf-89ff-bda0d242eeca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 09:51:03.277916 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:03.277916 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:03.277916 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:03.277916 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:03.277916 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:03.277916 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:03.277916 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:03.277916 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:03.277916 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:03.277916 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:03.277916 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:03.277916 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 09:51:03.277916 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 09:51:03.277916 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 09:51:03.278853 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 09:51:03.278853 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:03.278853 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:03.278853 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:03.278853 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:03.278853 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:03.278853 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:03.278853 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:03.278853 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:03.278853 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:03.278853 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:03.278853 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:03.278853 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:03.278853 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:03.278853 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:03.278853 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:03.278853 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:03.279805 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 09:51:03.279805 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 09:51:03.279805 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 09:51:03.279805 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 09:51:03.279805 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 09:51:03.279805 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 09:51:03.279805 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 09:51:03.279805 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:51:03.282583 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 343/675] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 10 09:51:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:51:03.283871 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c53f47-c401-40bf-89ff-bda0d242eeca None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:03.350251 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733a3660-1c35-442d-8138-d809a0cf7a2d None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:03.365108 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:03.385392 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d0640c-bcf4-427d-9ad7-d4dcc55b0e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:03.386440 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d0640c-bcf4-427d-9ad7-d4dcc55b0e18 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:03.386727 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d0640c-bcf4-427d-9ad7-d4dcc55b0e18 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:03.387000 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d0640c-bcf4-427d-9ad7-d4dcc55b0e18 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:03.394441 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d0640c-bcf4-427d-9ad7-d4dcc55b0e18 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:03.395895 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d0640c-bcf4-427d-9ad7-d4dcc55b0e18 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:03.401695 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c53f47-c401-40bf-89ff-bda0d242eeca None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:03.414913 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-16d0640c-bcf4-427d-9ad7-d4dcc55b0e18 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 10 09:51:03.414913 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:03.414913 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:03.414913 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:03.414913 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:03.414913 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:03.414913 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:03.414913 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:03.414913 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:03.414913 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:03.414913 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:03.414913 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:03.414913 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 09:51:03.414913 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 09:51:03.414913 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 09:51:03.414913 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 09:51:03.415959 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:03.415959 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:03.415959 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 09:51:03.415959 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 09:51:03.415959 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 09:51:03.415959 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 09:51:03.415959 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:03.415959 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:03.415959 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:03.415959 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:03.415959 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:03.415959 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:03.415959 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:03.415959 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:03.415959 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:03.415959 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:03.415959 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:03.415959 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:03.416964 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:03.416964 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:03.416964 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 09:51:03.416964 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 09:51:03.416964 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 09:51:03.416964 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 09:51:03.416964 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 09:51:03.416964 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 09:51:03.416964 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 10 09:51:03.416964 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:51:03.416964 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 333/676] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Aug 10 09:51:03 2022] GET /identity/v3/users/swift => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:51:03.416964 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d0640c-bcf4-427d-9ad7-d4dcc55b0e18 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:03.441280 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d51cdc6-5b91-4873-813d-d44df605edef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:03.441909 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d51cdc6-5b91-4873-813d-d44df605edef None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:03.442181 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d51cdc6-5b91-4873-813d-d44df605edef None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:03.442444 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d51cdc6-5b91-4873-813d-d44df605edef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:03.453216 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d51cdc6-5b91-4873-813d-d44df605edef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:03.454681 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d51cdc6-5b91-4873-813d-d44df605edef None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:03.469742 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-2d51cdc6-5b91-4873-813d-d44df605edef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:51:03.469742 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:03.469742 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:03.469742 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:03.469742 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:03.469742 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:03.469742 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:03.469742 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:03.469742 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:03.469742 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:03.469742 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:03.469742 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:03.469742 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 09:51:03.469742 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 09:51:03.469742 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 09:51:03.469742 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 09:51:03.470743 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:03.470743 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:03.470743 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:03.470743 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:03.470743 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:03.470743 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:03.470743 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:03.470743 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:03.470743 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:03.470743 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:03.470743 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:03.470743 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:03.470743 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:03.470743 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:03.470743 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:03.470743 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:03.470743 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 09:51:03.471642 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 09:51:03.471642 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:51:03.471642 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:51:03.475448 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 344/677] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 10 09:51:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:51:03.476685 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f5f6c8-b6d7-4c1a-bba6-c08588cef275 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:03.476966 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f5f6c8-b6d7-4c1a-bba6-c08588cef275 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:03.477259 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f5f6c8-b6d7-4c1a-bba6-c08588cef275 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:03.478648 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 345/678] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:51:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:51:03.479174 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f5f6c8-b6d7-4c1a-bba6-c08588cef275 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:03.496937 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:03.536103 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d0640c-bcf4-427d-9ad7-d4dcc55b0e18 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:03.570601 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fbfb1f-f9aa-45c0-847a-597ebaf8ac96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:03.571208 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fbfb1f-f9aa-45c0-847a-597ebaf8ac96 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:03.571484 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fbfb1f-f9aa-45c0-847a-597ebaf8ac96 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:03.571751 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fbfb1f-f9aa-45c0-847a-597ebaf8ac96 None admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:03.572434 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fbfb1f-f9aa-45c0-847a-597ebaf8ac96 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:03.572733 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fbfb1f-f9aa-45c0-847a-597ebaf8ac96 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:03.574194 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fbfb1f-f9aa-45c0-847a-597ebaf8ac96 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:03.585663 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f5f6c8-b6d7-4c1a-bba6-c08588cef275 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:03.586589 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 334/679] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Aug 10 09:51:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:03.587381 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fbfb1f-f9aa-45c0-847a-597ebaf8ac96 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:03.611573 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:03.624073 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75a91d1-16ae-4a4a-a2d3-c12f92f46b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:03.624683 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75a91d1-16ae-4a4a-a2d3-c12f92f46b7e None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:03.624958 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75a91d1-16ae-4a4a-a2d3-c12f92f46b7e None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:03.625297 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75a91d1-16ae-4a4a-a2d3-c12f92f46b7e None admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:03.626000 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75a91d1-16ae-4a4a-a2d3-c12f92f46b7e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:03.626926 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75a91d1-16ae-4a4a-a2d3-c12f92f46b7e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:03.627757 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75a91d1-16ae-4a4a-a2d3-c12f92f46b7e None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:03.650118 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 346/680] 10.222.0.27 () {56 vars in 1135 bytes} [Wed Aug 10 09:51:03 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:03.650118 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a980f5f-684a-4ba3-8865-905a3a3e422b None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:03.650118 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a980f5f-684a-4ba3-8865-905a3a3e422b None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:03.650118 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a980f5f-684a-4ba3-8865-905a3a3e422b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:03.668423 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-1a980f5f-684a-4ba3-8865-905a3a3e422b None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:51:03.669655 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-1a980f5f-684a-4ba3-8865-905a3a3e422b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:51:03.699104 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fbfb1f-f9aa-45c0-847a-597ebaf8ac96 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:03.729863 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:03.736654 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391af72b-4382-4d9e-acbf-a4eed1621311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:03.737549 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391af72b-4382-4d9e-acbf-a4eed1621311 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:03.737828 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391af72b-4382-4d9e-acbf-a4eed1621311 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:03.738098 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391af72b-4382-4d9e-acbf-a4eed1621311 None admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:03.738751 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391af72b-4382-4d9e-acbf-a4eed1621311 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:03.739055 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391af72b-4382-4d9e-acbf-a4eed1621311 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:03.740436 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391af72b-4382-4d9e-acbf-a4eed1621311 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:03.749413 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 347/681] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:51:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 09:51:03.749413 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a980f5f-684a-4ba3-8865-905a3a3e422b None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:03.763007 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 335/682] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 10 09:51:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:03.764452 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391af72b-4382-4d9e-acbf-a4eed1621311 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:03.846317 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a980f5f-684a-4ba3-8865-905a3a3e422b None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:03.857123 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:03.874352 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391af72b-4382-4d9e-acbf-a4eed1621311 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:03.882470 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156e8ae1-c002-4414-a62e-e897c583ad00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:03.883081 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e8ae1-c002-4414-a62e-e897c583ad00 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:03.883355 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e8ae1-c002-4414-a62e-e897c583ad00 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:03.883623 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e8ae1-c002-4414-a62e-e897c583ad00 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:03.884375 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156e8ae1-c002-4414-a62e-e897c583ad00 None admin] RBAC: Adding query filter params (role.id=c0cf832e3b184857b8eaed2f68da1532, scope.project.id=d47d5b72a00642a1a239b785110643ef, user.id=bbf8e725cbe0403d943b136235eac057) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:03.884676 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156e8ae1-c002-4414-a62e-e897c583ad00 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:03.886136 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156e8ae1-c002-4414-a62e-e897c583ad00 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:03.891736 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 348/683] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 10 09:51:03 2022] GET /identity/v3/role_assignments?user.id=bbf8e725cbe0403d943b136235eac057&scope.project.id=d47d5b72a00642a1a239b785110643ef&role.id=c0cf832e3b184857b8eaed2f68da1532 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:03.892544 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156e8ae1-c002-4414-a62e-e897c583ad00 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:03.933930 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90a8042-40c8-441c-80f6-9cacc4bbd958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:03.935213 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a8042-40c8-441c-80f6-9cacc4bbd958 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:03.936271 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a8042-40c8-441c-80f6-9cacc4bbd958 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:03.936737 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a8042-40c8-441c-80f6-9cacc4bbd958 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:04.014765 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:04.026444 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156e8ae1-c002-4414-a62e-e897c583ad00 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:04.026704 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90a8042-40c8-441c-80f6-9cacc4bbd958 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:04.028123 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90a8042-40c8-441c-80f6-9cacc4bbd958 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:04.071934 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf867e87-ddb0-41d2-90b0-bbb7ff723a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:04.073263 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf867e87-ddb0-41d2-90b0-bbb7ff723a9d None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:04.073582 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf867e87-ddb0-41d2-90b0-bbb7ff723a9d None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:04.073862 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf867e87-ddb0-41d2-90b0-bbb7ff723a9d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:04.081491 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf867e87-ddb0-41d2-90b0-bbb7ff723a9d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:04.082911 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf867e87-ddb0-41d2-90b0-bbb7ff723a9d None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:04.095612 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-bf867e87-ddb0-41d2-90b0-bbb7ff723a9d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 09:51:04.095612 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:04.095612 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:04.095612 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:04.095612 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:04.095612 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:04.095612 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:04.095612 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:04.095612 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:04.095612 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:04.095612 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:04.095612 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:04.095612 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 09:51:04.095612 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 09:51:04.095612 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 09:51:04.096557 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 09:51:04.096557 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:04.096557 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:04.096557 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:04.096557 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:04.096557 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:04.096557 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:04.096557 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:04.096557 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:04.096557 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:04.096557 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:04.096557 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:04.096557 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:04.096557 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:04.096557 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:04.096557 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:04.096557 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:04.097488 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 09:51:04.097488 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 09:51:04.097488 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 09:51:04.097488 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 09:51:04.097488 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 09:51:04.097488 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 09:51:04.097488 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 09:51:04.097488 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:51:04.098840 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 349/684] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 10 09:51:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:51:04.098840 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf867e87-ddb0-41d2-90b0-bbb7ff723a9d None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:04.153345 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:04.154613 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 336/685] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 10 09:51:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 09:51:04.155464 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90a8042-40c8-441c-80f6-9cacc4bbd958 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:04.227835 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf867e87-ddb0-41d2-90b0-bbb7ff723a9d None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:04.254821 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:04.263141 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4d4596-644e-46c4-9b6b-3f9abc79b3d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:04.263783 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d4596-644e-46c4-9b6b-3f9abc79b3d8 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:04.264062 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d4596-644e-46c4-9b6b-3f9abc79b3d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:04.264334 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d4596-644e-46c4-9b6b-3f9abc79b3d8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:04.264601 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90a8042-40c8-441c-80f6-9cacc4bbd958 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:04.275778 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4d4596-644e-46c4-9b6b-3f9abc79b3d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 09:51:04.281103 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-ce4d4596-644e-46c4-9b6b-3f9abc79b3d8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 09:51:04.281103 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:04.281103 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:04.281103 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:04.281103 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:04.281103 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:04.281103 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:04.281103 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:04.281103 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:04.281103 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:04.281103 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:04.281103 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:04.281103 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 09:51:04.281103 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 09:51:04.281103 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 09:51:04.281103 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 09:51:04.282040 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 09:51:04.282040 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 09:51:04.282040 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 09:51:04.282040 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 09:51:04.282040 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:04.282040 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:04.282040 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:04.282040 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:04.282040 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:04.282040 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:04.282040 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:04.282040 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:04.282040 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:04.282040 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:04.282040 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:04.282040 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:04.282861 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:04.282861 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:04.282861 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:04.282861 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:04.282861 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 09:51:04.282861 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 09:51:04.282861 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 09:51:04.282861 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 09:51:04.282861 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 09:51:04.282861 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 09:51:04.282861 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 09:51:04.282861 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:51:04.282861 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 350/686] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Aug 10 09:51:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:51:04.284135 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4d4596-644e-46c4-9b6b-3f9abc79b3d8 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:04.302067 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0634fca-008a-4344-9899-8a9a13a5bf7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:04.302682 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0634fca-008a-4344-9899-8a9a13a5bf7b None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:04.302964 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0634fca-008a-4344-9899-8a9a13a5bf7b None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:04.303238 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0634fca-008a-4344-9899-8a9a13a5bf7b None admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:04.304109 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0634fca-008a-4344-9899-8a9a13a5bf7b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:04.304521 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0634fca-008a-4344-9899-8a9a13a5bf7b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:04.306021 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0634fca-008a-4344-9899-8a9a13a5bf7b None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:04.319470 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 337/687] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Aug 10 09:51:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:04.320399 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0634fca-008a-4344-9899-8a9a13a5bf7b None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:04.381128 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:04.387644 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4d4596-644e-46c4-9b6b-3f9abc79b3d8 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:04.422907 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed014ad-0b78-4605-8d08-0f47ac1edb10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:04.423397 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed014ad-0b78-4605-8d08-0f47ac1edb10 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:04.423679 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed014ad-0b78-4605-8d08-0f47ac1edb10 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:04.423994 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed014ad-0b78-4605-8d08-0f47ac1edb10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:04.429592 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0634fca-008a-4344-9899-8a9a13a5bf7b None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:04.435058 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed014ad-0b78-4605-8d08-0f47ac1edb10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:04.436590 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed014ad-0b78-4605-8d08-0f47ac1edb10 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:04.453130 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-3ed014ad-0b78-4605-8d08-0f47ac1edb10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:51:04.453130 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:04.453130 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:04.453130 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:04.453130 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:04.453130 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:04.453130 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:04.453130 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:04.453130 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:04.453130 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:04.453130 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:04.453130 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:04.453130 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 09:51:04.453130 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 09:51:04.453130 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 09:51:04.453130 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 09:51:04.454104 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:04.454104 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:04.454104 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:04.454104 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:04.454104 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:04.454104 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:04.454104 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:04.454104 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:04.454104 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:04.454104 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:04.454104 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:04.454104 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:04.454104 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:04.454104 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:04.454104 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:04.454104 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:04.454104 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 09:51:04.454975 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 09:51:04.454975 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:51:04.454975 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:51:04.454975 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 351/688] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 10 09:51:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:51:04.455637 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed014ad-0b78-4605-8d08-0f47ac1edb10 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:04.470879 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24847ced-9c07-4a59-ba17-7446a1db51c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:04.471931 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24847ced-9c07-4a59-ba17-7446a1db51c6 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:04.472434 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24847ced-9c07-4a59-ba17-7446a1db51c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:04.472927 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24847ced-9c07-4a59-ba17-7446a1db51c6 None admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:04.473945 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24847ced-9c07-4a59-ba17-7446a1db51c6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:04.474453 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24847ced-9c07-4a59-ba17-7446a1db51c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:04.476146 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24847ced-9c07-4a59-ba17-7446a1db51c6 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:04.485742 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 338/689] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 10 09:51:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:04.486747 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24847ced-9c07-4a59-ba17-7446a1db51c6 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:04.508169 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:04.567834 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed014ad-0b78-4605-8d08-0f47ac1edb10 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:04.601043 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24847ced-9c07-4a59-ba17-7446a1db51c6 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:04.602713 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5723d110-5948-4651-9c79-67b300ac1da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:04.603467 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5723d110-5948-4651-9c79-67b300ac1da6 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:04.603745 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5723d110-5948-4651-9c79-67b300ac1da6 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:04.604024 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5723d110-5948-4651-9c79-67b300ac1da6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:04.605594 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5723d110-5948-4651-9c79-67b300ac1da6 None admin] RBAC: Adding query filter params (role.id=c0cf832e3b184857b8eaed2f68da1532, scope.project.id=d47d5b72a00642a1a239b785110643ef, user.id=4294c170df354fe892831281acd4ea7d) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:04.605908 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5723d110-5948-4651-9c79-67b300ac1da6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:04.607354 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5723d110-5948-4651-9c79-67b300ac1da6 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:04.615117 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 352/690] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 10 09:51:04 2022] GET /identity/v3/role_assignments?user.id=4294c170df354fe892831281acd4ea7d&scope.project.id=d47d5b72a00642a1a239b785110643ef&role.id=c0cf832e3b184857b8eaed2f68da1532 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:04.615958 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5723d110-5948-4651-9c79-67b300ac1da6 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:04.632569 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:04.643768 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8096bb41-a716-48f5-a38a-7d0f1190e8a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:04.644786 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8096bb41-a716-48f5-a38a-7d0f1190e8a2 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:04.645338 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8096bb41-a716-48f5-a38a-7d0f1190e8a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:04.645790 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8096bb41-a716-48f5-a38a-7d0f1190e8a2 None admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:04.646675 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8096bb41-a716-48f5-a38a-7d0f1190e8a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:04.647180 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8096bb41-a716-48f5-a38a-7d0f1190e8a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:04.649057 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8096bb41-a716-48f5-a38a-7d0f1190e8a2 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:04.667921 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 339/691] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 10 09:51:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:04.680105 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8096bb41-a716-48f5-a38a-7d0f1190e8a2 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:04.746685 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5723d110-5948-4651-9c79-67b300ac1da6 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:04.760151 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:04.787043 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed456f4-7c9d-4a58-a20e-e4eae3270ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:04.787813 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8096bb41-a716-48f5-a38a-7d0f1190e8a2 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:04.788838 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed456f4-7c9d-4a58-a20e-e4eae3270ac3 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:04.789443 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed456f4-7c9d-4a58-a20e-e4eae3270ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:04.790046 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed456f4-7c9d-4a58-a20e-e4eae3270ac3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:04.803065 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed456f4-7c9d-4a58-a20e-e4eae3270ac3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:04.805056 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed456f4-7c9d-4a58-a20e-e4eae3270ac3 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:04.822131 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-1ed456f4-7c9d-4a58-a20e-e4eae3270ac3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:51:04.822131 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:04.822131 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:04.822131 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:04.822131 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:04.822131 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:04.822131 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:04.822131 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:04.822131 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:04.822131 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:04.822131 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:04.822131 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:04.822131 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 09:51:04.822131 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 09:51:04.822131 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 09:51:04.822131 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 09:51:04.823191 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:04.823191 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:04.823191 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:04.823191 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:04.823191 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:04.823191 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:04.823191 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:04.823191 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:04.823191 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:04.823191 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:04.823191 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:04.823191 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:04.823191 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:04.823191 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:04.823191 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:04.823191 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:04.823191 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 09:51:04.824157 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 09:51:04.824157 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:51:04.824157 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:51:04.826374 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45910af1-42c0-4103-abfb-adef33283abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:04.826670 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 353/692] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 10 09:51:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:51:04.826971 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45910af1-42c0-4103-abfb-adef33283abc None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:04.827250 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45910af1-42c0-4103-abfb-adef33283abc None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:04.827520 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45910af1-42c0-4103-abfb-adef33283abc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:04.834252 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed456f4-7c9d-4a58-a20e-e4eae3270ac3 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:04.834831 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45910af1-42c0-4103-abfb-adef33283abc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:04.838895 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45910af1-42c0-4103-abfb-adef33283abc None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:04.860069 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-45910af1-42c0-4103-abfb-adef33283abc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 09:51:04.860069 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:04.860069 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:04.860069 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:04.860069 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:04.860069 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:04.860069 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:04.860069 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:04.860069 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:04.860069 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:04.860069 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:04.860069 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:04.860069 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 09:51:04.860069 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 09:51:04.860069 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 09:51:04.861056 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 09:51:04.861056 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:04.861056 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:04.861056 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:04.861056 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:04.861056 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:04.861056 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:04.861056 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:04.861056 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:04.861056 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:04.861056 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:04.861056 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:04.861056 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:04.861056 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:04.861056 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:04.861056 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:04.861056 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:04.862015 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 09:51:04.862015 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 09:51:04.862015 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 09:51:04.862015 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 09:51:04.862015 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 09:51:04.862015 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 09:51:04.862015 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 09:51:04.862015 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:51:04.867099 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 340/693] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 10 09:51:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:51:04.872012 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45910af1-42c0-4103-abfb-adef33283abc None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:04.939569 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:04.983704 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed456f4-7c9d-4a58-a20e-e4eae3270ac3 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:05.008780 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45910af1-42c0-4103-abfb-adef33283abc None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:05.020033 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e290391-bfe6-4524-b0ac-274ad10b7cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:05.020647 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e290391-bfe6-4524-b0ac-274ad10b7cb0 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:05.021018 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e290391-bfe6-4524-b0ac-274ad10b7cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:05.021325 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e290391-bfe6-4524-b0ac-274ad10b7cb0 None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:05.021973 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e290391-bfe6-4524-b0ac-274ad10b7cb0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:05.022338 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e290391-bfe6-4524-b0ac-274ad10b7cb0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:05.023827 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e290391-bfe6-4524-b0ac-274ad10b7cb0 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:05.038919 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 354/694] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 10 09:51:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:05.043805 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e290391-bfe6-4524-b0ac-274ad10b7cb0 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:05.052802 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361248b8-411f-4ed7-8796-ed2dabfad9cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:05.054210 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361248b8-411f-4ed7-8796-ed2dabfad9cd None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:05.054691 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361248b8-411f-4ed7-8796-ed2dabfad9cd None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:05.055144 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361248b8-411f-4ed7-8796-ed2dabfad9cd None admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:05.056383 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361248b8-411f-4ed7-8796-ed2dabfad9cd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:05.056866 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361248b8-411f-4ed7-8796-ed2dabfad9cd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:05.059034 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361248b8-411f-4ed7-8796-ed2dabfad9cd None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:05.061621 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:05.076470 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 341/695] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Aug 10 09:51:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:05.082320 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361248b8-411f-4ed7-8796-ed2dabfad9cd None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:05.196483 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e290391-bfe6-4524-b0ac-274ad10b7cb0 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:05.221719 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:05.234809 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79e2d3d-0738-4527-84c6-06c61476b264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:05.235442 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79e2d3d-0738-4527-84c6-06c61476b264 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:05.235716 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79e2d3d-0738-4527-84c6-06c61476b264 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:05.235990 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79e2d3d-0738-4527-84c6-06c61476b264 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:05.238583 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361248b8-411f-4ed7-8796-ed2dabfad9cd None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:05.246907 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79e2d3d-0738-4527-84c6-06c61476b264 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:05.248363 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79e2d3d-0738-4527-84c6-06c61476b264 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:05.260016 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-d79e2d3d-0738-4527-84c6-06c61476b264 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 10 09:51:05.260016 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:05.260016 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:05.260016 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:05.260016 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:05.260016 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:05.260016 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:05.260016 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:05.260016 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:05.260016 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:05.260016 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:05.260016 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:05.260016 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 09:51:05.260016 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 09:51:05.260016 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 09:51:05.260016 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 09:51:05.260997 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:05.260997 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:05.260997 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 09:51:05.260997 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 09:51:05.260997 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 09:51:05.260997 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 09:51:05.260997 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:05.260997 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:05.260997 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:05.260997 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:05.260997 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:05.260997 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:05.260997 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:05.260997 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:05.260997 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:05.260997 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:05.260997 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:05.260997 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:05.261952 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:05.261952 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:05.261952 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 09:51:05.261952 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 09:51:05.261952 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 09:51:05.261952 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 09:51:05.261952 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 09:51:05.261952 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 09:51:05.261952 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 10 09:51:05.261952 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:51:05.261952 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 355/696] 10.222.0.27 () {56 vars in 1093 bytes} [Wed Aug 10 09:51:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:51:05.266910 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79e2d3d-0738-4527-84c6-06c61476b264 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:05.283089 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c475757-c57a-496d-9930-56323f37db6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:05.283772 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c475757-c57a-496d-9930-56323f37db6e None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:05.284059 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c475757-c57a-496d-9930-56323f37db6e None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:05.284379 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c475757-c57a-496d-9930-56323f37db6e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:05.285190 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c475757-c57a-496d-9930-56323f37db6e None admin] RBAC: Adding query filter params (role.id=c0cf832e3b184857b8eaed2f68da1532, scope.project.id=d47d5b72a00642a1a239b785110643ef, user.id=b801551d29ff4687ab8c1ce8cfa51614) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:05.285574 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c475757-c57a-496d-9930-56323f37db6e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:05.287133 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c475757-c57a-496d-9930-56323f37db6e None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:05.293787 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 342/697] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 10 09:51:05 2022] GET /identity/v3/role_assignments?user.id=b801551d29ff4687ab8c1ce8cfa51614&scope.project.id=d47d5b72a00642a1a239b785110643ef&role.id=c0cf832e3b184857b8eaed2f68da1532 => generated 608 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 09:51:05.295079 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89866b1-8ada-4057-9460-06ea1577ec48 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:05.300201 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89866b1-8ada-4057-9460-06ea1577ec48 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:05.300498 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89866b1-8ada-4057-9460-06ea1577ec48 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:05.305608 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 343/698] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:51:05 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:51:05.311404 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517f7422-cb3c-4f46-b4b8-c613670f4ddb None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:05.311727 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517f7422-cb3c-4f46-b4b8-c613670f4ddb None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:05.312055 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517f7422-cb3c-4f46-b4b8-c613670f4ddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:05.344951 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-517f7422-cb3c-4f46-b4b8-c613670f4ddb None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:51:05.346357 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-517f7422-cb3c-4f46-b4b8-c613670f4ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:51:05.371162 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79e2d3d-0738-4527-84c6-06c61476b264 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:05.414011 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d44a517-bdaa-4113-8d41-1eeb6f2a9bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:05.414709 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d44a517-bdaa-4113-8d41-1eeb6f2a9bbf None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:05.414983 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d44a517-bdaa-4113-8d41-1eeb6f2a9bbf None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:05.415251 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d44a517-bdaa-4113-8d41-1eeb6f2a9bbf None admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:05.416001 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d44a517-bdaa-4113-8d41-1eeb6f2a9bbf None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:05.416296 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d44a517-bdaa-4113-8d41-1eeb6f2a9bbf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:05.417846 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d44a517-bdaa-4113-8d41-1eeb6f2a9bbf None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:05.437527 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:05.451124 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 344/699] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:51:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 09:51:05.453633 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 356/700] 10.222.0.27 () {56 vars in 1133 bytes} [Wed Aug 10 09:51:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:05.459358 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517f7422-cb3c-4f46-b4b8-c613670f4ddb None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:05.496216 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d44a517-bdaa-4113-8d41-1eeb6f2a9bbf None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:05.564874 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:05.613889 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517f7422-cb3c-4f46-b4b8-c613670f4ddb None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:05.650189 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d44a517-bdaa-4113-8d41-1eeb6f2a9bbf None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:05.654285 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e96e5b-a76b-4673-8a5d-0965dfa0f0e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:05.654980 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e96e5b-a76b-4673-8a5d-0965dfa0f0e1 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:05.655379 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e96e5b-a76b-4673-8a5d-0965dfa0f0e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:05.655707 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e96e5b-a76b-4673-8a5d-0965dfa0f0e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:05.698021 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb2ce7c-5096-471d-a53c-cd9a932392b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:05.699888 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb2ce7c-5096-471d-a53c-cd9a932392b5 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:05.700349 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb2ce7c-5096-471d-a53c-cd9a932392b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:05.700824 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb2ce7c-5096-471d-a53c-cd9a932392b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:05.714785 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb2ce7c-5096-471d-a53c-cd9a932392b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:05.716713 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb2ce7c-5096-471d-a53c-cd9a932392b5 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:05.722761 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:05.737396 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e96e5b-a76b-4673-8a5d-0965dfa0f0e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:05.738656 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-6fb2ce7c-5096-471d-a53c-cd9a932392b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:51:05.738656 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:05.738656 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:05.738656 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:05.738656 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:05.738656 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:05.738656 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:05.738656 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:05.738656 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:05.738656 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:05.738656 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:05.738656 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:05.738656 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 09:51:05.738656 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 09:51:05.738656 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 09:51:05.738656 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 09:51:05.739758 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:05.739758 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:05.739758 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:05.739758 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:05.739758 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:05.739758 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:05.739758 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:05.739758 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:05.739758 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:05.739758 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:05.739758 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:05.739758 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:05.739758 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:05.739758 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:05.739758 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:05.739758 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:05.739758 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 09:51:05.740879 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 09:51:05.740879 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:51:05.740879 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:51:05.741519 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 357/701] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 10 09:51:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:51:05.742267 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e96e5b-a76b-4673-8a5d-0965dfa0f0e1 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:05.748187 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb2ce7c-5096-471d-a53c-cd9a932392b5 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:05.861222 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 345/702] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 10 09:51:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 09:51:05.862481 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e96e5b-a76b-4673-8a5d-0965dfa0f0e1 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:05.873584 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:05.885934 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb2ce7c-5096-471d-a53c-cd9a932392b5 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:05.936222 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b6a5a1-23de-4c23-b77e-b21c9012613f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:05.936842 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b6a5a1-23de-4c23-b77e-b21c9012613f None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:05.937148 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b6a5a1-23de-4c23-b77e-b21c9012613f None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:05.937471 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b6a5a1-23de-4c23-b77e-b21c9012613f None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:05.938147 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b6a5a1-23de-4c23-b77e-b21c9012613f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:05.938427 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b6a5a1-23de-4c23-b77e-b21c9012613f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:05.939795 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b6a5a1-23de-4c23-b77e-b21c9012613f None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:05.953442 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 358/703] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 10 09:51:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:05.958842 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b6a5a1-23de-4c23-b77e-b21c9012613f None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:05.960712 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:05.982270 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e96e5b-a76b-4673-8a5d-0965dfa0f0e1 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:06.030381 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fd7e7b-a020-4cbc-8852-bab709e4f86e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:06.031175 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fd7e7b-a020-4cbc-8852-bab709e4f86e None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:06.031553 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fd7e7b-a020-4cbc-8852-bab709e4f86e None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:06.031946 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fd7e7b-a020-4cbc-8852-bab709e4f86e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:06.056641 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fd7e7b-a020-4cbc-8852-bab709e4f86e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:06.058371 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fd7e7b-a020-4cbc-8852-bab709e4f86e None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:06.083373 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-d3fd7e7b-a020-4cbc-8852-bab709e4f86e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:51:06.083373 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:06.083373 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:06.083373 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:06.083373 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:06.083373 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:06.083373 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:06.083373 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:06.083373 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:06.083373 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:06.083373 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:06.083373 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:06.083373 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 09:51:06.083373 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 09:51:06.083373 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 09:51:06.083373 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 09:51:06.084594 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:06.084594 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:06.084594 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:06.084594 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:06.084594 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:06.084594 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:06.084594 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:06.084594 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:06.084594 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:06.084594 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:06.084594 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:06.084594 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:06.084594 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:06.084594 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:06.084594 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:06.084594 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:06.084594 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 09:51:06.085780 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 09:51:06.085780 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:51:06.085780 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:51:06.089708 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 346/704] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 10 09:51:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:51:06.095877 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fd7e7b-a020-4cbc-8852-bab709e4f86e None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:06.105299 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b6a5a1-23de-4c23-b77e-b21c9012613f None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:06.184443 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948e2a99-b0dc-4a70-9bf9-d14994a87e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:06.185093 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948e2a99-b0dc-4a70-9bf9-d14994a87e26 None admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:06.185387 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948e2a99-b0dc-4a70-9bf9-d14994a87e26 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:06.185663 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948e2a99-b0dc-4a70-9bf9-d14994a87e26 None admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:06.186318 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948e2a99-b0dc-4a70-9bf9-d14994a87e26 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:06.187765 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948e2a99-b0dc-4a70-9bf9-d14994a87e26 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:06.221195 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 359/705] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Aug 10 09:51:05 2022] POST /identity/v3/users => generated 254 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 09:51:06.222841 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385d209c-43c7-4b8a-9561-dfd4a60d7421 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:06.223130 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385d209c-43c7-4b8a-9561-dfd4a60d7421 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:06.223401 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385d209c-43c7-4b8a-9561-dfd4a60d7421 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:06.226656 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 360/706] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:51:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:51:06.236474 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd64c481-5bc3-4a70-8c87-779ac93c9974 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:06.236654 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd64c481-5bc3-4a70-8c87-779ac93c9974 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:06.236929 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd64c481-5bc3-4a70-8c87-779ac93c9974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:06.259764 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-cd64c481-5bc3-4a70-8c87-779ac93c9974 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:51:06.261120 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-cd64c481-5bc3-4a70-8c87-779ac93c9974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:51:06.263498 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:06.281027 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fd7e7b-a020-4cbc-8852-bab709e4f86e None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:06.354229 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 361/707] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:51:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 10 09:51:06.364079 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab87ee6-d2e6-4bcd-89eb-9437cd8be41f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:06.364879 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab87ee6-d2e6-4bcd-89eb-9437cd8be41f None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:06.365430 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab87ee6-d2e6-4bcd-89eb-9437cd8be41f None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:06.365860 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab87ee6-d2e6-4bcd-89eb-9437cd8be41f None admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:06.366747 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab87ee6-d2e6-4bcd-89eb-9437cd8be41f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:06.367207 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab87ee6-d2e6-4bcd-89eb-9437cd8be41f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:06.368789 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab87ee6-d2e6-4bcd-89eb-9437cd8be41f None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:06.378745 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:06.383656 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 347/708] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 10 09:51:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:06.388555 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd64c481-5bc3-4a70-8c87-779ac93c9974 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:06.397541 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab87ee6-d2e6-4bcd-89eb-9437cd8be41f None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:06.544484 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd64c481-5bc3-4a70-8c87-779ac93c9974 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:06.554873 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab87ee6-d2e6-4bcd-89eb-9437cd8be41f None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:06.593477 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cff19a-0af0-4496-9dee-2ccaca35e973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:06.594128 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cff19a-0af0-4496-9dee-2ccaca35e973 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:06.594412 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cff19a-0af0-4496-9dee-2ccaca35e973 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:06.594998 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cff19a-0af0-4496-9dee-2ccaca35e973 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:06.596106 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cff19a-0af0-4496-9dee-2ccaca35e973 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:06.597874 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cff19a-0af0-4496-9dee-2ccaca35e973 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:06.603931 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22b14e2-264f-45ed-b119-1a87a57f7b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:06.604579 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22b14e2-264f-45ed-b119-1a87a57f7b01 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:06.604859 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22b14e2-264f-45ed-b119-1a87a57f7b01 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:06.605227 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22b14e2-264f-45ed-b119-1a87a57f7b01 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:06.612966 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22b14e2-264f-45ed-b119-1a87a57f7b01 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:06.613539 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-07cff19a-0af0-4496-9dee-2ccaca35e973 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 10 09:51:06.613539 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:06.613539 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 09:51:06.613539 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 09:51:06.613539 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 09:51:06.613539 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 09:51:06.613539 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 09:51:06.613539 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 09:51:06.613539 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 10 09:51:06.613539 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:51:06.613539 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 09:51:06.613539 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:51:06.613539 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:06.613539 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:06.613539 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:06.613539 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:06.613539 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:06.614533 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:06.614533 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:06.614533 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:06.614533 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:06.614533 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:06.614533 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:06.614533 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 09:51:06.614533 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 09:51:06.614533 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 09:51:06.614533 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 09:51:06.614533 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:06.614533 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:06.614533 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:06.614533 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:06.614533 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:06.614533 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:06.615368 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:06.615368 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:06.615368 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:06.615368 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:06.615368 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:06.615368 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:06.615368 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:06.615368 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:06.615368 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:06.615368 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:06.615368 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 09:51:06.615368 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 09:51:06.615368 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 10 09:51:06.615368 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:51:06.616180 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22b14e2-264f-45ed-b119-1a87a57f7b01 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:06.618045 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 362/709] 10.222.0.27 () {56 vars in 1129 bytes} [Wed Aug 10 09:51:06 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 09:51:06.624234 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cff19a-0af0-4496-9dee-2ccaca35e973 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:06.627833 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:06.631969 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-b22b14e2-264f-45ed-b119-1a87a57f7b01 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 09:51:06.631969 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:06.631969 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:06.631969 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:06.631969 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:06.631969 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:06.631969 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:06.631969 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:06.631969 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:06.631969 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:06.631969 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:06.631969 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:06.631969 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 09:51:06.631969 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 09:51:06.631969 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 09:51:06.633383 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 09:51:06.633383 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:06.633383 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:06.633383 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:06.633383 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:06.633383 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:06.633383 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:06.633383 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:06.633383 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:06.633383 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:06.633383 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:06.633383 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:06.633383 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:06.633383 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:06.633383 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:06.633383 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:06.633383 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:06.634284 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 09:51:06.634284 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 09:51:06.634284 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 09:51:06.634284 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 09:51:06.634284 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 09:51:06.634284 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 09:51:06.634284 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 09:51:06.634284 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:51:06.634284 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 348/710] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 10 09:51:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:51:06.639246 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22b14e2-264f-45ed-b119-1a87a57f7b01 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:06.726045 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:06.763667 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cff19a-0af0-4496-9dee-2ccaca35e973 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:06.782462 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22b14e2-264f-45ed-b119-1a87a57f7b01 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:06.813835 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7bac80-5e4c-4715-af89-53ec1f420329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:06.814377 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7bac80-5e4c-4715-af89-53ec1f420329 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:06.814654 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7bac80-5e4c-4715-af89-53ec1f420329 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:06.814928 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7bac80-5e4c-4715-af89-53ec1f420329 None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:06.815567 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7bac80-5e4c-4715-af89-53ec1f420329 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:06.815875 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7bac80-5e4c-4715-af89-53ec1f420329 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:06.819509 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7bac80-5e4c-4715-af89-53ec1f420329 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:06.828693 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 363/711] 10.222.0.27 () {56 vars in 1124 bytes} [Wed Aug 10 09:51:06 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:06.838047 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7bac80-5e4c-4715-af89-53ec1f420329 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:06.840778 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2387c85b-6a28-4f00-b012-81f5b9c5a939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:06.841715 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2387c85b-6a28-4f00-b012-81f5b9c5a939 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:06.842242 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2387c85b-6a28-4f00-b012-81f5b9c5a939 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:06.842734 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2387c85b-6a28-4f00-b012-81f5b9c5a939 None admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:06.843645 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2387c85b-6a28-4f00-b012-81f5b9c5a939 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:06.844153 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2387c85b-6a28-4f00-b012-81f5b9c5a939 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:06.845856 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2387c85b-6a28-4f00-b012-81f5b9c5a939 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:06.876460 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 349/712] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Aug 10 09:51:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 09:51:06.882588 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2387c85b-6a28-4f00-b012-81f5b9c5a939 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:06.914703 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:06.956889 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7bac80-5e4c-4715-af89-53ec1f420329 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:07.006282 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9157bf22-6729-43b6-a3fa-39b6f33bd1b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:07.006984 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9157bf22-6729-43b6-a3fa-39b6f33bd1b4 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:07.007264 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9157bf22-6729-43b6-a3fa-39b6f33bd1b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:07.007533 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9157bf22-6729-43b6-a3fa-39b6f33bd1b4 None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:07.008177 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9157bf22-6729-43b6-a3fa-39b6f33bd1b4 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:07.008471 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9157bf22-6729-43b6-a3fa-39b6f33bd1b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:07.010481 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9157bf22-6729-43b6-a3fa-39b6f33bd1b4 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:07.017557 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 364/713] 10.222.0.27 () {56 vars in 1124 bytes} [Wed Aug 10 09:51:06 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:07.063112 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2387c85b-6a28-4f00-b012-81f5b9c5a939 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:07.086412 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:07.108533 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46a3799-cf56-45ce-8d0d-21aa8181c04f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:07.109205 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46a3799-cf56-45ce-8d0d-21aa8181c04f None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:07.109482 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46a3799-cf56-45ce-8d0d-21aa8181c04f None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:07.109750 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46a3799-cf56-45ce-8d0d-21aa8181c04f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:07.110492 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46a3799-cf56-45ce-8d0d-21aa8181c04f None admin] RBAC: Adding query filter params (role.id=eb04edc46b3742d7a0f0ead26f68bc22, scope.project.id=d47d5b72a00642a1a239b785110643ef, user.id=dd8580888cba41a88566da4540b1130c) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:07.110797 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46a3799-cf56-45ce-8d0d-21aa8181c04f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:07.112238 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46a3799-cf56-45ce-8d0d-21aa8181c04f None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:07.118648 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 350/714] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 10 09:51:06 2022] GET /identity/v3/role_assignments?user.id=dd8580888cba41a88566da4540b1130c&scope.project.id=d47d5b72a00642a1a239b785110643ef&role.id=eb04edc46b3742d7a0f0ead26f68bc22 => generated 259 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:07.201382 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1069c309-066d-483d-84fd-1283052148a0 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:07.201754 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1069c309-066d-483d-84fd-1283052148a0 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:07.201934 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1069c309-066d-483d-84fd-1283052148a0 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:07.203646 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 365/715] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:51:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:51:07.209532 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de76bf0c-6d0f-4067-ae02-97fd81af1487 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:07.209946 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de76bf0c-6d0f-4067-ae02-97fd81af1487 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:07.210220 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de76bf0c-6d0f-4067-ae02-97fd81af1487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:07.238368 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-de76bf0c-6d0f-4067-ae02-97fd81af1487 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:51:07.239645 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-de76bf0c-6d0f-4067-ae02-97fd81af1487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:51:07.323241 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 351/716] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:51:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 09:51:07.345693 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1069c309-066d-483d-84fd-1283052148a0 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:07.461932 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1069c309-066d-483d-84fd-1283052148a0 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:07.496262 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:07.506991 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8755166c-eb07-44b2-9aaf-2c8a34194277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:07.507633 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8755166c-eb07-44b2-9aaf-2c8a34194277 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:07.507912 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8755166c-eb07-44b2-9aaf-2c8a34194277 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:07.508182 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8755166c-eb07-44b2-9aaf-2c8a34194277 None admin] PATH_INFO: `/v3/services/network` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:07.508775 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8755166c-eb07-44b2-9aaf-2c8a34194277 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:07.510192 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8755166c-eb07-44b2-9aaf-2c8a34194277 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:07.526181 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-8755166c-eb07-44b2-9aaf-2c8a34194277 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 10 09:51:07.526181 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:07.526181 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 09:51:07.526181 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 09:51:07.526181 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 09:51:07.526181 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 09:51:07.526181 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 09:51:07.526181 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 09:51:07.526181 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 10 09:51:07.526181 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:51:07.526181 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 09:51:07.526181 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:51:07.526181 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:07.526181 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:07.526181 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:07.526181 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:07.526181 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:07.528551 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:07.528551 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:07.528551 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:07.528551 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:07.528551 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:07.528551 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:07.528551 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 09:51:07.528551 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 09:51:07.528551 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 09:51:07.528551 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 09:51:07.528551 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:07.528551 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:07.528551 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:07.528551 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:07.528551 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:07.528551 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:07.530605 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:07.530605 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:07.530605 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:07.530605 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:07.530605 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:07.530605 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:07.530605 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:07.530605 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:07.530605 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:07.530605 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:07.530605 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 09:51:07.530605 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 09:51:07.530605 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 10 09:51:07.530605 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:51:07.530605 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 366/717] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 10 09:51:07 2022] GET /identity/v3/services/network => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:51:07.538487 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de76bf0c-6d0f-4067-ae02-97fd81af1487 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:07.652756 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de76bf0c-6d0f-4067-ae02-97fd81af1487 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:07.672183 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:07.698692 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5c999a-66d7-4cc9-9d62-1839ed798b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:07.699315 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5c999a-66d7-4cc9-9d62-1839ed798b84 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:07.699591 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5c999a-66d7-4cc9-9d62-1839ed798b84 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:07.699862 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5c999a-66d7-4cc9-9d62-1839ed798b84 None admin] PATH_INFO: `/v3/services` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:07.700511 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5c999a-66d7-4cc9-9d62-1839ed798b84 None admin] RBAC: Adding query filter params (name=network) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:07.700814 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5c999a-66d7-4cc9-9d62-1839ed798b84 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:07.702233 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5c999a-66d7-4cc9-9d62-1839ed798b84 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:07.707187 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 352/718] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Aug 10 09:51:07 2022] GET /identity/v3/services?name=network => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:07.712780 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8755166c-eb07-44b2-9aaf-2c8a34194277 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:07.888601 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8755166c-eb07-44b2-9aaf-2c8a34194277 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:07.935107 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa9225d-c6c5-4cb7-b376-ea526a0ef345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:07.936556 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa9225d-c6c5-4cb7-b376-ea526a0ef345 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:07.937036 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa9225d-c6c5-4cb7-b376-ea526a0ef345 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:07.937530 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa9225d-c6c5-4cb7-b376-ea526a0ef345 None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:07.938367 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa9225d-c6c5-4cb7-b376-ea526a0ef345 None admin] RBAC: Adding query filter params (type=network) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:07.938872 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa9225d-c6c5-4cb7-b376-ea526a0ef345 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:07.940457 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa9225d-c6c5-4cb7-b376-ea526a0ef345 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:07.948559 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 367/719] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Aug 10 09:51:07 2022] GET /identity/v3/services?type=network => generated 124 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:08.177550 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1441b2-e8ee-4ec4-80a2-c775cc951003 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:08.178678 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1441b2-e8ee-4ec4-80a2-c775cc951003 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:08.179492 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1441b2-e8ee-4ec4-80a2-c775cc951003 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:08.182161 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 353/720] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:51:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:51:08.188497 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0bef12-5d35-4f8f-bb26-c2ce416e3f90 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:08.189038 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0bef12-5d35-4f8f-bb26-c2ce416e3f90 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:08.189553 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0bef12-5d35-4f8f-bb26-c2ce416e3f90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:08.220710 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-2a0bef12-5d35-4f8f-bb26-c2ce416e3f90 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:51:08.221926 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-2a0bef12-5d35-4f8f-bb26-c2ce416e3f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:51:08.276797 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:08.295288 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 368/721] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:51:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 09:51:08.343822 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1441b2-e8ee-4ec4-80a2-c775cc951003 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:08.492835 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1441b2-e8ee-4ec4-80a2-c775cc951003 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:08.535116 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2656bf-582f-4858-b989-72ebe8513d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:08.535755 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2656bf-582f-4858-b989-72ebe8513d56 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:08.536038 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2656bf-582f-4858-b989-72ebe8513d56 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:08.536312 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2656bf-582f-4858-b989-72ebe8513d56 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:08.554062 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2656bf-582f-4858-b989-72ebe8513d56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 09:51:08.558794 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-2f2656bf-582f-4858-b989-72ebe8513d56 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 09:51:08.558794 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:08.558794 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:08.558794 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:08.558794 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:08.558794 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:08.558794 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:08.558794 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:08.558794 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:08.558794 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:08.558794 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:08.558794 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:08.558794 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 09:51:08.558794 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 09:51:08.558794 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 09:51:08.558794 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 09:51:08.559691 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 09:51:08.559691 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 09:51:08.559691 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 09:51:08.559691 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 09:51:08.559691 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:08.559691 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:08.559691 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:08.559691 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:08.559691 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:08.559691 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:08.559691 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:08.559691 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:08.559691 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:08.559691 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:08.559691 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:08.559691 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:08.560508 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:08.560508 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:08.560508 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:08.560508 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:08.560508 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 09:51:08.560508 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 09:51:08.560508 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 09:51:08.560508 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 09:51:08.560508 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 09:51:08.560508 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 09:51:08.560508 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 09:51:08.560508 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:51:08.560508 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 354/722] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Aug 10 09:51:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:51:08.566244 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0bef12-5d35-4f8f-bb26-c2ce416e3f90 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:08.745980 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0bef12-5d35-4f8f-bb26-c2ce416e3f90 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:08.903374 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172bd735-ca7b-40fc-b32e-4c936a3d0b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:08.903984 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172bd735-ca7b-40fc-b32e-4c936a3d0b59 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:08.904262 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172bd735-ca7b-40fc-b32e-4c936a3d0b59 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:08.904533 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172bd735-ca7b-40fc-b32e-4c936a3d0b59 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:08.905234 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172bd735-ca7b-40fc-b32e-4c936a3d0b59 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:08.905594 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172bd735-ca7b-40fc-b32e-4c936a3d0b59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:08.907129 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172bd735-ca7b-40fc-b32e-4c936a3d0b59 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:08.915602 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 369/723] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 10 09:51:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:08.921018 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2656bf-582f-4858-b989-72ebe8513d56 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:08.991225 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:09.039673 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32061abc-8c15-4ecb-82f8-e463cb561233 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:09.040186 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32061abc-8c15-4ecb-82f8-e463cb561233 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:09.040186 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32061abc-8c15-4ecb-82f8-e463cb561233 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:09.041755 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 370/724] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:51:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 09:51:09.046299 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b98e0f9-6c7a-4eab-a65d-75273487d95b None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:09.046580 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b98e0f9-6c7a-4eab-a65d-75273487d95b None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:09.046859 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b98e0f9-6c7a-4eab-a65d-75273487d95b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:09.059844 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2656bf-582f-4858-b989-72ebe8513d56 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:09.078430 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-0b98e0f9-6c7a-4eab-a65d-75273487d95b None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:51:09.079628 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-0b98e0f9-6c7a-4eab-a65d-75273487d95b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:51:09.094499 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7a1cea-3a7c-4cf0-a5be-39c6e2d05bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:09.095131 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7a1cea-3a7c-4cf0-a5be-39c6e2d05bc9 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:09.095405 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7a1cea-3a7c-4cf0-a5be-39c6e2d05bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:09.095674 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7a1cea-3a7c-4cf0-a5be-39c6e2d05bc9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:09.121116 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7a1cea-3a7c-4cf0-a5be-39c6e2d05bc9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:09.122588 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7a1cea-3a7c-4cf0-a5be-39c6e2d05bc9 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:09.152536 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-3a7a1cea-3a7c-4cf0-a5be-39c6e2d05bc9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:51:09.152536 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:09.152536 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:09.152536 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:09.152536 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:09.152536 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:09.152536 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:09.152536 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:09.152536 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:09.152536 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:09.152536 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:09.152536 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:09.152536 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 09:51:09.152536 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 09:51:09.152536 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 09:51:09.152536 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 09:51:09.153553 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:09.153553 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:09.153553 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:09.153553 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:09.153553 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:09.153553 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:09.153553 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:09.153553 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:09.153553 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:09.153553 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:09.153553 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:09.153553 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:09.153553 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:09.153553 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:09.153553 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:09.153553 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:09.153553 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 09:51:09.155192 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 09:51:09.155192 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:51:09.155192 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:51:09.155192 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 355/725] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 10 09:51:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:51:09.162215 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7a1cea-3a7c-4cf0-a5be-39c6e2d05bc9 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:09.175291 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:09.198496 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 371/726] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:51:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 10 09:51:09.239318 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b98e0f9-6c7a-4eab-a65d-75273487d95b None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:09.304153 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:09.318205 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7a1cea-3a7c-4cf0-a5be-39c6e2d05bc9 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:09.347685 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b98e0f9-6c7a-4eab-a65d-75273487d95b None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:09.383531 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f6e2ec-2b29-4263-bb55-bf464135e571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:09.384542 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f6e2ec-2b29-4263-bb55-bf464135e571 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:09.385020 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f6e2ec-2b29-4263-bb55-bf464135e571 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:09.385517 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f6e2ec-2b29-4263-bb55-bf464135e571 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:09.386368 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1631735-c97a-4bde-8395-4472ee217be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:09.386980 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1631735-c97a-4bde-8395-4472ee217be6 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:09.387257 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1631735-c97a-4bde-8395-4472ee217be6 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:09.387524 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1631735-c97a-4bde-8395-4472ee217be6 None admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:09.388183 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1631735-c97a-4bde-8395-4472ee217be6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:09.388641 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1631735-c97a-4bde-8395-4472ee217be6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:09.390117 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1631735-c97a-4bde-8395-4472ee217be6 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:09.398318 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f6e2ec-2b29-4263-bb55-bf464135e571 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 09:51:09.403621 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-94f6e2ec-2b29-4263-bb55-bf464135e571 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 09:51:09.403621 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:09.403621 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:09.403621 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:09.403621 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:09.403621 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:09.403621 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:09.403621 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:09.403621 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:09.403621 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:09.403621 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:09.403621 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:09.403621 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 09:51:09.403621 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 09:51:09.403621 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 09:51:09.403621 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 09:51:09.404577 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 09:51:09.404577 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 09:51:09.404577 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 09:51:09.404577 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 09:51:09.404577 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:09.404577 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:09.404577 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:09.404577 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:09.404577 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:09.404577 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:09.404577 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:09.404577 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:09.404577 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:09.404577 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:09.404577 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:09.404577 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:09.405446 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:09.405446 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:09.405446 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:09.405446 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:09.405446 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 09:51:09.405446 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 09:51:09.405446 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 09:51:09.405446 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 09:51:09.405446 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 09:51:09.405446 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 09:51:09.405446 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 09:51:09.405446 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:51:09.412853 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 372/727] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Aug 10 09:51:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:51:09.414142 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 356/728] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 10 09:51:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:09.414715 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f6e2ec-2b29-4263-bb55-bf464135e571 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:09.420252 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1631735-c97a-4bde-8395-4472ee217be6 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:09.461038 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:09.550937 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f6e2ec-2b29-4263-bb55-bf464135e571 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:09.618562 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101facaf-5362-4ef2-91ef-c221f16fbbd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:09.619092 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101facaf-5362-4ef2-91ef-c221f16fbbd7 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:09.619366 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101facaf-5362-4ef2-91ef-c221f16fbbd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:09.619630 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101facaf-5362-4ef2-91ef-c221f16fbbd7 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:09.620296 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101facaf-5362-4ef2-91ef-c221f16fbbd7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:09.620592 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101facaf-5362-4ef2-91ef-c221f16fbbd7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:09.621999 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101facaf-5362-4ef2-91ef-c221f16fbbd7 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:09.625950 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1631735-c97a-4bde-8395-4472ee217be6 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:09.638036 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 373/729] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Aug 10 09:51:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 09:51:09.639623 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0978cfb8-63d4-4456-a82f-e5a2148c7f9b None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:09.640176 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0978cfb8-63d4-4456-a82f-e5a2148c7f9b None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:09.640751 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0978cfb8-63d4-4456-a82f-e5a2148c7f9b None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:09.644941 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 374/730] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:51:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:51:09.646335 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0978cfb8-63d4-4456-a82f-e5a2148c7f9b None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:09.677171 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b1881c-7636-4fba-af19-685add22f033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:09.678232 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b1881c-7636-4fba-af19-685add22f033 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:09.679083 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b1881c-7636-4fba-af19-685add22f033 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:09.679083 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b1881c-7636-4fba-af19-685add22f033 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:09.687039 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b1881c-7636-4fba-af19-685add22f033 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:09.688504 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b1881c-7636-4fba-af19-685add22f033 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:09.701013 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-f2b1881c-7636-4fba-af19-685add22f033 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 10 09:51:09.701013 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:09.701013 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:09.701013 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:09.701013 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:09.701013 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:09.701013 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:09.701013 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:09.701013 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:09.701013 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:09.701013 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:09.701013 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:09.701013 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 09:51:09.701013 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 09:51:09.701013 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 09:51:09.701013 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 09:51:09.702106 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:09.702106 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:09.702106 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 09:51:09.702106 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 09:51:09.702106 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 09:51:09.702106 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 09:51:09.702106 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:09.702106 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:09.702106 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:09.702106 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:09.702106 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:09.702106 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:09.702106 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:09.702106 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:09.702106 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:09.702106 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:09.702106 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:09.702106 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:09.708347 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:09.708347 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:09.708347 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 09:51:09.708347 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 09:51:09.708347 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 09:51:09.708347 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 09:51:09.708347 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 09:51:09.708347 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 09:51:09.708347 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 10 09:51:09.708347 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:51:09.708347 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 357/731] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Aug 10 09:51:09 2022] GET /identity/v3/users/swift => generated 83 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 09:51:09.708347 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a37cb90-cb01-4a8b-81ff-e53d67e615ba None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:09.708347 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a37cb90-cb01-4a8b-81ff-e53d67e615ba None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:09.709962 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a37cb90-cb01-4a8b-81ff-e53d67e615ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:09.721614 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-2a37cb90-cb01-4a8b-81ff-e53d67e615ba None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:51:09.722888 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-2a37cb90-cb01-4a8b-81ff-e53d67e615ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:51:09.726864 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:09.768099 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0978cfb8-63d4-4456-a82f-e5a2148c7f9b None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:09.769846 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:09.797714 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 358/732] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:51:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 09:51:09.805244 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf1f44d-6edc-44d2-8c26-9230c0ba99dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:09.805873 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf1f44d-6edc-44d2-8c26-9230c0ba99dc None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:09.806157 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf1f44d-6edc-44d2-8c26-9230c0ba99dc None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:09.806419 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf1f44d-6edc-44d2-8c26-9230c0ba99dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:09.807705 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932abd05-f25d-484a-8bf6-e0d5a6d71502 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:09.808475 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932abd05-f25d-484a-8bf6-e0d5a6d71502 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:09.809477 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932abd05-f25d-484a-8bf6-e0d5a6d71502 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:09.811314 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 359/733] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:51:09 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:51:09.812323 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932abd05-f25d-484a-8bf6-e0d5a6d71502 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:09.825838 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf1f44d-6edc-44d2-8c26-9230c0ba99dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:09.828149 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf1f44d-6edc-44d2-8c26-9230c0ba99dc None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:09.843520 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-dbf1f44d-6edc-44d2-8c26-9230c0ba99dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:51:09.843520 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:09.843520 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:09.843520 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:09.843520 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:09.843520 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:09.843520 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:09.843520 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:09.843520 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:09.843520 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:09.843520 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:09.843520 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:09.843520 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 09:51:09.843520 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 09:51:09.843520 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 09:51:09.843520 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 09:51:09.844499 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:09.844499 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:09.844499 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:09.844499 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:09.844499 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:09.844499 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:09.844499 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:09.844499 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:09.844499 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:09.844499 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:09.844499 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:09.844499 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:09.844499 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:09.844499 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:09.844499 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:09.844499 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:09.844499 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 09:51:09.845399 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 09:51:09.845399 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:51:09.845399 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:51:09.845399 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 375/734] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 10 09:51:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:51:09.846200 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e3e7a1-c11d-4d3e-bfd0-b29e21dba88b None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:09.846200 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e3e7a1-c11d-4d3e-bfd0-b29e21dba88b None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:09.846443 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e3e7a1-c11d-4d3e-bfd0-b29e21dba88b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:09.864717 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-97e3e7a1-c11d-4d3e-bfd0-b29e21dba88b None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:51:09.865887 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-97e3e7a1-c11d-4d3e-bfd0-b29e21dba88b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:51:09.931980 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932abd05-f25d-484a-8bf6-e0d5a6d71502 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:09.939320 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 376/735] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:51:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 09:51:09.940917 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e3e7a1-c11d-4d3e-bfd0-b29e21dba88b None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:09.969034 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d3f221-73c8-466a-bdd7-69bdd1e8e11d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:09.969675 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d3f221-73c8-466a-bdd7-69bdd1e8e11d None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:09.969941 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d3f221-73c8-466a-bdd7-69bdd1e8e11d None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:09.970207 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d3f221-73c8-466a-bdd7-69bdd1e8e11d None admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:09.970939 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d3f221-73c8-466a-bdd7-69bdd1e8e11d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:09.971240 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d3f221-73c8-466a-bdd7-69bdd1e8e11d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:09.972733 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d3f221-73c8-466a-bdd7-69bdd1e8e11d None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:09.982956 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:09.992358 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 360/736] 10.222.0.27 () {56 vars in 1135 bytes} [Wed Aug 10 09:51:09 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:09.993222 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d3f221-73c8-466a-bdd7-69bdd1e8e11d None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:10.038148 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:10.054891 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e3e7a1-c11d-4d3e-bfd0-b29e21dba88b None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:10.089823 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4980f778-4f39-4925-88d9-0c93f994412c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:10.090455 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4980f778-4f39-4925-88d9-0c93f994412c None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:10.090728 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4980f778-4f39-4925-88d9-0c93f994412c None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:10.090992 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4980f778-4f39-4925-88d9-0c93f994412c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:10.099063 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d3f221-73c8-466a-bdd7-69bdd1e8e11d None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:10.102103 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4980f778-4f39-4925-88d9-0c93f994412c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 09:51:10.106650 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-4980f778-4f39-4925-88d9-0c93f994412c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 09:51:10.106650 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:10.106650 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:10.106650 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:10.106650 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:10.106650 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:10.106650 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:10.106650 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:10.106650 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:10.106650 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:10.106650 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:10.106650 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:10.106650 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 09:51:10.106650 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 09:51:10.106650 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 09:51:10.106650 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 09:51:10.107598 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 09:51:10.107598 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 09:51:10.107598 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 09:51:10.107598 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 09:51:10.107598 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:10.107598 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:10.107598 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:10.107598 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:10.107598 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:10.107598 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:10.107598 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:10.107598 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:10.107598 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:10.107598 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:10.107598 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:10.107598 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:10.109144 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:10.109144 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:10.109144 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:10.109144 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:10.109144 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 09:51:10.109144 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 09:51:10.109144 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 09:51:10.109144 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 09:51:10.109144 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 09:51:10.109144 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 09:51:10.109144 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 09:51:10.109144 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:51:10.109144 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 377/737] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Aug 10 09:51:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:51:10.109144 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4980f778-4f39-4925-88d9-0c93f994412c None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:10.140937 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad0f6b9-9a56-4934-94e1-5cf6757bb45d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:10.141713 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad0f6b9-9a56-4934-94e1-5cf6757bb45d None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:10.141991 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad0f6b9-9a56-4934-94e1-5cf6757bb45d None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:10.142265 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad0f6b9-9a56-4934-94e1-5cf6757bb45d None admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:10.142918 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad0f6b9-9a56-4934-94e1-5cf6757bb45d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:10.143223 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad0f6b9-9a56-4934-94e1-5cf6757bb45d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:10.144595 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad0f6b9-9a56-4934-94e1-5cf6757bb45d None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:10.157722 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 361/738] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 10 09:51:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:10.158544 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad0f6b9-9a56-4934-94e1-5cf6757bb45d None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:10.216606 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4980f778-4f39-4925-88d9-0c93f994412c None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:10.221250 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:10.250517 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b159e60b-b98c-4c51-9bf7-7be4055e195f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:10.251127 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b159e60b-b98c-4c51-9bf7-7be4055e195f None admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:10.251407 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b159e60b-b98c-4c51-9bf7-7be4055e195f None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:10.251680 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b159e60b-b98c-4c51-9bf7-7be4055e195f None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:10.252324 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b159e60b-b98c-4c51-9bf7-7be4055e195f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:10.253734 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b159e60b-b98c-4c51-9bf7-7be4055e195f None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:10.268987 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad0f6b9-9a56-4934-94e1-5cf6757bb45d None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:10.281097 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 378/739] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Aug 10 09:51:10 2022] POST /identity/v3/services => generated 251 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 09:51:10.281097 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b159e60b-b98c-4c51-9bf7-7be4055e195f None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:10.283032 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:10.337516 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4649808-6953-4a07-8511-3f3c0025a073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:10.338153 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4649808-6953-4a07-8511-3f3c0025a073 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:10.338460 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4649808-6953-4a07-8511-3f3c0025a073 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:10.339002 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4649808-6953-4a07-8511-3f3c0025a073 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:10.410349 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b159e60b-b98c-4c51-9bf7-7be4055e195f None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:10.426016 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4649808-6953-4a07-8511-3f3c0025a073 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:10.427563 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4649808-6953-4a07-8511-3f3c0025a073 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:10.446540 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9824f3d3-ab76-4a5e-a477-66f52023f3d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:10.447155 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9824f3d3-ab76-4a5e-a477-66f52023f3d0 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:10.447434 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9824f3d3-ab76-4a5e-a477-66f52023f3d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:10.447717 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9824f3d3-ab76-4a5e-a477-66f52023f3d0 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:10.448392 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9824f3d3-ab76-4a5e-a477-66f52023f3d0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:10.448690 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9824f3d3-ab76-4a5e-a477-66f52023f3d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:10.450102 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9824f3d3-ab76-4a5e-a477-66f52023f3d0 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:10.459878 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 379/740] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 10 09:51:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:10.460925 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9824f3d3-ab76-4a5e-a477-66f52023f3d0 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:10.487518 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:10.537384 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 362/741] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 10 09:51:10 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 10 09:51:10.538809 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc199b6-3861-4fe7-b52c-7801f177fd8e None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:10.539179 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc199b6-3861-4fe7-b52c-7801f177fd8e None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:10.539513 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc199b6-3861-4fe7-b52c-7801f177fd8e None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:10.540988 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 363/742] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:51:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:51:10.545708 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc199b6-3861-4fe7-b52c-7801f177fd8e None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:10.546609 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:10.593722 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9824f3d3-ab76-4a5e-a477-66f52023f3d0 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:10.630814 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b340044e-7cb6-48d9-a9f4-80fef62a55bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:10.631683 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b340044e-7cb6-48d9-a9f4-80fef62a55bb None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:10.631961 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b340044e-7cb6-48d9-a9f4-80fef62a55bb None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:10.632227 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b340044e-7cb6-48d9-a9f4-80fef62a55bb None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:10.640820 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b340044e-7cb6-48d9-a9f4-80fef62a55bb None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:10.642287 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b340044e-7cb6-48d9-a9f4-80fef62a55bb None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:10.653191 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc199b6-3861-4fe7-b52c-7801f177fd8e None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:10.653601 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-b340044e-7cb6-48d9-a9f4-80fef62a55bb None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 10 09:51:10.653601 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:10.653601 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:10.653601 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:10.653601 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:10.653601 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:10.653601 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:10.653601 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:10.653601 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:10.653601 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:10.653601 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:10.653601 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:10.653601 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 09:51:10.653601 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 09:51:10.653601 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 09:51:10.653601 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 09:51:10.654515 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:10.654515 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:10.654515 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 09:51:10.654515 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 09:51:10.654515 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 09:51:10.654515 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 09:51:10.654515 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:10.654515 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:10.654515 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:10.654515 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:10.654515 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:10.654515 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:10.654515 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:10.654515 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:10.654515 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:10.654515 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:10.654515 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:10.654515 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:10.655435 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:10.655435 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:10.655435 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 09:51:10.655435 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 09:51:10.655435 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 09:51:10.655435 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 09:51:10.655435 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 09:51:10.655435 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 09:51:10.655435 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 10 09:51:10.655435 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:51:10.655435 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 380/743] 10.222.0.27 () {56 vars in 1117 bytes} [Wed Aug 10 09:51:10 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:51:10.656065 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b340044e-7cb6-48d9-a9f4-80fef62a55bb None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:10.695592 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e0ee79-06e8-4839-993f-5dd047480a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:10.696217 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e0ee79-06e8-4839-993f-5dd047480a7f None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:10.696496 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e0ee79-06e8-4839-993f-5dd047480a7f None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:10.696962 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e0ee79-06e8-4839-993f-5dd047480a7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:10.707027 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e0ee79-06e8-4839-993f-5dd047480a7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:10.708488 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e0ee79-06e8-4839-993f-5dd047480a7f None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:10.723059 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-b5e0ee79-06e8-4839-993f-5dd047480a7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:51:10.723059 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:10.723059 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:10.723059 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:10.723059 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:10.723059 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:10.723059 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:10.723059 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:10.723059 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:10.723059 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:10.723059 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:10.723059 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:10.723059 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 09:51:10.723059 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 09:51:10.723059 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 09:51:10.723059 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 09:51:10.724039 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:10.724039 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:10.724039 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:10.724039 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:10.724039 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:10.724039 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:10.724039 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:10.724039 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:10.724039 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:10.724039 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:10.724039 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:10.724039 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:10.724039 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:10.724039 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:10.724039 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:10.724039 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:10.724039 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 09:51:10.724912 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 09:51:10.724912 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:51:10.724912 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:51:10.724912 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 364/744] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 10 09:51:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:51:10.725890 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cada3d8-74f6-4d9e-a0bb-66d92dfc0e3b None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:10.725890 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cada3d8-74f6-4d9e-a0bb-66d92dfc0e3b None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:10.725890 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cada3d8-74f6-4d9e-a0bb-66d92dfc0e3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:10.739767 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:10.745917 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-5cada3d8-74f6-4d9e-a0bb-66d92dfc0e3b None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:51:10.747102 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-5cada3d8-74f6-4d9e-a0bb-66d92dfc0e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:51:10.774509 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b340044e-7cb6-48d9-a9f4-80fef62a55bb None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:10.802451 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:10.812997 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d99c21-b46e-4090-b76a-d283f3ac4275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:10.813648 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d99c21-b46e-4090-b76a-d283f3ac4275 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:10.813925 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d99c21-b46e-4090-b76a-d283f3ac4275 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:10.814193 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d99c21-b46e-4090-b76a-d283f3ac4275 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:10.825240 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 365/745] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:51:10 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 10 09:51:10.825240 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cada3d8-74f6-4d9e-a0bb-66d92dfc0e3b None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:10.834440 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d99c21-b46e-4090-b76a-d283f3ac4275 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:10.836039 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d99c21-b46e-4090-b76a-d283f3ac4275 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:10.850997 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-33d99c21-b46e-4090-b76a-d283f3ac4275 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:51:10.850997 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:10.850997 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:10.850997 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:10.850997 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:10.850997 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:10.850997 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:10.850997 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:10.850997 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:10.850997 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:10.850997 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:10.850997 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:10.850997 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 09:51:10.850997 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 09:51:10.850997 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 09:51:10.850997 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 09:51:10.852010 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:10.852010 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:10.852010 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:10.852010 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:10.852010 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:10.852010 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:10.852010 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:10.852010 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:10.852010 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:10.852010 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:10.852010 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:10.852010 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:10.852010 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:10.852010 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:10.852010 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:10.852010 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:10.852010 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 09:51:10.852905 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 09:51:10.852905 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:51:10.852905 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:51:10.852905 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 381/746] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 10 09:51:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:51:10.853257 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d99c21-b46e-4090-b76a-d283f3ac4275 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:10.939451 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cada3d8-74f6-4d9e-a0bb-66d92dfc0e3b None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:10.963501 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d99c21-b46e-4090-b76a-d283f3ac4275 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:10.975260 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c88c53f-c1ee-4acf-a2bd-de8735a7e058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:10.975874 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c88c53f-c1ee-4acf-a2bd-de8735a7e058 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:10.976152 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c88c53f-c1ee-4acf-a2bd-de8735a7e058 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:10.976430 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c88c53f-c1ee-4acf-a2bd-de8735a7e058 None admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:10.977190 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c88c53f-c1ee-4acf-a2bd-de8735a7e058 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:10.977707 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c88c53f-c1ee-4acf-a2bd-de8735a7e058 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:10.978975 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c88c53f-c1ee-4acf-a2bd-de8735a7e058 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:10.982401 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:10.998327 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 366/747] 10.222.0.27 () {56 vars in 1149 bytes} [Wed Aug 10 09:51:10 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:10.998885 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c88c53f-c1ee-4acf-a2bd-de8735a7e058 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:11.002755 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742b9117-a4f5-4218-a6ad-8c6590efc33a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:11.003403 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742b9117-a4f5-4218-a6ad-8c6590efc33a None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:11.003685 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742b9117-a4f5-4218-a6ad-8c6590efc33a None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:11.003953 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742b9117-a4f5-4218-a6ad-8c6590efc33a None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:11.004601 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742b9117-a4f5-4218-a6ad-8c6590efc33a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:11.004898 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742b9117-a4f5-4218-a6ad-8c6590efc33a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:11.006301 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742b9117-a4f5-4218-a6ad-8c6590efc33a None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:11.023335 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 382/748] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 10 09:51:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:11.023335 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742b9117-a4f5-4218-a6ad-8c6590efc33a None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:11.064004 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:11.108007 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c88c53f-c1ee-4acf-a2bd-de8735a7e058 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:11.128952 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742b9117-a4f5-4218-a6ad-8c6590efc33a None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:11.141540 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697acedd-a095-49fa-aa0b-a863912c952b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:11.142147 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697acedd-a095-49fa-aa0b-a863912c952b None admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:11.142441 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697acedd-a095-49fa-aa0b-a863912c952b None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:11.142698 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697acedd-a095-49fa-aa0b-a863912c952b None admin] PATH_INFO: `/v3/services` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:11.143391 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697acedd-a095-49fa-aa0b-a863912c952b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:11.144703 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697acedd-a095-49fa-aa0b-a863912c952b None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:11.169113 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 367/749] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Aug 10 09:51:10 2022] POST /identity/v3/services => generated 240 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 09:51:11.169113 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697acedd-a095-49fa-aa0b-a863912c952b None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:11.186257 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4cf4e7-29d2-4bf3-b070-96f7c7f90a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:11.187157 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4cf4e7-29d2-4bf3-b070-96f7c7f90a1e None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:11.187432 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4cf4e7-29d2-4bf3-b070-96f7c7f90a1e None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:11.188148 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4cf4e7-29d2-4bf3-b070-96f7c7f90a1e None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:11.188818 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4cf4e7-29d2-4bf3-b070-96f7c7f90a1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:11.189412 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4cf4e7-29d2-4bf3-b070-96f7c7f90a1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:11.191003 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4cf4e7-29d2-4bf3-b070-96f7c7f90a1e None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:11.207535 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 383/750] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 10 09:51:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:11.209240 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4cf4e7-29d2-4bf3-b070-96f7c7f90a1e None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:11.231379 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:11.283473 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697acedd-a095-49fa-aa0b-a863912c952b None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:11.319295 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2af707c-b049-43ca-9b8f-bceaa494e6d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:11.319921 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2af707c-b049-43ca-9b8f-bceaa494e6d8 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:11.320199 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2af707c-b049-43ca-9b8f-bceaa494e6d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:11.320472 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2af707c-b049-43ca-9b8f-bceaa494e6d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:11.337164 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:11.347690 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4cf4e7-29d2-4bf3-b070-96f7c7f90a1e None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:11.396152 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86ba6f7-88ad-413d-b1f1-f56005dfc4c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:11.397191 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ba6f7-88ad-413d-b1f1-f56005dfc4c8 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:11.397717 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ba6f7-88ad-413d-b1f1-f56005dfc4c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:11.398133 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ba6f7-88ad-413d-b1f1-f56005dfc4c8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:11.401195 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2af707c-b049-43ca-9b8f-bceaa494e6d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:11.402776 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2af707c-b049-43ca-9b8f-bceaa494e6d8 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:11.409917 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86ba6f7-88ad-413d-b1f1-f56005dfc4c8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:11.411760 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86ba6f7-88ad-413d-b1f1-f56005dfc4c8 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:11.425301 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-c86ba6f7-88ad-413d-b1f1-f56005dfc4c8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 10 09:51:11.425301 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:11.425301 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:11.425301 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:11.425301 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:11.425301 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:11.425301 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:11.425301 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:11.425301 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:11.425301 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:11.425301 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:11.425301 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:11.425301 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 09:51:11.425301 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 09:51:11.425301 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 09:51:11.425301 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 09:51:11.426286 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:11.426286 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:11.426286 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 09:51:11.426286 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 09:51:11.426286 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 09:51:11.426286 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 09:51:11.426286 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:11.426286 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:11.426286 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:11.426286 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:11.426286 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:11.426286 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:11.426286 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:11.426286 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:11.426286 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:11.426286 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:11.426286 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:11.426286 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:11.427233 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:11.427233 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:11.427233 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 09:51:11.427233 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 09:51:11.427233 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 09:51:11.427233 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 09:51:11.427233 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 09:51:11.427233 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 09:51:11.427233 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 10 09:51:11.427233 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:51:11.427233 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 384/751] 10.222.0.27 () {56 vars in 1093 bytes} [Wed Aug 10 09:51:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:51:11.427826 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86ba6f7-88ad-413d-b1f1-f56005dfc4c8 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:11.471782 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:11.519596 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 368/752] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 10 09:51:11 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 09:51:11.521010 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2af707c-b049-43ca-9b8f-bceaa494e6d8 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:11.542527 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86ba6f7-88ad-413d-b1f1-f56005dfc4c8 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:11.577631 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9849f89c-35cf-4de9-974e-fa0f94288d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:11.578269 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9849f89c-35cf-4de9-974e-fa0f94288d5c None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:11.578546 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9849f89c-35cf-4de9-974e-fa0f94288d5c None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:11.579229 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9849f89c-35cf-4de9-974e-fa0f94288d5c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:11.588261 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9849f89c-35cf-4de9-974e-fa0f94288d5c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:11.590256 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9849f89c-35cf-4de9-974e-fa0f94288d5c None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:11.607802 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-9849f89c-35cf-4de9-974e-fa0f94288d5c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 09:51:11.607802 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:11.607802 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:11.607802 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:11.607802 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:11.607802 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:11.607802 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:11.607802 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:11.607802 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:11.607802 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:11.607802 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:11.607802 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:11.607802 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 09:51:11.607802 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 09:51:11.607802 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 09:51:11.608718 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 09:51:11.608718 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:11.608718 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:11.608718 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:11.608718 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:11.608718 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:11.608718 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:11.608718 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:11.608718 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:11.608718 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:11.608718 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:11.608718 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:11.608718 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:11.608718 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:11.608718 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:11.608718 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:11.608718 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:11.609644 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 09:51:11.609644 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 09:51:11.609644 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 09:51:11.609644 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 09:51:11.609644 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 09:51:11.609644 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 09:51:11.609644 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 09:51:11.609644 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:51:11.609644 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 385/753] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 10 09:51:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:51:11.613856 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9849f89c-35cf-4de9-974e-fa0f94288d5c None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:11.630307 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:11.637168 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2af707c-b049-43ca-9b8f-bceaa494e6d8 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:11.688277 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0416822-f0c8-4dec-9a46-a8ba8b7bceb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:11.689177 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0416822-f0c8-4dec-9a46-a8ba8b7bceb3 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:11.689513 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0416822-f0c8-4dec-9a46-a8ba8b7bceb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:11.689788 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0416822-f0c8-4dec-9a46-a8ba8b7bceb3 None admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:11.691491 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0416822-f0c8-4dec-9a46-a8ba8b7bceb3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:11.691806 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0416822-f0c8-4dec-9a46-a8ba8b7bceb3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:11.693653 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0416822-f0c8-4dec-9a46-a8ba8b7bceb3 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:11.712450 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 369/754] 10.222.0.27 () {56 vars in 1133 bytes} [Wed Aug 10 09:51:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:11.713648 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0416822-f0c8-4dec-9a46-a8ba8b7bceb3 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:11.730980 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:11.740401 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9849f89c-35cf-4de9-974e-fa0f94288d5c None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:11.779358 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51c99a2-b286-4a0a-8c94-28e63f428d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:11.780513 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51c99a2-b286-4a0a-8c94-28e63f428d33 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:11.780990 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51c99a2-b286-4a0a-8c94-28e63f428d33 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:11.781573 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51c99a2-b286-4a0a-8c94-28e63f428d33 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:11.793619 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51c99a2-b286-4a0a-8c94-28e63f428d33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:11.795545 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51c99a2-b286-4a0a-8c94-28e63f428d33 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:11.811019 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-d51c99a2-b286-4a0a-8c94-28e63f428d33 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:51:11.811019 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:11.811019 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:11.811019 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:11.811019 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:11.811019 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:11.811019 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:11.811019 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:11.811019 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:11.811019 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:11.811019 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:11.811019 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:11.811019 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 09:51:11.811019 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 09:51:11.811019 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 09:51:11.811019 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 09:51:11.812012 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:11.812012 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:11.812012 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:11.812012 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:11.812012 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:11.812012 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:11.812012 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:11.812012 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:11.812012 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:11.812012 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:11.812012 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:11.812012 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:11.812012 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:11.812012 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:11.812012 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:11.812012 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:11.812012 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 09:51:11.812884 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 09:51:11.812884 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:51:11.812884 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:51:11.815102 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 386/755] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 10 09:51:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:51:11.816261 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51c99a2-b286-4a0a-8c94-28e63f428d33 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:11.829662 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0416822-f0c8-4dec-9a46-a8ba8b7bceb3 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:11.872354 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1da554-0062-498d-8131-515944f3c607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:11.872962 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1da554-0062-498d-8131-515944f3c607 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:11.873277 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1da554-0062-498d-8131-515944f3c607 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:11.873553 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1da554-0062-498d-8131-515944f3c607 None admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:11.874263 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1da554-0062-498d-8131-515944f3c607 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:11.874983 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1da554-0062-498d-8131-515944f3c607 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:11.876716 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1da554-0062-498d-8131-515944f3c607 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:11.888156 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:11.896752 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 370/756] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Aug 10 09:51:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:11.897974 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1da554-0062-498d-8131-515944f3c607 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:11.934305 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51c99a2-b286-4a0a-8c94-28e63f428d33 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:11.988909 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db42e597-f51d-4fdb-bbb4-8181d78f9207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:11.989861 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db42e597-f51d-4fdb-bbb4-8181d78f9207 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:11.990283 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db42e597-f51d-4fdb-bbb4-8181d78f9207 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:11.990644 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:11.990753 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db42e597-f51d-4fdb-bbb4-8181d78f9207 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:12.004356 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db42e597-f51d-4fdb-bbb4-8181d78f9207 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:12.005976 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db42e597-f51d-4fdb-bbb4-8181d78f9207 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:12.021448 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-db42e597-f51d-4fdb-bbb4-8181d78f9207 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:51:12.021448 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:12.021448 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:12.021448 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:12.021448 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:12.021448 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:12.021448 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:12.021448 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:12.021448 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:12.021448 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:12.021448 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:12.021448 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:12.021448 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 09:51:12.021448 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 09:51:12.021448 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 09:51:12.021448 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 09:51:12.022474 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:12.022474 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:12.022474 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:12.022474 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:12.022474 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:12.022474 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:12.022474 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:12.022474 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:12.022474 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:12.022474 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:12.022474 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:12.022474 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:12.022474 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:12.022474 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:12.022474 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:12.022474 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:12.022474 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 09:51:12.023365 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 09:51:12.023365 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:51:12.023365 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:51:12.026524 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1da554-0062-498d-8131-515944f3c607 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:12.027304 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 387/757] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 10 09:51:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:51:12.028153 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db42e597-f51d-4fdb-bbb4-8181d78f9207 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:12.062809 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe313bf0-a69a-44c2-92d6-0fa7c8ebf341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:12.063774 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe313bf0-a69a-44c2-92d6-0fa7c8ebf341 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:12.064251 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe313bf0-a69a-44c2-92d6-0fa7c8ebf341 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:12.064735 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe313bf0-a69a-44c2-92d6-0fa7c8ebf341 None admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:12.065625 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe313bf0-a69a-44c2-92d6-0fa7c8ebf341 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:12.066147 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe313bf0-a69a-44c2-92d6-0fa7c8ebf341 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:12.067744 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe313bf0-a69a-44c2-92d6-0fa7c8ebf341 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:12.080983 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 371/758] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 10 09:51:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:12.082202 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe313bf0-a69a-44c2-92d6-0fa7c8ebf341 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:12.135103 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db42e597-f51d-4fdb-bbb4-8181d78f9207 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:12.153692 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:12.172977 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc4e9d7-8edd-48ec-b4e9-043c0c2374a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:12.173845 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc4e9d7-8edd-48ec-b4e9-043c0c2374a3 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:12.174318 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc4e9d7-8edd-48ec-b4e9-043c0c2374a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:12.174728 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc4e9d7-8edd-48ec-b4e9-043c0c2374a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:12.175708 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc4e9d7-8edd-48ec-b4e9-043c0c2374a3 None admin] RBAC: Adding query filter params (role.id=eb04edc46b3742d7a0f0ead26f68bc22, scope.project.id=d47d5b72a00642a1a239b785110643ef, user.id=b801551d29ff4687ab8c1ce8cfa51614) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:12.176201 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc4e9d7-8edd-48ec-b4e9-043c0c2374a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:12.177789 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc4e9d7-8edd-48ec-b4e9-043c0c2374a3 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:12.189311 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe313bf0-a69a-44c2-92d6-0fa7c8ebf341 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:12.189604 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 388/759] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 10 09:51:12 2022] GET /identity/v3/role_assignments?user.id=b801551d29ff4687ab8c1ce8cfa51614&scope.project.id=d47d5b72a00642a1a239b785110643ef&role.id=eb04edc46b3742d7a0f0ead26f68bc22 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:12.190777 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc4e9d7-8edd-48ec-b4e9-043c0c2374a3 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:12.217247 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:12.223003 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c04cb2b-4b93-44ba-aa5e-6da9db272c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:12.223830 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c04cb2b-4b93-44ba-aa5e-6da9db272c0f None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:12.224156 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c04cb2b-4b93-44ba-aa5e-6da9db272c0f None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:12.226722 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c04cb2b-4b93-44ba-aa5e-6da9db272c0f None admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:12.226722 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c04cb2b-4b93-44ba-aa5e-6da9db272c0f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:12.226722 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c04cb2b-4b93-44ba-aa5e-6da9db272c0f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:12.227354 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c04cb2b-4b93-44ba-aa5e-6da9db272c0f None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:12.241402 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 372/760] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 10 09:51:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:12.246995 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c04cb2b-4b93-44ba-aa5e-6da9db272c0f None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:12.362104 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc4e9d7-8edd-48ec-b4e9-043c0c2374a3 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:12.373110 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c04cb2b-4b93-44ba-aa5e-6da9db272c0f None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:12.402253 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e279a2e0-0f77-411e-bbf4-3c5bb8067cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:12.402706 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e279a2e0-0f77-411e-bbf4-3c5bb8067cd7 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:12.402986 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e279a2e0-0f77-411e-bbf4-3c5bb8067cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:12.403263 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e279a2e0-0f77-411e-bbf4-3c5bb8067cd7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:12.411310 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e279a2e0-0f77-411e-bbf4-3c5bb8067cd7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:12.412975 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e279a2e0-0f77-411e-bbf4-3c5bb8067cd7 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:12.414219 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951001fd-5c48-4540-a200-27d27859b8ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:12.414885 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951001fd-5c48-4540-a200-27d27859b8ce None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:12.415164 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951001fd-5c48-4540-a200-27d27859b8ce None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:12.415437 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951001fd-5c48-4540-a200-27d27859b8ce None admin] PATH_INFO: `/v3/projects/service` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:12.423054 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951001fd-5c48-4540-a200-27d27859b8ce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:12.424529 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951001fd-5c48-4540-a200-27d27859b8ce None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:12.426599 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-e279a2e0-0f77-411e-bbf4-3c5bb8067cd7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 09:51:12.426599 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:12.426599 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:12.426599 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:12.426599 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:12.426599 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:12.426599 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:12.426599 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:12.426599 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:12.426599 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:12.426599 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:12.426599 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:12.426599 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 09:51:12.426599 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 09:51:12.426599 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 09:51:12.427456 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 09:51:12.427456 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:12.427456 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:12.427456 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:12.427456 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:12.427456 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:12.427456 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:12.427456 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:12.427456 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:12.427456 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:12.427456 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:12.427456 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:12.427456 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:12.427456 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:12.427456 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:12.427456 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:12.427456 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:12.428469 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 09:51:12.428469 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 09:51:12.428469 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 09:51:12.428469 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 09:51:12.428469 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 09:51:12.428469 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 09:51:12.428469 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 09:51:12.428469 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:51:12.432759 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 389/761] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 10 09:51:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:51:12.434105 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e336f36f-ceed-4159-8a62-926c758e3ae9 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:12.434385 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e336f36f-ceed-4159-8a62-926c758e3ae9 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:12.434656 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e336f36f-ceed-4159-8a62-926c758e3ae9 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:12.436182 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 390/762] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:51:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:51:12.436489 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-951001fd-5c48-4540-a200-27d27859b8ce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 09:51:12.436489 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:12.436489 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:12.436489 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:12.436489 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:12.436489 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:12.436489 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:12.436489 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:12.436489 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:12.436489 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:12.436489 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:12.436489 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:12.436489 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 09:51:12.436489 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 09:51:12.436489 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 09:51:12.438404 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 09:51:12.438404 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:12.438404 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:12.438404 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:12.438404 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:12.438404 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:12.438404 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:12.438404 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:12.438404 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:12.438404 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:12.438404 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:12.438404 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:12.438404 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:12.438404 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:12.438404 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:12.438404 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:12.438404 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:12.440487 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 09:51:12.440487 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 09:51:12.440487 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 09:51:12.440487 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 09:51:12.440487 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 09:51:12.440487 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 09:51:12.440487 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 09:51:12.440487 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:51:12.441666 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e336f36f-ceed-4159-8a62-926c758e3ae9 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:12.441829 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 373/763] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 10 09:51:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 09:51:12.449111 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908197d8-73ca-46ce-92c3-af38fb37e328 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:12.449111 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908197d8-73ca-46ce-92c3-af38fb37e328 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:12.449111 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908197d8-73ca-46ce-92c3-af38fb37e328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:12.462923 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-908197d8-73ca-46ce-92c3-af38fb37e328 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:51:12.464243 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-908197d8-73ca-46ce-92c3-af38fb37e328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:51:12.493432 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:12.512830 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:12.541527 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 374/764] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:51:12 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 09:51:12.542794 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908197d8-73ca-46ce-92c3-af38fb37e328 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:12.543908 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e336f36f-ceed-4159-8a62-926c758e3ae9 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:12.578255 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035dd268-0dd3-4f73-b93c-227961b306d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:12.578835 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035dd268-0dd3-4f73-b93c-227961b306d6 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:12.579282 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035dd268-0dd3-4f73-b93c-227961b306d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:12.579602 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035dd268-0dd3-4f73-b93c-227961b306d6 None admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:12.580455 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035dd268-0dd3-4f73-b93c-227961b306d6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:12.580956 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035dd268-0dd3-4f73-b93c-227961b306d6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:12.582740 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035dd268-0dd3-4f73-b93c-227961b306d6 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:12.596030 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 391/765] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Aug 10 09:51:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:12.601281 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035dd268-0dd3-4f73-b93c-227961b306d6 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:12.661761 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908197d8-73ca-46ce-92c3-af38fb37e328 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:12.699902 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3966cfb-8fba-43e7-9fda-117a738d75bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:12.700637 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3966cfb-8fba-43e7-9fda-117a738d75bd None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:12.700768 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3966cfb-8fba-43e7-9fda-117a738d75bd None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:12.701041 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3966cfb-8fba-43e7-9fda-117a738d75bd None admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:12.701783 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3966cfb-8fba-43e7-9fda-117a738d75bd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:12.702090 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3966cfb-8fba-43e7-9fda-117a738d75bd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:12.703546 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3966cfb-8fba-43e7-9fda-117a738d75bd None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:12.720672 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 375/766] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Aug 10 09:51:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:12.721639 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3966cfb-8fba-43e7-9fda-117a738d75bd None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:12.727744 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035dd268-0dd3-4f73-b93c-227961b306d6 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:12.732390 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:12.768285 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:12.776785 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16e4649-d3c6-4d9c-8b95-09e1cef8c122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:12.778012 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16e4649-d3c6-4d9c-8b95-09e1cef8c122 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:12.778463 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16e4649-d3c6-4d9c-8b95-09e1cef8c122 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:12.778875 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16e4649-d3c6-4d9c-8b95-09e1cef8c122 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:12.779598 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16e4649-d3c6-4d9c-8b95-09e1cef8c122 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:12.781655 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16e4649-d3c6-4d9c-8b95-09e1cef8c122 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:12.793764 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-d16e4649-d3c6-4d9c-8b95-09e1cef8c122 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 10 09:51:12.793764 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:12.793764 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 09:51:12.793764 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 09:51:12.793764 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 09:51:12.793764 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 09:51:12.793764 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 09:51:12.793764 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 09:51:12.793764 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 10 09:51:12.793764 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:51:12.793764 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 09:51:12.793764 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:51:12.793764 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:12.793764 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:12.793764 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:12.793764 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:12.793764 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:12.795039 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:12.795039 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:12.795039 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:12.795039 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:12.795039 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:12.795039 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:12.795039 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 09:51:12.795039 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 09:51:12.795039 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 09:51:12.795039 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 09:51:12.795039 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:12.795039 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:12.795039 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:12.795039 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:12.795039 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:12.795039 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:12.796047 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:12.796047 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:12.796047 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:12.796047 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:12.796047 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:12.796047 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:12.796047 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:12.796047 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:12.796047 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:12.796047 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:12.796047 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 09:51:12.796047 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 09:51:12.796047 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 10 09:51:12.796047 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:51:12.798894 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 392/767] 10.222.0.27 () {56 vars in 1129 bytes} [Wed Aug 10 09:51:12 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:51:12.799782 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16e4649-d3c6-4d9c-8b95-09e1cef8c122 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:12.835978 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3966cfb-8fba-43e7-9fda-117a738d75bd None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:12.873500 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13453b52-3e72-40b6-9f52-27259d7e1a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:12.874335 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13453b52-3e72-40b6-9f52-27259d7e1a7b None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:12.874732 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13453b52-3e72-40b6-9f52-27259d7e1a7b None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:12.875096 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13453b52-3e72-40b6-9f52-27259d7e1a7b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:12.875921 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13453b52-3e72-40b6-9f52-27259d7e1a7b None admin] RBAC: Adding query filter params (role.id=c0cf832e3b184857b8eaed2f68da1532, scope.project.id=d47d5b72a00642a1a239b785110643ef, user.id=179709fe7d8343689f096ac0d9a333b0) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:12.876366 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13453b52-3e72-40b6-9f52-27259d7e1a7b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:12.878142 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13453b52-3e72-40b6-9f52-27259d7e1a7b None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:12.889176 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 376/768] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 10 09:51:12 2022] GET /identity/v3/role_assignments?user.id=179709fe7d8343689f096ac0d9a333b0&scope.project.id=d47d5b72a00642a1a239b785110643ef&role.id=c0cf832e3b184857b8eaed2f68da1532 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:12.889176 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13453b52-3e72-40b6-9f52-27259d7e1a7b None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:12.960906 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16e4649-d3c6-4d9c-8b95-09e1cef8c122 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:13.031622 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03222c1f-5353-4729-a4df-d20b33c66d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:13.032343 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03222c1f-5353-4729-a4df-d20b33c66d10 None admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:13.032681 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03222c1f-5353-4729-a4df-d20b33c66d10 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:13.032959 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03222c1f-5353-4729-a4df-d20b33c66d10 None admin] PATH_INFO: `/v3/projects/d47d5b72a00642a1a239b785110643ef/users/dd8580888cba41a88566da4540b1130c/roles/eb04edc46b3742d7a0f0ead26f68bc22` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:13.035248 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03222c1f-5353-4729-a4df-d20b33c66d10 None admin] RBAC: Authorizing `identity:create_grant(project_id=d47d5b72a00642a1a239b785110643ef, user_id=dd8580888cba41a88566da4540b1130c, role_id=eb04edc46b3742d7a0f0ead26f68bc22)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:13.036696 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03222c1f-5353-4729-a4df-d20b33c66d10 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:13.063151 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13453b52-3e72-40b6-9f52-27259d7e1a7b None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:13.072206 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:13.076015 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 393/769] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Aug 10 09:51:12 2022] PUT /identity/v3/projects/d47d5b72a00642a1a239b785110643ef/users/dd8580888cba41a88566da4540b1130c/roles/eb04edc46b3742d7a0f0ead26f68bc22 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 09:51:13.105895 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e874db3-a76a-4546-a2c7-d6ee6f5b4b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:13.106890 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e874db3-a76a-4546-a2c7-d6ee6f5b4b8b None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:13.107395 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e874db3-a76a-4546-a2c7-d6ee6f5b4b8b None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:13.107857 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e874db3-a76a-4546-a2c7-d6ee6f5b4b8b None admin] PATH_INFO: `/v3/services` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:13.108729 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e874db3-a76a-4546-a2c7-d6ee6f5b4b8b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:13.109291 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e874db3-a76a-4546-a2c7-d6ee6f5b4b8b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:13.110998 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e874db3-a76a-4546-a2c7-d6ee6f5b4b8b None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:13.117055 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 377/770] 10.222.0.27 () {56 vars in 1124 bytes} [Wed Aug 10 09:51:12 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:13.122706 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03222c1f-5353-4729-a4df-d20b33c66d10 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:13.158684 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:13.257604 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03222c1f-5353-4729-a4df-d20b33c66d10 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:13.298799 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c827b48a-36d4-4f12-a137-0be1ed2ee6d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:13.299766 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c827b48a-36d4-4f12-a137-0be1ed2ee6d4 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:13.300257 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c827b48a-36d4-4f12-a137-0be1ed2ee6d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:13.300718 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c827b48a-36d4-4f12-a137-0be1ed2ee6d4 None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:13.301666 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c827b48a-36d4-4f12-a137-0be1ed2ee6d4 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:13.302162 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c827b48a-36d4-4f12-a137-0be1ed2ee6d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:13.303928 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c827b48a-36d4-4f12-a137-0be1ed2ee6d4 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:13.309807 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 394/771] 10.222.0.27 () {56 vars in 1124 bytes} [Wed Aug 10 09:51:13 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:13.315304 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e874db3-a76a-4546-a2c7-d6ee6f5b4b8b None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:13.419895 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b87fe-ed54-4889-a692-c2dfc3ed9845 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:13.420552 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b87fe-ed54-4889-a692-c2dfc3ed9845 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:13.421022 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b87fe-ed54-4889-a692-c2dfc3ed9845 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:13.423528 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 395/772] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:51:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:51:13.429193 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecca9d1-fc5e-488e-a23d-3c25bc44d4f3 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:13.429770 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecca9d1-fc5e-488e-a23d-3c25bc44d4f3 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:13.430258 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecca9d1-fc5e-488e-a23d-3c25bc44d4f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:13.430518 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e874db3-a76a-4546-a2c7-d6ee6f5b4b8b None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:13.463936 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-4ecca9d1-fc5e-488e-a23d-3c25bc44d4f3 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:51:13.465612 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-4ecca9d1-fc5e-488e-a23d-3c25bc44d4f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:51:13.472282 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88b44bb-4ae7-4732-b01b-8074656d1f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:13.472282 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b44bb-4ae7-4732-b01b-8074656d1f1c None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:13.472282 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b44bb-4ae7-4732-b01b-8074656d1f1c None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:13.472282 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b44bb-4ae7-4732-b01b-8074656d1f1c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:13.472635 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88b44bb-4ae7-4732-b01b-8074656d1f1c None admin] RBAC: Adding query filter params (interface=public, service_id=ec7e7e1c53fc41639a490577cd5f7e4d, region_id=RegionOne) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:13.472635 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88b44bb-4ae7-4732-b01b-8074656d1f1c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:13.472635 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88b44bb-4ae7-4732-b01b-8074656d1f1c None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:13.481505 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 378/773] 10.222.0.27 () {56 vars in 1251 bytes} [Wed Aug 10 09:51:13 2022] GET /identity/v3/endpoints?service_id=ec7e7e1c53fc41639a490577cd5f7e4d&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 09:51:13.493036 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88b44bb-4ae7-4732-b01b-8074656d1f1c None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:13.527316 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:13.593598 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 396/774] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:51:13 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 09:51:13.604240 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88b44bb-4ae7-4732-b01b-8074656d1f1c None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:13.629081 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecca9d1-fc5e-488e-a23d-3c25bc44d4f3 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:13.641614 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08163b18-088c-4970-b3d5-d64825af8c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:13.642285 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08163b18-088c-4970-b3d5-d64825af8c52 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:13.642565 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08163b18-088c-4970-b3d5-d64825af8c52 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:13.642838 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08163b18-088c-4970-b3d5-d64825af8c52 None admin] PATH_INFO: `/v3/services` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:13.643460 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08163b18-088c-4970-b3d5-d64825af8c52 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:13.649088 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08163b18-088c-4970-b3d5-d64825af8c52 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:13.651198 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 379/775] 10.222.0.27 () {56 vars in 1087 bytes} [Wed Aug 10 09:51:13 2022] GET /identity/v3/services => generated 772 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:13.683842 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:13.835854 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecca9d1-fc5e-488e-a23d-3c25bc44d4f3 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:13.876781 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a80d9b1-28d0-4f0c-b1ee-5963621d77d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:13.877465 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a80d9b1-28d0-4f0c-b1ee-5963621d77d4 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:13.877742 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a80d9b1-28d0-4f0c-b1ee-5963621d77d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:13.878011 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a80d9b1-28d0-4f0c-b1ee-5963621d77d4 None admin] PATH_INFO: `/v3/services/network` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:13.878607 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a80d9b1-28d0-4f0c-b1ee-5963621d77d4 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:13.879992 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a80d9b1-28d0-4f0c-b1ee-5963621d77d4 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:13.890735 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-8a80d9b1-28d0-4f0c-b1ee-5963621d77d4 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 10 09:51:13.890735 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:13.890735 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 09:51:13.890735 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 09:51:13.890735 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 09:51:13.890735 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 09:51:13.890735 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 09:51:13.890735 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 09:51:13.890735 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 10 09:51:13.890735 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:51:13.890735 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 09:51:13.890735 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:51:13.890735 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:13.890735 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:13.890735 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:13.890735 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:13.890735 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:13.891951 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:13.891951 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:13.891951 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:13.891951 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:13.891951 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:13.891951 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:13.891951 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 09:51:13.891951 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 09:51:13.891951 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 09:51:13.891951 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 09:51:13.891951 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:13.891951 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:13.891951 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:13.891951 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:13.891951 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:13.891951 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:13.892965 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:13.892965 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:13.892965 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:13.892965 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:13.892965 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:13.892965 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:13.892965 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:13.892965 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:13.892965 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:13.892965 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:13.892965 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 09:51:13.892965 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 09:51:13.892965 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 10 09:51:13.892965 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:51:13.892965 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 397/776] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 10 09:51:13 2022] GET /identity/v3/services/network => generated 88 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 09:51:13.899099 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08163b18-088c-4970-b3d5-d64825af8c52 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:14.005631 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:14.011265 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08163b18-088c-4970-b3d5-d64825af8c52 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:14.048740 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1c036c-00f0-487e-868f-d0b24cb0af46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:14.049431 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1c036c-00f0-487e-868f-d0b24cb0af46 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:14.049762 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1c036c-00f0-487e-868f-d0b24cb0af46 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:14.050037 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1c036c-00f0-487e-868f-d0b24cb0af46 None admin] PATH_INFO: `/v3/services` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:14.050698 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1c036c-00f0-487e-868f-d0b24cb0af46 None admin] RBAC: Adding query filter params (name=network) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:14.051002 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1c036c-00f0-487e-868f-d0b24cb0af46 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:14.052411 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1c036c-00f0-487e-868f-d0b24cb0af46 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:14.063306 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 380/777] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Aug 10 09:51:13 2022] GET /identity/v3/services?name=network => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:14.074205 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a80d9b1-28d0-4f0c-b1ee-5963621d77d4 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:14.203325 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:14.222664 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a80d9b1-28d0-4f0c-b1ee-5963621d77d4 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:14.270065 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a66b4a-c3c1-43c1-911f-1f8425a4caaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:14.270678 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a66b4a-c3c1-43c1-911f-1f8425a4caaa None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:14.270958 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a66b4a-c3c1-43c1-911f-1f8425a4caaa None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:14.271226 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a66b4a-c3c1-43c1-911f-1f8425a4caaa None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:14.271858 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a66b4a-c3c1-43c1-911f-1f8425a4caaa None admin] RBAC: Adding query filter params (type=network) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:14.272215 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a66b4a-c3c1-43c1-911f-1f8425a4caaa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:14.273664 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a66b4a-c3c1-43c1-911f-1f8425a4caaa None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:14.281337 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 398/778] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Aug 10 09:51:14 2022] GET /identity/v3/services?type=network => generated 350 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:14.286853 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1c036c-00f0-487e-868f-d0b24cb0af46 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:14.414487 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1c036c-00f0-487e-868f-d0b24cb0af46 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:14.478735 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3f8afa-2d8d-4733-8ea6-fb34aa5415ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:14.480203 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3f8afa-2d8d-4733-8ea6-fb34aa5415ab None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:14.480626 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3f8afa-2d8d-4733-8ea6-fb34aa5415ab None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:14.481037 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3f8afa-2d8d-4733-8ea6-fb34aa5415ab None admin] PATH_INFO: `/v3/endpoints` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:14.481915 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3f8afa-2d8d-4733-8ea6-fb34aa5415ab None admin] RBAC: Adding query filter params (interface=public, service_id=5c1b75d2d6ce4a818810709af8e632b7, region_id=RegionOne) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:14.482391 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3f8afa-2d8d-4733-8ea6-fb34aa5415ab None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:14.484167 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3f8afa-2d8d-4733-8ea6-fb34aa5415ab None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:14.494218 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 381/779] 10.222.0.27 () {56 vars in 1251 bytes} [Wed Aug 10 09:51:14 2022] GET /identity/v3/endpoints?service_id=5c1b75d2d6ce4a818810709af8e632b7&interface=public®ion_id=RegionOne => generated 194 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:14.502263 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a66b4a-c3c1-43c1-911f-1f8425a4caaa None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:14.612290 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb39ad5-6452-4543-9330-acc3cb8f3c2d None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:14.613037 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb39ad5-6452-4543-9330-acc3cb8f3c2d None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:14.613557 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb39ad5-6452-4543-9330-acc3cb8f3c2d None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:14.615226 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 382/780] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:51:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:51:14.621520 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01602390-d0b4-4e67-9e83-ad6bda374073 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:14.622139 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01602390-d0b4-4e67-9e83-ad6bda374073 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:14.623584 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01602390-d0b4-4e67-9e83-ad6bda374073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:14.631366 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a66b4a-c3c1-43c1-911f-1f8425a4caaa None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:14.654410 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-01602390-d0b4-4e67-9e83-ad6bda374073 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:51:14.657449 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-01602390-d0b4-4e67-9e83-ad6bda374073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:51:14.692853 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa1990b-8a37-4431-ac58-36465022f6d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:14.694134 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa1990b-8a37-4431-ac58-36465022f6d2 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:14.694583 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa1990b-8a37-4431-ac58-36465022f6d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:14.695019 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa1990b-8a37-4431-ac58-36465022f6d2 None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:14.695845 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa1990b-8a37-4431-ac58-36465022f6d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:14.697484 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa1990b-8a37-4431-ac58-36465022f6d2 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:14.703080 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 399/781] 10.222.0.27 () {56 vars in 1087 bytes} [Wed Aug 10 09:51:14 2022] GET /identity/v3/services => generated 772 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:14.713481 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:14.778213 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 383/782] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:51:14 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 09:51:14.816686 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa1990b-8a37-4431-ac58-36465022f6d2 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:14.835742 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:14.931108 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa1990b-8a37-4431-ac58-36465022f6d2 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:14.969717 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff2653c-0d82-4005-8f94-de6e3493043d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:14.970404 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff2653c-0d82-4005-8f94-de6e3493043d None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:14.970678 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff2653c-0d82-4005-8f94-de6e3493043d None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:14.970947 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff2653c-0d82-4005-8f94-de6e3493043d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:14.982843 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff2653c-0d82-4005-8f94-de6e3493043d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 09:51:14.988035 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-bff2653c-0d82-4005-8f94-de6e3493043d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 09:51:14.988035 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:14.988035 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:14.988035 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:14.988035 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:14.988035 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:14.988035 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:14.988035 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:14.988035 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:14.988035 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:14.988035 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:14.988035 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:14.988035 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 09:51:14.988035 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 09:51:14.988035 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 09:51:14.988035 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 09:51:14.988974 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 09:51:14.988974 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 09:51:14.988974 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 09:51:14.988974 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 09:51:14.988974 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:14.988974 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:14.988974 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:14.988974 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:14.988974 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:14.988974 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:14.988974 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:14.988974 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:14.988974 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:14.988974 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:14.988974 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:14.988974 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:14.989870 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:14.989870 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:14.989870 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:14.989870 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:14.989870 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 09:51:14.989870 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 09:51:14.989870 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 09:51:14.989870 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 09:51:14.989870 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 09:51:14.989870 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 09:51:14.989870 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 09:51:14.989870 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:51:14.989870 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 400/783] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Aug 10 09:51:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:51:14.995317 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01602390-d0b4-4e67-9e83-ad6bda374073 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:15.137245 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01602390-d0b4-4e67-9e83-ad6bda374073 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:15.183060 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce9f0d1-3ade-4fba-90c5-44b50a607244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:15.183722 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce9f0d1-3ade-4fba-90c5-44b50a607244 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:15.183993 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce9f0d1-3ade-4fba-90c5-44b50a607244 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:15.184261 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce9f0d1-3ade-4fba-90c5-44b50a607244 None admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:15.184931 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce9f0d1-3ade-4fba-90c5-44b50a607244 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:15.185254 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce9f0d1-3ade-4fba-90c5-44b50a607244 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:15.186622 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce9f0d1-3ade-4fba-90c5-44b50a607244 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:15.197349 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 384/784] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 10 09:51:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:15.202819 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff2653c-0d82-4005-8f94-de6e3493043d None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:15.290740 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:15.323167 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff2653c-0d82-4005-8f94-de6e3493043d None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:15.359699 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4690cf-4399-4ff4-be54-da829a405308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:15.360331 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4690cf-4399-4ff4-be54-da829a405308 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:15.360604 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4690cf-4399-4ff4-be54-da829a405308 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:15.360869 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4690cf-4399-4ff4-be54-da829a405308 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:15.371958 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4690cf-4399-4ff4-be54-da829a405308 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:15.373438 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4690cf-4399-4ff4-be54-da829a405308 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:15.387859 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-4e4690cf-4399-4ff4-be54-da829a405308 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:51:15.387859 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:15.387859 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:15.387859 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:15.387859 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:15.387859 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:15.387859 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:15.387859 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:15.387859 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:15.387859 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:15.387859 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:15.387859 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:15.387859 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 09:51:15.387859 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 09:51:15.387859 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 09:51:15.387859 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 09:51:15.388995 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:15.388995 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:15.388995 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:15.388995 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:15.388995 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:15.388995 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:15.388995 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:15.388995 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:15.388995 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:15.388995 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:15.388995 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:15.388995 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:15.388995 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:15.388995 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:15.388995 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:15.388995 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:15.388995 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 09:51:15.390135 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 09:51:15.390135 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:51:15.390135 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:51:15.390135 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 401/785] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 10 09:51:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:51:15.398458 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce9f0d1-3ade-4fba-90c5-44b50a607244 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:15.432193 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:15.494342 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3967c611-0252-4b20-839f-c0c9780d51c4 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:15.495037 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3967c611-0252-4b20-839f-c0c9780d51c4 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:15.495535 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3967c611-0252-4b20-839f-c0c9780d51c4 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:15.497366 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 402/786] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:51:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:51:15.502293 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb120f5-178d-4dda-bf17-d04279cd53ab None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:15.502821 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb120f5-178d-4dda-bf17-d04279cd53ab None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:15.503366 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb120f5-178d-4dda-bf17-d04279cd53ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:15.537099 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce9f0d1-3ade-4fba-90c5-44b50a607244 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:15.539697 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-0fb120f5-178d-4dda-bf17-d04279cd53ab None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:51:15.541189 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-0fb120f5-178d-4dda-bf17-d04279cd53ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:51:15.573591 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae15d82-bb1a-4e05-82fd-7078aa510da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:15.574312 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae15d82-bb1a-4e05-82fd-7078aa510da5 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:15.574577 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae15d82-bb1a-4e05-82fd-7078aa510da5 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:15.574847 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae15d82-bb1a-4e05-82fd-7078aa510da5 None admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:15.575521 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae15d82-bb1a-4e05-82fd-7078aa510da5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:15.575862 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae15d82-bb1a-4e05-82fd-7078aa510da5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:15.577254 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae15d82-bb1a-4e05-82fd-7078aa510da5 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:15.607266 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 385/787] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 10 09:51:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:15.609335 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c340e4-7249-482b-bafa-d98bf41e3bec None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:15.609947 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c340e4-7249-482b-bafa-d98bf41e3bec None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:15.610447 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c340e4-7249-482b-bafa-d98bf41e3bec None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:15.612075 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 386/788] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:51:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:51:15.613395 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c340e4-7249-482b-bafa-d98bf41e3bec None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:15.645519 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 403/789] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:51:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 09:51:15.646778 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078231b0-e163-430c-bc71-912ea8255eb2 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:15.647128 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078231b0-e163-430c-bc71-912ea8255eb2 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:15.647399 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078231b0-e163-430c-bc71-912ea8255eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:15.674553 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-078231b0-e163-430c-bc71-912ea8255eb2 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:51:15.676087 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-078231b0-e163-430c-bc71-912ea8255eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:51:15.706945 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:15.733091 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:15.736864 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c340e4-7249-482b-bafa-d98bf41e3bec None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:15.759977 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 404/790] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:51:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 09:51:15.761149 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078231b0-e163-430c-bc71-912ea8255eb2 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:15.782148 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff1df39-ca2d-4c9e-bf96-ccddd31fdaba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:15.784820 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff1df39-ca2d-4c9e-bf96-ccddd31fdaba None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:15.785300 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff1df39-ca2d-4c9e-bf96-ccddd31fdaba None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:15.786953 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff1df39-ca2d-4c9e-bf96-ccddd31fdaba None admin] PATH_INFO: `/v3/users/swift` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:15.797163 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff1df39-ca2d-4c9e-bf96-ccddd31fdaba None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:15.799561 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff1df39-ca2d-4c9e-bf96-ccddd31fdaba None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:15.815419 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-eff1df39-ca2d-4c9e-bf96-ccddd31fdaba None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 10 09:51:15.815419 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:15.815419 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:15.815419 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:15.815419 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:15.815419 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:15.815419 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:15.815419 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:15.815419 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:15.815419 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:15.815419 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:15.815419 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:15.815419 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 09:51:15.815419 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 09:51:15.815419 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 09:51:15.815419 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 09:51:15.816383 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:15.816383 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:15.816383 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 09:51:15.816383 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 09:51:15.816383 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 09:51:15.816383 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 09:51:15.816383 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:15.816383 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:15.816383 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:15.816383 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:15.816383 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:15.816383 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:15.816383 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:15.816383 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:15.816383 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:15.816383 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:15.816383 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:15.816383 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:15.817350 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:15.817350 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:15.817350 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 09:51:15.817350 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 09:51:15.817350 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 09:51:15.817350 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 09:51:15.817350 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 09:51:15.817350 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 09:51:15.817350 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 10 09:51:15.817350 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:51:15.824776 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 387/791] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Aug 10 09:51:15 2022] GET /identity/v3/users/swift => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:51:15.824776 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff1df39-ca2d-4c9e-bf96-ccddd31fdaba None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:15.889318 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078231b0-e163-430c-bc71-912ea8255eb2 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:15.925470 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb38379-8a70-482d-a574-5678c0f5a1bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:15.926080 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb38379-8a70-482d-a574-5678c0f5a1bb None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:15.926346 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb38379-8a70-482d-a574-5678c0f5a1bb None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:15.926614 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb38379-8a70-482d-a574-5678c0f5a1bb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:15.937786 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb38379-8a70-482d-a574-5678c0f5a1bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 09:51:15.943696 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-ddb38379-8a70-482d-a574-5678c0f5a1bb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 09:51:15.943696 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:15.943696 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:15.943696 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:15.943696 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:15.943696 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:15.943696 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:15.943696 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:15.943696 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:15.943696 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:15.943696 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:15.943696 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:15.943696 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 09:51:15.943696 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 09:51:15.943696 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 09:51:15.943696 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 09:51:15.944794 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 09:51:15.944794 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 09:51:15.944794 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 09:51:15.944794 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 09:51:15.944794 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:15.944794 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:15.944794 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:15.944794 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:15.944794 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:15.944794 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:15.944794 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:15.944794 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:15.944794 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:15.944794 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:15.944794 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:15.944794 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:15.945670 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:15.945670 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:15.945670 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:15.945670 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:15.945670 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 09:51:15.945670 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 09:51:15.945670 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 09:51:15.945670 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 09:51:15.945670 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 09:51:15.945670 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 09:51:15.945670 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 09:51:15.945670 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:51:15.948257 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff1df39-ca2d-4c9e-bf96-ccddd31fdaba None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:15.949338 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 405/792] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Aug 10 09:51:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:51:15.950302 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb38379-8a70-482d-a574-5678c0f5a1bb None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:15.997536 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66b142f-cf52-41b4-8c67-fa0c23cebb49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:15.999077 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b142f-cf52-41b4-8c67-fa0c23cebb49 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:15.999620 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b142f-cf52-41b4-8c67-fa0c23cebb49 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:16.000399 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b142f-cf52-41b4-8c67-fa0c23cebb49 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:16.002166 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:16.013642 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:16.019845 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66b142f-cf52-41b4-8c67-fa0c23cebb49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 09:51:16.027219 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-a66b142f-cf52-41b4-8c67-fa0c23cebb49 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 09:51:16.027219 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:16.027219 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:16.027219 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:16.027219 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:16.027219 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:16.027219 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:16.027219 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:16.027219 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:16.027219 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:16.027219 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:16.027219 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:16.027219 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 09:51:16.027219 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 09:51:16.027219 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 09:51:16.027219 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 09:51:16.028202 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 09:51:16.028202 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 09:51:16.028202 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 09:51:16.028202 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 09:51:16.028202 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:16.028202 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:16.028202 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:16.028202 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:16.028202 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:16.028202 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:16.028202 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:16.028202 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:16.028202 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:16.028202 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:16.028202 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:16.028202 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:16.029044 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:16.029044 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:16.029044 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:16.029044 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:16.029044 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 09:51:16.029044 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 09:51:16.029044 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 09:51:16.029044 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 09:51:16.029044 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 09:51:16.029044 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 09:51:16.029044 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 09:51:16.029044 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:51:16.035668 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 388/793] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Aug 10 09:51:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:51:16.035668 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66b142f-cf52-41b4-8c67-fa0c23cebb49 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:16.071692 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb38379-8a70-482d-a574-5678c0f5a1bb None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:16.107222 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b74580-aeac-41c6-99c0-00f7605ee4c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:16.107990 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b74580-aeac-41c6-99c0-00f7605ee4c0 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:16.108397 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b74580-aeac-41c6-99c0-00f7605ee4c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:16.108762 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b74580-aeac-41c6-99c0-00f7605ee4c0 None admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:16.109680 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b74580-aeac-41c6-99c0-00f7605ee4c0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:16.110055 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b74580-aeac-41c6-99c0-00f7605ee4c0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:16.111564 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b74580-aeac-41c6-99c0-00f7605ee4c0 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:16.132515 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 406/794] 10.222.0.27 () {56 vars in 1135 bytes} [Wed Aug 10 09:51:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:16.133767 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b74580-aeac-41c6-99c0-00f7605ee4c0 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:16.145703 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66b142f-cf52-41b4-8c67-fa0c23cebb49 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:16.180139 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d406de7-de52-49cc-a65e-1d973fdcc546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:16.180548 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d406de7-de52-49cc-a65e-1d973fdcc546 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:16.180830 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d406de7-de52-49cc-a65e-1d973fdcc546 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:16.181145 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d406de7-de52-49cc-a65e-1d973fdcc546 None admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:16.181821 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d406de7-de52-49cc-a65e-1d973fdcc546 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:16.182182 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d406de7-de52-49cc-a65e-1d973fdcc546 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:16.183510 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d406de7-de52-49cc-a65e-1d973fdcc546 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:16.197158 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 389/795] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 10 09:51:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:16.197158 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d406de7-de52-49cc-a65e-1d973fdcc546 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:16.246089 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b74580-aeac-41c6-99c0-00f7605ee4c0 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:16.247967 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:16.253034 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:16.288631 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf93c1be-0d57-429c-8c92-d5da6b14ef75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:16.289681 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf93c1be-0d57-429c-8c92-d5da6b14ef75 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:16.290224 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf93c1be-0d57-429c-8c92-d5da6b14ef75 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:16.290665 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf93c1be-0d57-429c-8c92-d5da6b14ef75 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:16.291493 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf93c1be-0d57-429c-8c92-d5da6b14ef75 None admin] RBAC: Adding query filter params (name=service) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:16.292488 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf93c1be-0d57-429c-8c92-d5da6b14ef75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:16.294173 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf93c1be-0d57-429c-8c92-d5da6b14ef75 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:16.295767 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d406de7-de52-49cc-a65e-1d973fdcc546 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:16.303771 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 407/796] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Aug 10 09:51:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:16.305011 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf93c1be-0d57-429c-8c92-d5da6b14ef75 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:16.330768 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeebc60-ee73-4372-933b-3542a570fe36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:16.331397 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeebc60-ee73-4372-933b-3542a570fe36 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:16.331677 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeebc60-ee73-4372-933b-3542a570fe36 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:16.331995 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeebc60-ee73-4372-933b-3542a570fe36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:16.343392 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdeebc60-ee73-4372-933b-3542a570fe36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:16.345407 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdeebc60-ee73-4372-933b-3542a570fe36 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:16.359297 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-cdeebc60-ee73-4372-933b-3542a570fe36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:51:16.359297 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:16.359297 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:16.359297 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:16.359297 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:16.359297 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:16.359297 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:16.359297 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:16.359297 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:16.359297 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:16.359297 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:16.359297 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:16.359297 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 09:51:16.359297 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 09:51:16.359297 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 09:51:16.359297 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 09:51:16.360245 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:16.360245 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:16.360245 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:16.360245 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:16.360245 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:16.360245 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:16.360245 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:16.360245 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:16.360245 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:16.360245 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:16.360245 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:16.360245 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:16.360245 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:16.360245 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:16.360245 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:16.360245 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:16.360245 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 09:51:16.361141 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 09:51:16.361141 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:51:16.361141 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:51:16.361141 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 390/797] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 10 09:51:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:51:16.361813 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeebc60-ee73-4372-933b-3542a570fe36 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:16.416767 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf93c1be-0d57-429c-8c92-d5da6b14ef75 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:16.451171 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f771dd-af4e-476e-84ec-462b3cca5beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:16.451719 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f771dd-af4e-476e-84ec-462b3cca5beb None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:16.451990 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f771dd-af4e-476e-84ec-462b3cca5beb None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:16.452254 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f771dd-af4e-476e-84ec-462b3cca5beb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:16.463037 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f771dd-af4e-476e-84ec-462b3cca5beb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:16.464478 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f771dd-af4e-476e-84ec-462b3cca5beb None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:16.465671 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeebc60-ee73-4372-933b-3542a570fe36 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:16.478408 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-79f771dd-af4e-476e-84ec-462b3cca5beb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:51:16.478408 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:16.478408 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:16.478408 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:16.478408 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:16.478408 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:16.478408 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:16.478408 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:16.478408 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:16.478408 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:16.478408 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:16.478408 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:16.478408 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 09:51:16.478408 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 09:51:16.478408 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 09:51:16.478408 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 09:51:16.479463 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:16.479463 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:16.479463 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:16.479463 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:16.479463 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:16.479463 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:16.479463 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:16.479463 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:16.479463 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:16.479463 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:16.479463 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:16.479463 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:16.479463 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:16.479463 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:16.479463 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:16.479463 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:16.479463 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 09:51:16.480373 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 09:51:16.480373 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:51:16.480373 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:51:16.482115 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:16.484175 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 408/798] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 10 09:51:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:51:16.484802 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f771dd-af4e-476e-84ec-462b3cca5beb None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:16.501402 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb661e8-f999-44da-867c-c57da8cae867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:16.502121 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb661e8-f999-44da-867c-c57da8cae867 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:16.502486 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb661e8-f999-44da-867c-c57da8cae867 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:16.502640 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb661e8-f999-44da-867c-c57da8cae867 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:16.504321 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:16.514552 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb661e8-f999-44da-867c-c57da8cae867 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:16.516077 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb661e8-f999-44da-867c-c57da8cae867 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:16.531401 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-cdb661e8-f999-44da-867c-c57da8cae867 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:51:16.531401 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:16.531401 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:16.531401 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:16.531401 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:16.531401 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:16.531401 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:16.531401 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:16.531401 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:16.531401 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:16.531401 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:16.531401 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:16.531401 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 09:51:16.531401 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 09:51:16.531401 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 09:51:16.531401 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 09:51:16.532345 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:16.532345 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:16.532345 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:16.532345 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:16.532345 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:16.532345 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:16.532345 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:16.532345 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:16.532345 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:16.532345 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:16.532345 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:16.532345 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:16.532345 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:16.532345 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:16.532345 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:16.532345 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:16.532345 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 09:51:16.533338 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 09:51:16.533338 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:51:16.533338 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:51:16.533338 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 391/799] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 10 09:51:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:51:16.533999 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a09f0-7b99-4a65-bba7-68d06d4df55b None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:16.534279 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a09f0-7b99-4a65-bba7-68d06d4df55b None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:16.534552 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a09f0-7b99-4a65-bba7-68d06d4df55b None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:16.535905 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 392/800] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:51:16 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:51:16.536440 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755a09f0-7b99-4a65-bba7-68d06d4df55b None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:16.596451 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f771dd-af4e-476e-84ec-462b3cca5beb None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:16.628660 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd27bd07-c6d6-445c-9338-04c776632dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:16.629298 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd27bd07-c6d6-445c-9338-04c776632dc3 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:16.629580 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd27bd07-c6d6-445c-9338-04c776632dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:16.629856 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd27bd07-c6d6-445c-9338-04c776632dc3 None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:16.630497 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd27bd07-c6d6-445c-9338-04c776632dc3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:16.630803 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd27bd07-c6d6-445c-9338-04c776632dc3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:16.632344 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd27bd07-c6d6-445c-9338-04c776632dc3 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:16.644144 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 409/801] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 10 09:51:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:16.644951 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd27bd07-c6d6-445c-9338-04c776632dc3 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:16.653466 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755a09f0-7b99-4a65-bba7-68d06d4df55b None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:16.697798 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe7089d-d6e8-41d5-b78b-18e7b6ed9bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:16.698676 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe7089d-d6e8-41d5-b78b-18e7b6ed9bae None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:16.699146 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe7089d-d6e8-41d5-b78b-18e7b6ed9bae None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:16.699760 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe7089d-d6e8-41d5-b78b-18e7b6ed9bae None admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:16.700703 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe7089d-d6e8-41d5-b78b-18e7b6ed9bae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:16.701318 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe7089d-d6e8-41d5-b78b-18e7b6ed9bae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:16.702973 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe7089d-d6e8-41d5-b78b-18e7b6ed9bae None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:16.715334 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 393/802] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 10 09:51:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:16.716606 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f5ce78-b0db-4c4b-9229-c46da4bd19bd None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:16.716896 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f5ce78-b0db-4c4b-9229-c46da4bd19bd None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:16.717202 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f5ce78-b0db-4c4b-9229-c46da4bd19bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:16.734896 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-a5f5ce78-b0db-4c4b-9229-c46da4bd19bd None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:51:16.735796 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:16.736094 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-a5f5ce78-b0db-4c4b-9229-c46da4bd19bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:51:16.754040 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:16.766424 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd27bd07-c6d6-445c-9338-04c776632dc3 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:16.804043 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1ed7a0-3369-4b66-b698-f86d5334bd50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:16.804753 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1ed7a0-3369-4b66-b698-f86d5334bd50 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:16.805079 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1ed7a0-3369-4b66-b698-f86d5334bd50 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:16.805433 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1ed7a0-3369-4b66-b698-f86d5334bd50 None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:16.806242 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1ed7a0-3369-4b66-b698-f86d5334bd50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:16.806554 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1ed7a0-3369-4b66-b698-f86d5334bd50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:16.817183 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 394/803] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:51:16 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 09:51:16.817363 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1ed7a0-3369-4b66-b698-f86d5334bd50 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:16.817470 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f5ce78-b0db-4c4b-9229-c46da4bd19bd None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:16.829863 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 410/804] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 10 09:51:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:16.835704 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1ed7a0-3369-4b66-b698-f86d5334bd50 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:16.921532 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f5ce78-b0db-4c4b-9229-c46da4bd19bd None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:16.939344 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1ed7a0-3369-4b66-b698-f86d5334bd50 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:16.955214 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad30d03-5b5e-471f-9da0-bdcc78809903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:16.955868 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad30d03-5b5e-471f-9da0-bdcc78809903 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:16.956347 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad30d03-5b5e-471f-9da0-bdcc78809903 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:16.956460 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad30d03-5b5e-471f-9da0-bdcc78809903 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:16.963168 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad30d03-5b5e-471f-9da0-bdcc78809903 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:16.964636 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad30d03-5b5e-471f-9da0-bdcc78809903 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:16.972149 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ddb9e8-f7e9-4805-8273-01d249fd80de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:16.972772 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ddb9e8-f7e9-4805-8273-01d249fd80de None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:16.973051 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ddb9e8-f7e9-4805-8273-01d249fd80de None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:16.973352 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ddb9e8-f7e9-4805-8273-01d249fd80de None admin] PATH_INFO: `/v3/users/nova` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:16.975926 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-dad30d03-5b5e-471f-9da0-bdcc78809903 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 09:51:16.975926 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:16.975926 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:16.975926 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:16.975926 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:16.975926 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:16.975926 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:16.975926 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:16.975926 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:16.975926 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:16.975926 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:16.975926 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:16.975926 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 09:51:16.975926 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 09:51:16.975926 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 09:51:16.976968 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 09:51:16.976968 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:16.976968 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:16.976968 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:16.976968 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:16.976968 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:16.976968 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:16.976968 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:16.976968 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:16.976968 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:16.976968 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:16.976968 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:16.976968 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:16.976968 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:16.976968 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:16.976968 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:16.976968 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:16.978000 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 09:51:16.978000 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 09:51:16.978000 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 09:51:16.978000 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 09:51:16.978000 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 09:51:16.978000 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 09:51:16.978000 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 09:51:16.978000 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:51:16.978471 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:16.978543 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 395/805] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 10 09:51:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:51:16.978543 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad30d03-5b5e-471f-9da0-bdcc78809903 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:16.983636 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ddb9e8-f7e9-4805-8273-01d249fd80de None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:16.985722 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ddb9e8-f7e9-4805-8273-01d249fd80de None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:16.995466 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:16.996869 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-d7ddb9e8-f7e9-4805-8273-01d249fd80de None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 10 09:51:16.996869 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:16.996869 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:16.996869 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:16.996869 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:16.996869 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:16.996869 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:16.996869 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:16.996869 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:16.996869 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:16.996869 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:16.996869 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:16.996869 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 09:51:16.996869 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 09:51:16.996869 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 09:51:16.996869 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 09:51:16.997824 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:16.997824 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:16.997824 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 09:51:16.997824 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 09:51:16.997824 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 09:51:16.997824 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 09:51:16.997824 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:16.997824 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:16.997824 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:16.997824 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:16.997824 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:16.997824 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:16.997824 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:16.997824 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:16.997824 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:16.997824 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:16.997824 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:16.997824 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:16.998740 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:16.998740 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:16.998740 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 09:51:16.998740 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 09:51:16.998740 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 09:51:16.998740 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 09:51:16.998740 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 09:51:16.998740 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 09:51:16.998740 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 10 09:51:16.998740 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:51:16.998740 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 411/806] 10.222.0.27 () {56 vars in 1093 bytes} [Wed Aug 10 09:51:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:51:16.998740 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ddb9e8-f7e9-4805-8273-01d249fd80de None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:17.082270 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad30d03-5b5e-471f-9da0-bdcc78809903 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:17.096424 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ddb9e8-f7e9-4805-8273-01d249fd80de None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:17.114646 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebafd70f-3457-4d64-abf2-4f85a805b7bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:17.115269 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebafd70f-3457-4d64-abf2-4f85a805b7bb None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:17.115548 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebafd70f-3457-4d64-abf2-4f85a805b7bb None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:17.115887 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebafd70f-3457-4d64-abf2-4f85a805b7bb None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:17.123151 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebafd70f-3457-4d64-abf2-4f85a805b7bb None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:17.124605 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebafd70f-3457-4d64-abf2-4f85a805b7bb None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:17.128663 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ce57a8-6254-42da-898d-1127cb5b99a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:17.129306 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ce57a8-6254-42da-898d-1127cb5b99a6 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:17.129580 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ce57a8-6254-42da-898d-1127cb5b99a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:17.129846 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ce57a8-6254-42da-898d-1127cb5b99a6 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:17.130426 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ce57a8-6254-42da-898d-1127cb5b99a6 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:17.131812 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ce57a8-6254-42da-898d-1127cb5b99a6 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:17.136163 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-ebafd70f-3457-4d64-abf2-4f85a805b7bb None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 10 09:51:17.136163 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:17.136163 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:17.136163 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:17.136163 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:17.136163 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:17.136163 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:17.136163 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:17.136163 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:17.136163 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:17.136163 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:17.136163 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:17.136163 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 09:51:17.136163 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 09:51:17.136163 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 09:51:17.136163 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 09:51:17.137171 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:17.137171 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:17.137171 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 09:51:17.137171 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 09:51:17.137171 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 09:51:17.137171 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 09:51:17.137171 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:17.137171 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:17.137171 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:17.137171 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:17.137171 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:17.137171 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:17.137171 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:17.137171 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:17.137171 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:17.137171 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:17.137171 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:17.137171 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:17.138105 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:17.138105 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:17.138105 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 09:51:17.138105 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 09:51:17.138105 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 09:51:17.138105 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 09:51:17.138105 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 09:51:17.138105 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 09:51:17.138105 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 10 09:51:17.138105 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:51:17.138105 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 396/807] 10.222.0.27 () {56 vars in 1117 bytes} [Wed Aug 10 09:51:16 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:51:17.138683 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39355471-0f5d-4810-971d-61eaeac20423 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:17.138683 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39355471-0f5d-4810-971d-61eaeac20423 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:17.139380 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39355471-0f5d-4810-971d-61eaeac20423 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:17.144614 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-31ce57a8-6254-42da-898d-1127cb5b99a6 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 10 09:51:17.144614 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:17.144614 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 09:51:17.144614 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 09:51:17.144614 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 09:51:17.144614 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 09:51:17.144614 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 09:51:17.144614 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 09:51:17.144614 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 10 09:51:17.144614 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:51:17.144614 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 09:51:17.144614 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:51:17.144614 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:17.144614 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:17.144614 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:17.144614 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:17.144614 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:17.146138 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:17.146138 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:17.146138 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:17.146138 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:17.146138 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:17.146138 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:17.146138 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 09:51:17.146138 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 09:51:17.146138 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 09:51:17.146138 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 09:51:17.146138 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:17.146138 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:17.146138 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:17.146138 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:17.146138 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:17.146138 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:17.147174 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:17.147174 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:17.147174 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:17.147174 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:17.147174 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:17.147174 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:17.147174 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:17.147174 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:17.147174 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:17.147174 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:17.147174 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 09:51:17.147174 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 09:51:17.147174 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 10 09:51:17.147174 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:51:17.147898 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 397/808] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:51:17 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:51:17.147898 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39355471-0f5d-4810-971d-61eaeac20423 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:17.148044 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 412/809] 10.222.0.27 () {56 vars in 1129 bytes} [Wed Aug 10 09:51:16 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:51:17.148044 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ce57a8-6254-42da-898d-1127cb5b99a6 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:17.207669 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:17.224195 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:17.249869 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ce57a8-6254-42da-898d-1127cb5b99a6 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:17.250019 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39355471-0f5d-4810-971d-61eaeac20423 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:17.282375 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bd3d8d-526a-45bc-9a90-d1ed7b007eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:17.282987 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bd3d8d-526a-45bc-9a90-d1ed7b007eef None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:17.283271 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bd3d8d-526a-45bc-9a90-d1ed7b007eef None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:17.283543 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bd3d8d-526a-45bc-9a90-d1ed7b007eef None admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:17.283634 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35527e7b-8128-437a-b6da-6dec157765c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:17.284231 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35527e7b-8128-437a-b6da-6dec157765c2 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:17.284321 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bd3d8d-526a-45bc-9a90-d1ed7b007eef None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:17.284510 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35527e7b-8128-437a-b6da-6dec157765c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:17.284600 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bd3d8d-526a-45bc-9a90-d1ed7b007eef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:17.284781 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35527e7b-8128-437a-b6da-6dec157765c2 None admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:17.285502 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35527e7b-8128-437a-b6da-6dec157765c2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:17.285809 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35527e7b-8128-437a-b6da-6dec157765c2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:17.286028 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bd3d8d-526a-45bc-9a90-d1ed7b007eef None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:17.287232 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35527e7b-8128-437a-b6da-6dec157765c2 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:17.298586 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 398/810] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Aug 10 09:51:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:17.299370 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35527e7b-8128-437a-b6da-6dec157765c2 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:17.307759 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 413/811] 10.222.0.27 () {56 vars in 1133 bytes} [Wed Aug 10 09:51:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:17.308905 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d98d85-2372-4d4c-90bf-e920fd0051c8 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:17.309218 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d98d85-2372-4d4c-90bf-e920fd0051c8 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:17.309492 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d98d85-2372-4d4c-90bf-e920fd0051c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:17.328304 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-12d98d85-2372-4d4c-90bf-e920fd0051c8 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:51:17.329541 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-12d98d85-2372-4d4c-90bf-e920fd0051c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:51:17.397265 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35527e7b-8128-437a-b6da-6dec157765c2 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:17.397713 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 414/812] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:51:17 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 09:51:17.398495 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d98d85-2372-4d4c-90bf-e920fd0051c8 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:17.434675 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f21cd6-4fe4-42ba-bb75-99dacd110d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:17.435261 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f21cd6-4fe4-42ba-bb75-99dacd110d53 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:17.435546 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f21cd6-4fe4-42ba-bb75-99dacd110d53 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:17.435817 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f21cd6-4fe4-42ba-bb75-99dacd110d53 None admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:17.436556 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f21cd6-4fe4-42ba-bb75-99dacd110d53 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:17.436863 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f21cd6-4fe4-42ba-bb75-99dacd110d53 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:17.438375 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f21cd6-4fe4-42ba-bb75-99dacd110d53 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:17.440026 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:17.457950 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 399/813] 10.222.0.27 () {56 vars in 1149 bytes} [Wed Aug 10 09:51:17 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:17.458645 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f21cd6-4fe4-42ba-bb75-99dacd110d53 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:17.459801 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:17.514127 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d98d85-2372-4d4c-90bf-e920fd0051c8 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:17.547762 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f77e4cd-9080-47bd-9e2d-662ded33a793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:17.548359 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f77e4cd-9080-47bd-9e2d-662ded33a793 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:17.548632 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f77e4cd-9080-47bd-9e2d-662ded33a793 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:17.548902 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f77e4cd-9080-47bd-9e2d-662ded33a793 None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:17.549563 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f77e4cd-9080-47bd-9e2d-662ded33a793 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:17.549863 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f77e4cd-9080-47bd-9e2d-662ded33a793 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:17.551243 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f77e4cd-9080-47bd-9e2d-662ded33a793 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:17.555862 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 415/814] 10.222.0.27 () {56 vars in 1124 bytes} [Wed Aug 10 09:51:17 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:17.556369 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f77e4cd-9080-47bd-9e2d-662ded33a793 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:17.577831 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f21cd6-4fe4-42ba-bb75-99dacd110d53 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:17.611779 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aa7d94-1791-4252-9f5e-53e671340319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:17.612425 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa7d94-1791-4252-9f5e-53e671340319 None admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:17.612690 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa7d94-1791-4252-9f5e-53e671340319 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:17.612958 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa7d94-1791-4252-9f5e-53e671340319 None admin] PATH_INFO: `/v3/projects/d47d5b72a00642a1a239b785110643ef/users/b801551d29ff4687ab8c1ce8cfa51614/roles/eb04edc46b3742d7a0f0ead26f68bc22` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:17.614905 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aa7d94-1791-4252-9f5e-53e671340319 None admin] RBAC: Authorizing `identity:create_grant(project_id=d47d5b72a00642a1a239b785110643ef, user_id=b801551d29ff4687ab8c1ce8cfa51614, role_id=eb04edc46b3742d7a0f0ead26f68bc22)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:17.616370 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aa7d94-1791-4252-9f5e-53e671340319 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:17.629877 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 400/815] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Aug 10 09:51:17 2022] PUT /identity/v3/projects/d47d5b72a00642a1a239b785110643ef/users/b801551d29ff4687ab8c1ce8cfa51614/roles/eb04edc46b3742d7a0f0ead26f68bc22 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 09:51:17.630663 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aa7d94-1791-4252-9f5e-53e671340319 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:17.663723 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f77e4cd-9080-47bd-9e2d-662ded33a793 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:17.680155 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:17.697259 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:17.710700 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98becbfe-9a70-42b4-a86d-d0ae63588381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:17.711333 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98becbfe-9a70-42b4-a86d-d0ae63588381 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:17.711613 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98becbfe-9a70-42b4-a86d-d0ae63588381 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:17.711889 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98becbfe-9a70-42b4-a86d-d0ae63588381 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:17.752352 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aa7d94-1791-4252-9f5e-53e671340319 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:17.788642 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98becbfe-9a70-42b4-a86d-d0ae63588381 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:17.790546 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98becbfe-9a70-42b4-a86d-d0ae63588381 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:17.790989 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1629ab63-9549-46aa-917b-83532a61f9d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:17.791628 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1629ab63-9549-46aa-917b-83532a61f9d8 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:17.791907 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1629ab63-9549-46aa-917b-83532a61f9d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:17.792178 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1629ab63-9549-46aa-917b-83532a61f9d8 None admin] PATH_INFO: `/v3/services/network` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:17.792763 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1629ab63-9549-46aa-917b-83532a61f9d8 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:17.794742 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1629ab63-9549-46aa-917b-83532a61f9d8 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:17.807055 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-1629ab63-9549-46aa-917b-83532a61f9d8 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 10 09:51:17.807055 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:17.807055 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 09:51:17.807055 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 09:51:17.807055 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 09:51:17.807055 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 09:51:17.807055 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 09:51:17.807055 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 09:51:17.807055 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 10 09:51:17.807055 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:51:17.807055 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 09:51:17.807055 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:51:17.807055 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:17.807055 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:17.807055 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:17.807055 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:17.807055 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:17.808058 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:17.808058 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:17.808058 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:17.808058 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:17.808058 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:17.808058 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:17.808058 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 09:51:17.808058 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 09:51:17.808058 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 09:51:17.808058 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 09:51:17.808058 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:17.808058 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:17.808058 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:17.808058 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:17.808058 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:17.808058 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:17.808878 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:17.808878 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:17.808878 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:17.808878 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:17.808878 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:17.808878 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:17.808878 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:17.808878 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:17.808878 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:17.808878 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:17.808878 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 09:51:17.808878 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 09:51:17.808878 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 10 09:51:17.808878 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:51:17.808878 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 401/816] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 10 09:51:17 2022] GET /identity/v3/services/network => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:51:17.809714 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1629ab63-9549-46aa-917b-83532a61f9d8 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:17.903536 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 416/817] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 10 09:51:17 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 09:51:17.904738 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98becbfe-9a70-42b4-a86d-d0ae63588381 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:17.919701 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:17.922036 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1629ab63-9549-46aa-917b-83532a61f9d8 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:17.940433 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:17.961151 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e937f050-19a5-4fa0-a0fb-f9ad137a5342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:17.961701 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e937f050-19a5-4fa0-a0fb-f9ad137a5342 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:17.961984 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e937f050-19a5-4fa0-a0fb-f9ad137a5342 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:17.962254 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e937f050-19a5-4fa0-a0fb-f9ad137a5342 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:17.972151 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e937f050-19a5-4fa0-a0fb-f9ad137a5342 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:17.973643 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e937f050-19a5-4fa0-a0fb-f9ad137a5342 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:17.988021 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-e937f050-19a5-4fa0-a0fb-f9ad137a5342 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:51:17.988021 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:17.988021 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:17.988021 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:17.988021 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:17.988021 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:17.988021 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:17.988021 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:17.988021 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:17.988021 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:17.988021 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:17.988021 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:17.988021 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 09:51:17.988021 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 09:51:17.988021 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 09:51:17.988021 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 09:51:17.989219 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:17.989219 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:17.989219 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:17.989219 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:17.989219 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:17.989219 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:17.989219 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:17.989219 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:17.989219 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:17.989219 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:17.989219 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:17.989219 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:17.989219 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:17.989219 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:17.989219 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:17.989219 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:17.989219 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 09:51:17.990268 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 09:51:17.990268 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:51:17.990268 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:51:17.993729 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 402/818] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 10 09:51:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:51:17.994555 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e937f050-19a5-4fa0-a0fb-f9ad137a5342 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:18.011210 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98becbfe-9a70-42b4-a86d-d0ae63588381 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:18.049694 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4163451a-6ebd-48c5-aa9a-7dc981475e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:18.050534 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4163451a-6ebd-48c5-aa9a-7dc981475e8c None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:18.050806 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4163451a-6ebd-48c5-aa9a-7dc981475e8c None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:18.051468 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4163451a-6ebd-48c5-aa9a-7dc981475e8c None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:18.052308 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4163451a-6ebd-48c5-aa9a-7dc981475e8c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:18.052732 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4163451a-6ebd-48c5-aa9a-7dc981475e8c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:18.054476 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4163451a-6ebd-48c5-aa9a-7dc981475e8c None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:18.063575 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 417/819] 10.222.0.27 () {56 vars in 1124 bytes} [Wed Aug 10 09:51:17 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:18.064482 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4163451a-6ebd-48c5-aa9a-7dc981475e8c None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:18.102984 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e937f050-19a5-4fa0-a0fb-f9ad137a5342 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:18.138955 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ec8e08-dccd-4be0-8e45-b708d2f05ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:18.139572 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ec8e08-dccd-4be0-8e45-b708d2f05ff6 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:18.139877 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ec8e08-dccd-4be0-8e45-b708d2f05ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:18.140182 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ec8e08-dccd-4be0-8e45-b708d2f05ff6 None admin] PATH_INFO: `/v3/services` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:18.140828 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ec8e08-dccd-4be0-8e45-b708d2f05ff6 None admin] RBAC: Adding query filter params (name=network) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:18.141156 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ec8e08-dccd-4be0-8e45-b708d2f05ff6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:18.142540 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ec8e08-dccd-4be0-8e45-b708d2f05ff6 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:18.147287 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 403/820] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Aug 10 09:51:17 2022] GET /identity/v3/services?name=network => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:18.147413 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:18.152777 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ec8e08-dccd-4be0-8e45-b708d2f05ff6 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:18.171678 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4163451a-6ebd-48c5-aa9a-7dc981475e8c None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:18.190300 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:18.206883 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2657b96-cd90-4c51-9871-27ec44cab91e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:18.207496 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2657b96-cd90-4c51-9871-27ec44cab91e None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:18.207771 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2657b96-cd90-4c51-9871-27ec44cab91e None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:18.208275 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2657b96-cd90-4c51-9871-27ec44cab91e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:18.218015 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2657b96-cd90-4c51-9871-27ec44cab91e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:18.219393 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2657b96-cd90-4c51-9871-27ec44cab91e None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:18.234365 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-b2657b96-cd90-4c51-9871-27ec44cab91e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:51:18.234365 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:18.234365 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:18.234365 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:18.234365 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:18.234365 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:18.234365 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:18.234365 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:18.234365 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:18.234365 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:18.234365 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:18.234365 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:18.234365 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 09:51:18.234365 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 09:51:18.234365 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 09:51:18.234365 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 09:51:18.235327 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:18.235327 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:18.235327 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:18.235327 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:18.235327 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:18.235327 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:18.235327 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:18.235327 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:18.235327 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:18.235327 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:18.235327 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:18.235327 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:18.235327 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:18.235327 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:18.235327 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:18.235327 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:18.235327 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 09:51:18.236222 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 09:51:18.236222 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:51:18.236222 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:51:18.236222 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 418/821] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 10 09:51:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:51:18.237027 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2657b96-cd90-4c51-9871-27ec44cab91e None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:18.264961 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ec8e08-dccd-4be0-8e45-b708d2f05ff6 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:18.298751 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4d76c9-809c-44bd-8569-597bcc70a01e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:18.299363 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4d76c9-809c-44bd-8569-597bcc70a01e None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:18.299648 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4d76c9-809c-44bd-8569-597bcc70a01e None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:18.299922 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4d76c9-809c-44bd-8569-597bcc70a01e None admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:18.300573 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4d76c9-809c-44bd-8569-597bcc70a01e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:18.300877 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4d76c9-809c-44bd-8569-597bcc70a01e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:18.302295 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4d76c9-809c-44bd-8569-597bcc70a01e None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:18.314217 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 404/822] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 10 09:51:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:18.315035 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4d76c9-809c-44bd-8569-597bcc70a01e None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:18.343984 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2657b96-cd90-4c51-9871-27ec44cab91e None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:18.370965 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:18.379914 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d63bd12-b5fb-4b32-b1b6-a86276f0e056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:18.380628 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d63bd12-b5fb-4b32-b1b6-a86276f0e056 None admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:18.380908 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d63bd12-b5fb-4b32-b1b6-a86276f0e056 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:18.381214 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d63bd12-b5fb-4b32-b1b6-a86276f0e056 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:18.381930 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d63bd12-b5fb-4b32-b1b6-a86276f0e056 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:18.383340 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d63bd12-b5fb-4b32-b1b6-a86276f0e056 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:18.404464 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 419/823] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 10 09:51:18 2022] POST /identity/v3/endpoints => generated 346 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 09:51:18.407378 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d63bd12-b5fb-4b32-b1b6-a86276f0e056 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:18.427696 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:18.438251 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4d76c9-809c-44bd-8569-597bcc70a01e None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:18.488462 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c01d6e-dfae-45bb-a6ba-1cf66e7ce8ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:18.490526 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c01d6e-dfae-45bb-a6ba-1cf66e7ce8ee None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:18.491083 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c01d6e-dfae-45bb-a6ba-1cf66e7ce8ee None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:18.491564 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c01d6e-dfae-45bb-a6ba-1cf66e7ce8ee None admin] PATH_INFO: `/v3/services` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:18.492402 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c01d6e-dfae-45bb-a6ba-1cf66e7ce8ee None admin] RBAC: Adding query filter params (type=network) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:18.492899 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c01d6e-dfae-45bb-a6ba-1cf66e7ce8ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:18.494591 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c01d6e-dfae-45bb-a6ba-1cf66e7ce8ee None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:18.509008 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 405/824] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Aug 10 09:51:18 2022] GET /identity/v3/services?type=network => generated 350 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:18.509008 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c01d6e-dfae-45bb-a6ba-1cf66e7ce8ee None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:18.531529 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d63bd12-b5fb-4b32-b1b6-a86276f0e056 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:18.575416 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4288782d-dcea-4fc9-a472-e0abd663e1be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:18.576879 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4288782d-dcea-4fc9-a472-e0abd663e1be None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:18.577599 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4288782d-dcea-4fc9-a472-e0abd663e1be None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:18.578063 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4288782d-dcea-4fc9-a472-e0abd663e1be None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:18.579152 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4288782d-dcea-4fc9-a472-e0abd663e1be None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:18.579617 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4288782d-dcea-4fc9-a472-e0abd663e1be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:18.581682 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4288782d-dcea-4fc9-a472-e0abd663e1be None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:18.603963 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 420/825] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 10 09:51:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:18.603963 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4288782d-dcea-4fc9-a472-e0abd663e1be None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:18.647076 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c01d6e-dfae-45bb-a6ba-1cf66e7ce8ee None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:18.649997 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:18.706693 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73191be-27fa-4fa2-b140-43a1a3c2bf58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:18.708643 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73191be-27fa-4fa2-b140-43a1a3c2bf58 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:18.709342 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73191be-27fa-4fa2-b140-43a1a3c2bf58 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:18.709714 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73191be-27fa-4fa2-b140-43a1a3c2bf58 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:18.719051 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73191be-27fa-4fa2-b140-43a1a3c2bf58 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:18.720581 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73191be-27fa-4fa2-b140-43a1a3c2bf58 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:18.721707 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4288782d-dcea-4fc9-a472-e0abd663e1be None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:18.733113 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-a73191be-27fa-4fa2-b140-43a1a3c2bf58 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 09:51:18.733113 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:18.733113 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:18.733113 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:18.733113 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:18.733113 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:18.733113 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:18.733113 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:18.733113 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:18.733113 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:18.733113 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:18.733113 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:18.733113 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 09:51:18.733113 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 09:51:18.733113 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 09:51:18.734080 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 09:51:18.734080 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:18.734080 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:18.734080 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:18.734080 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:18.734080 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:18.734080 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:18.734080 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:18.734080 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:18.734080 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:18.734080 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:18.734080 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:18.734080 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:18.734080 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:18.734080 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:18.734080 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:18.734080 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:18.734968 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 09:51:18.734968 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 09:51:18.734968 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 09:51:18.734968 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 09:51:18.734968 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 09:51:18.734968 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 09:51:18.734968 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 09:51:18.734968 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:51:18.739080 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 406/826] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 10 09:51:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:51:18.739880 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73191be-27fa-4fa2-b140-43a1a3c2bf58 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:18.755783 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:18.768254 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecaa79a-bfff-43ff-aaf6-a728db14f77b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:18.769453 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecaa79a-bfff-43ff-aaf6-a728db14f77b None admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:18.770220 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecaa79a-bfff-43ff-aaf6-a728db14f77b None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:18.771116 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecaa79a-bfff-43ff-aaf6-a728db14f77b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:18.772313 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecaa79a-bfff-43ff-aaf6-a728db14f77b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:18.774921 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecaa79a-bfff-43ff-aaf6-a728db14f77b None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:18.803975 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 421/827] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 10 09:51:18 2022] POST /identity/v3/endpoints => generated 337 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 09:51:18.805286 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecaa79a-bfff-43ff-aaf6-a728db14f77b None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:18.898510 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73191be-27fa-4fa2-b140-43a1a3c2bf58 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:18.931783 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:18.944434 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecaa79a-bfff-43ff-aaf6-a728db14f77b None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:18.978604 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583a9acc-aec3-4aa9-b8b0-8a541892e9b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:18.979263 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583a9acc-aec3-4aa9-b8b0-8a541892e9b1 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:18.979543 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583a9acc-aec3-4aa9-b8b0-8a541892e9b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:18.979812 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583a9acc-aec3-4aa9-b8b0-8a541892e9b1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:18.991030 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c96891e-4112-436b-a5a2-ba9b2dbdaa3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:18.992069 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c96891e-4112-436b-a5a2-ba9b2dbdaa3d None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:18.992562 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c96891e-4112-436b-a5a2-ba9b2dbdaa3d None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:18.993105 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c96891e-4112-436b-a5a2-ba9b2dbdaa3d None admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:18.994195 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c96891e-4112-436b-a5a2-ba9b2dbdaa3d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:18.994786 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c96891e-4112-436b-a5a2-ba9b2dbdaa3d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:18.996515 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c96891e-4112-436b-a5a2-ba9b2dbdaa3d None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:18.998337 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583a9acc-aec3-4aa9-b8b0-8a541892e9b1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:18.999835 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583a9acc-aec3-4aa9-b8b0-8a541892e9b1 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:19.012098 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 422/828] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Aug 10 09:51:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:19.017787 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c96891e-4112-436b-a5a2-ba9b2dbdaa3d None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:19.023834 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-583a9acc-aec3-4aa9-b8b0-8a541892e9b1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 09:51:19.023834 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:19.023834 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:19.023834 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:19.023834 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:19.023834 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:19.023834 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:19.023834 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:19.023834 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:19.023834 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:19.023834 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:19.023834 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:19.023834 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 09:51:19.023834 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 09:51:19.023834 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 09:51:19.024807 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 09:51:19.024807 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:19.024807 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:19.024807 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:19.024807 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:19.024807 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:19.024807 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:19.024807 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:19.024807 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:19.024807 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:19.024807 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:19.024807 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:19.024807 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:19.024807 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:19.024807 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:19.024807 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:19.024807 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:19.025761 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 09:51:19.025761 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 09:51:19.025761 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 09:51:19.025761 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 09:51:19.025761 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 09:51:19.025761 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 09:51:19.025761 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 09:51:19.025761 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:51:19.025761 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 407/829] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 10 09:51:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:51:19.034122 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583a9acc-aec3-4aa9-b8b0-8a541892e9b1 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:19.148406 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:19.166595 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c96891e-4112-436b-a5a2-ba9b2dbdaa3d None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:19.198662 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583a9acc-aec3-4aa9-b8b0-8a541892e9b1 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:19.221257 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff68bf6b-8f6d-4515-aa7b-7ad57bfb48bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:19.222332 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff68bf6b-8f6d-4515-aa7b-7ad57bfb48bf None admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:19.222859 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff68bf6b-8f6d-4515-aa7b-7ad57bfb48bf None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:19.223538 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff68bf6b-8f6d-4515-aa7b-7ad57bfb48bf None admin] PATH_INFO: `/v3/projects/d47d5b72a00642a1a239b785110643ef/users/179709fe7d8343689f096ac0d9a333b0/roles/c0cf832e3b184857b8eaed2f68da1532` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:19.246018 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff68bf6b-8f6d-4515-aa7b-7ad57bfb48bf None admin] RBAC: Authorizing `identity:create_grant(project_id=d47d5b72a00642a1a239b785110643ef, user_id=179709fe7d8343689f096ac0d9a333b0, role_id=c0cf832e3b184857b8eaed2f68da1532)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:19.247406 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff68bf6b-8f6d-4515-aa7b-7ad57bfb48bf None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:19.252936 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c2f199-8e2c-438a-91dd-6e589aa97ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:19.253637 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c2f199-8e2c-438a-91dd-6e589aa97ef7 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:19.254037 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c2f199-8e2c-438a-91dd-6e589aa97ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:19.254396 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c2f199-8e2c-438a-91dd-6e589aa97ef7 None admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:19.255299 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c2f199-8e2c-438a-91dd-6e589aa97ef7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:19.255642 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c2f199-8e2c-438a-91dd-6e589aa97ef7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:19.257453 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c2f199-8e2c-438a-91dd-6e589aa97ef7 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:19.269409 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 423/830] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Aug 10 09:51:19 2022] PUT /identity/v3/projects/d47d5b72a00642a1a239b785110643ef/users/179709fe7d8343689f096ac0d9a333b0/roles/c0cf832e3b184857b8eaed2f68da1532 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 09:51:19.271444 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 408/831] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Aug 10 09:51:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:19.278149 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff68bf6b-8f6d-4515-aa7b-7ad57bfb48bf None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:19.288609 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:19.399878 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff68bf6b-8f6d-4515-aa7b-7ad57bfb48bf None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:19.440025 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da40b1be-6801-4ef6-b735-b542a1ea1b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:19.440903 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da40b1be-6801-4ef6-b735-b542a1ea1b77 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:19.441463 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da40b1be-6801-4ef6-b735-b542a1ea1b77 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:19.441906 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da40b1be-6801-4ef6-b735-b542a1ea1b77 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:19.442809 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da40b1be-6801-4ef6-b735-b542a1ea1b77 None admin] RBAC: Adding query filter params (role.id=eb04edc46b3742d7a0f0ead26f68bc22, scope.project.id=d47d5b72a00642a1a239b785110643ef, user.id=dd8580888cba41a88566da4540b1130c) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:19.443618 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da40b1be-6801-4ef6-b735-b542a1ea1b77 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:19.445266 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da40b1be-6801-4ef6-b735-b542a1ea1b77 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:19.452286 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 424/832] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 10 09:51:19 2022] GET /identity/v3/role_assignments?user.id=dd8580888cba41a88566da4540b1130c&scope.project.id=d47d5b72a00642a1a239b785110643ef&role.id=eb04edc46b3742d7a0f0ead26f68bc22 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:19.650250 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7048dfdb-f493-42a0-a8ef-5c5096557f4c None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:19.650472 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7048dfdb-f493-42a0-a8ef-5c5096557f4c None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:19.650704 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7048dfdb-f493-42a0-a8ef-5c5096557f4c None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:19.652473 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 409/833] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:51:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:51:19.658431 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01de856-e0dc-4d8e-87b3-332864a7e8ef None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:19.658765 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01de856-e0dc-4d8e-87b3-332864a7e8ef None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:19.658989 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01de856-e0dc-4d8e-87b3-332864a7e8ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:19.683203 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-c01de856-e0dc-4d8e-87b3-332864a7e8ef None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:51:19.684188 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-c01de856-e0dc-4d8e-87b3-332864a7e8ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:51:19.754764 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:19.761322 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 425/834] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:51:19 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 09:51:19.784081 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7048dfdb-f493-42a0-a8ef-5c5096557f4c None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:19.890336 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7048dfdb-f493-42a0-a8ef-5c5096557f4c None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:19.920199 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:19.925548 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a0b49b-529e-444d-a45a-bdab05d36ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:19.926228 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a0b49b-529e-444d-a45a-bdab05d36ff2 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:19.926511 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a0b49b-529e-444d-a45a-bdab05d36ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:19.926786 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a0b49b-529e-444d-a45a-bdab05d36ff2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:19.938102 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a0b49b-529e-444d-a45a-bdab05d36ff2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 09:51:19.942756 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-74a0b49b-529e-444d-a45a-bdab05d36ff2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 09:51:19.942756 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:19.942756 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:19.942756 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:19.942756 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:19.942756 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:19.942756 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:19.942756 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:19.942756 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:19.942756 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:19.942756 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:19.942756 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:19.942756 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 09:51:19.942756 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 09:51:19.942756 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 09:51:19.942756 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 09:51:19.944100 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 09:51:19.944100 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 09:51:19.944100 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 09:51:19.944100 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 09:51:19.944100 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:19.944100 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:19.944100 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:19.944100 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:19.944100 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:19.944100 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:19.944100 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:19.944100 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:19.944100 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:19.944100 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:19.944100 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:19.944100 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:19.945372 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:19.945372 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:19.945372 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:19.945372 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:19.945372 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 09:51:19.945372 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 09:51:19.945372 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 09:51:19.945372 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 09:51:19.945372 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 09:51:19.945372 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 09:51:19.945372 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 09:51:19.945372 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:51:19.945372 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 410/835] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Aug 10 09:51:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:51:19.954049 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01de856-e0dc-4d8e-87b3-332864a7e8ef None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:20.058126 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01de856-e0dc-4d8e-87b3-332864a7e8ef None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:20.094039 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca91b4c-3c3c-4aee-9363-e25356d7efba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:20.094650 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca91b4c-3c3c-4aee-9363-e25356d7efba None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:20.094972 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca91b4c-3c3c-4aee-9363-e25356d7efba None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:20.095247 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca91b4c-3c3c-4aee-9363-e25356d7efba None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:20.095919 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca91b4c-3c3c-4aee-9363-e25356d7efba None admin] RBAC: Adding query filter params (name=admin) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:20.096217 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca91b4c-3c3c-4aee-9363-e25356d7efba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:20.097682 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca91b4c-3c3c-4aee-9363-e25356d7efba None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:20.106482 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 426/836] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 10 09:51:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:20.112110 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a0b49b-529e-444d-a45a-bdab05d36ff2 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:20.218773 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a0b49b-529e-444d-a45a-bdab05d36ff2 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:20.254129 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f289b838-d277-45db-8e29-aa4d4f40ec4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:20.254754 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f289b838-d277-45db-8e29-aa4d4f40ec4d None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:20.255029 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f289b838-d277-45db-8e29-aa4d4f40ec4d None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:20.255293 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f289b838-d277-45db-8e29-aa4d4f40ec4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:20.265809 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f289b838-d277-45db-8e29-aa4d4f40ec4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:20.267268 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f289b838-d277-45db-8e29-aa4d4f40ec4d None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:20.282125 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-f289b838-d277-45db-8e29-aa4d4f40ec4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:51:20.282125 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:20.282125 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:20.282125 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:20.282125 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:20.282125 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:20.282125 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:20.282125 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:20.282125 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:20.282125 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:20.282125 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:20.282125 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:20.282125 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 09:51:20.282125 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 09:51:20.282125 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 09:51:20.282125 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 09:51:20.283456 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:20.283456 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:20.283456 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:20.283456 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:20.283456 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:20.283456 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:20.283456 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:20.283456 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:20.283456 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:20.283456 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:20.283456 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:20.283456 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:20.283456 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:20.283456 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:20.283456 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:20.283456 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:20.283456 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 09:51:20.284541 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 09:51:20.284541 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:51:20.284541 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:51:20.285808 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 411/837] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 10 09:51:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:51:20.294073 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca91b4c-3c3c-4aee-9363-e25356d7efba None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:20.357769 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:20.396421 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca91b4c-3c3c-4aee-9363-e25356d7efba None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:20.432144 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932347bb-c11e-4030-8584-3deadfa78751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:20.432814 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932347bb-c11e-4030-8584-3deadfa78751 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:20.433105 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932347bb-c11e-4030-8584-3deadfa78751 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:20.433384 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932347bb-c11e-4030-8584-3deadfa78751 None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:20.434056 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932347bb-c11e-4030-8584-3deadfa78751 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:20.434357 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932347bb-c11e-4030-8584-3deadfa78751 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:20.435785 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932347bb-c11e-4030-8584-3deadfa78751 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:20.449485 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 427/838] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 10 09:51:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:20.454837 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f289b838-d277-45db-8e29-aa4d4f40ec4d None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:20.502394 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:20.562078 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f289b838-d277-45db-8e29-aa4d4f40ec4d None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:20.579363 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd60e1-f056-46b7-beb0-b9e6579c49fb None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:20.579739 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd60e1-f056-46b7-beb0-b9e6579c49fb None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:20.580086 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd60e1-f056-46b7-beb0-b9e6579c49fb None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:20.581829 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 428/839] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:51:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 09:51:20.586779 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fc765c-cc18-4747-89ef-3a20cee98e26 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:20.587132 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fc765c-cc18-4747-89ef-3a20cee98e26 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:20.587477 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fc765c-cc18-4747-89ef-3a20cee98e26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:20.596474 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ed6515-2815-4cec-afd2-7124ca098058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:20.597122 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ed6515-2815-4cec-afd2-7124ca098058 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:20.597401 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ed6515-2815-4cec-afd2-7124ca098058 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:20.597669 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ed6515-2815-4cec-afd2-7124ca098058 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:20.605392 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ed6515-2815-4cec-afd2-7124ca098058 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:20.606555 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-51fc765c-cc18-4747-89ef-3a20cee98e26 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:51:20.606831 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ed6515-2815-4cec-afd2-7124ca098058 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:20.607957 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-51fc765c-cc18-4747-89ef-3a20cee98e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:51:20.618448 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-a5ed6515-2815-4cec-afd2-7124ca098058 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 10 09:51:20.618448 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:20.618448 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:20.618448 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:20.618448 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:20.618448 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:20.618448 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:20.618448 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:20.618448 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:20.618448 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:20.618448 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:20.618448 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:20.618448 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 09:51:20.618448 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 09:51:20.618448 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 09:51:20.618448 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 09:51:20.619561 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:20.619561 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:20.619561 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 09:51:20.619561 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 09:51:20.619561 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 09:51:20.619561 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 09:51:20.619561 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:20.619561 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:20.619561 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:20.619561 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:20.619561 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:20.619561 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:20.619561 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:20.619561 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:20.619561 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:20.619561 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:20.619561 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:20.619561 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:20.620688 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:20.620688 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:20.620688 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 09:51:20.620688 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 09:51:20.620688 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 09:51:20.620688 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 09:51:20.620688 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 09:51:20.620688 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 09:51:20.620688 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 10 09:51:20.620688 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:51:20.620688 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 412/840] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Aug 10 09:51:20 2022] GET /identity/v3/users/swift => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:51:20.626934 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ed6515-2815-4cec-afd2-7124ca098058 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:20.697592 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 429/841] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:51:20 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 09:51:20.713882 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fc765c-cc18-4747-89ef-3a20cee98e26 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:20.747997 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ed6515-2815-4cec-afd2-7124ca098058 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:20.751217 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:20.771350 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:20.788903 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc1a269-058b-4c5c-b373-f8aa9628b742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:20.790278 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc1a269-058b-4c5c-b373-f8aa9628b742 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:20.790700 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc1a269-058b-4c5c-b373-f8aa9628b742 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:20.791108 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc1a269-058b-4c5c-b373-f8aa9628b742 None admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:20.791973 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc1a269-058b-4c5c-b373-f8aa9628b742 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:20.792425 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc1a269-058b-4c5c-b373-f8aa9628b742 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:20.794054 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc1a269-058b-4c5c-b373-f8aa9628b742 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:20.812786 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 413/842] 10.222.0.27 () {56 vars in 1135 bytes} [Wed Aug 10 09:51:20 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 09:51:20.818942 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc1a269-058b-4c5c-b373-f8aa9628b742 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:20.822348 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fc765c-cc18-4747-89ef-3a20cee98e26 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:20.859459 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce559b66-6719-47cf-b03f-869caab6999f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:20.860308 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce559b66-6719-47cf-b03f-869caab6999f None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:20.860689 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce559b66-6719-47cf-b03f-869caab6999f None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:20.861052 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce559b66-6719-47cf-b03f-869caab6999f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:20.861772 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce559b66-6719-47cf-b03f-869caab6999f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:20.863394 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce559b66-6719-47cf-b03f-869caab6999f None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:20.873083 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-ce559b66-6719-47cf-b03f-869caab6999f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 10 09:51:20.873083 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:20.873083 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 09:51:20.873083 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 09:51:20.873083 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 09:51:20.873083 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 09:51:20.873083 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 09:51:20.873083 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 09:51:20.873083 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 10 09:51:20.873083 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:51:20.873083 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 09:51:20.873083 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:51:20.873083 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:20.873083 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:20.873083 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:20.873083 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:20.873083 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:20.874276 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:20.874276 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:20.874276 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:20.874276 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:20.874276 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:20.874276 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:20.874276 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 09:51:20.874276 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 09:51:20.874276 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 09:51:20.874276 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 09:51:20.874276 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:20.874276 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:20.874276 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:20.874276 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:20.874276 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:20.874276 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:20.875279 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:20.875279 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:20.875279 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:20.875279 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:20.875279 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:20.875279 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:20.875279 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:20.875279 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:20.875279 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:20.875279 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:20.875279 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 09:51:20.875279 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 09:51:20.875279 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 10 09:51:20.875279 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:51:20.881389 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 430/843] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Aug 10 09:51:20 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:51:20.883317 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce559b66-6719-47cf-b03f-869caab6999f None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:20.927785 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc1a269-058b-4c5c-b373-f8aa9628b742 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:20.963887 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984a02ed-658c-49e6-9934-1444c8d6af78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:20.964855 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984a02ed-658c-49e6-9934-1444c8d6af78 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:20.965579 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984a02ed-658c-49e6-9934-1444c8d6af78 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:20.966023 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984a02ed-658c-49e6-9934-1444c8d6af78 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:20.989757 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce559b66-6719-47cf-b03f-869caab6999f None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:20.997804 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:21.009578 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:21.029429 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520429d4-9f92-4ab9-9f41-da6db3c29244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:21.030069 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520429d4-9f92-4ab9-9f41-da6db3c29244 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:21.030405 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520429d4-9f92-4ab9-9f41-da6db3c29244 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:21.030788 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520429d4-9f92-4ab9-9f41-da6db3c29244 None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:21.031445 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520429d4-9f92-4ab9-9f41-da6db3c29244 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:21.031809 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520429d4-9f92-4ab9-9f41-da6db3c29244 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:21.033536 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520429d4-9f92-4ab9-9f41-da6db3c29244 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:21.043220 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 431/844] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Aug 10 09:51:20 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 09:51:21.043783 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984a02ed-658c-49e6-9934-1444c8d6af78 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:21.044367 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520429d4-9f92-4ab9-9f41-da6db3c29244 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:21.045764 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984a02ed-658c-49e6-9934-1444c8d6af78 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:21.150534 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520429d4-9f92-4ab9-9f41-da6db3c29244 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:21.156541 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 414/845] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 10 09:51:20 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 10 09:51:21.157769 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984a02ed-658c-49e6-9934-1444c8d6af78 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:21.186948 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65517ae7-0b43-4605-ab94-77416920430b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:21.187715 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65517ae7-0b43-4605-ab94-77416920430b None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:21.188057 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65517ae7-0b43-4605-ab94-77416920430b None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:21.188399 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65517ae7-0b43-4605-ab94-77416920430b None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:21.189257 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65517ae7-0b43-4605-ab94-77416920430b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:21.189696 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65517ae7-0b43-4605-ab94-77416920430b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:21.191184 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65517ae7-0b43-4605-ab94-77416920430b None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:21.202850 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 432/846] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Aug 10 09:51:21 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:21.228390 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:21.272948 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984a02ed-658c-49e6-9934-1444c8d6af78 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:21.311479 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fc3190-7405-42e5-a9ee-66340d807921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:21.312036 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fc3190-7405-42e5-a9ee-66340d807921 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:21.312309 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fc3190-7405-42e5-a9ee-66340d807921 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:21.312577 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fc3190-7405-42e5-a9ee-66340d807921 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:21.324333 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fc3190-7405-42e5-a9ee-66340d807921 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:21.325847 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fc3190-7405-42e5-a9ee-66340d807921 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:21.332912 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b8652f-f3ab-4e99-b4ec-6e5377002b94 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:21.333402 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b8652f-f3ab-4e99-b4ec-6e5377002b94 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:21.333783 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b8652f-f3ab-4e99-b4ec-6e5377002b94 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:21.339501 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 433/847] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:51:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:51:21.341357 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be86cbc-6016-44e8-a318-0fab5c4ffdcd None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:21.341647 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be86cbc-6016-44e8-a318-0fab5c4ffdcd None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:21.341922 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be86cbc-6016-44e8-a318-0fab5c4ffdcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:21.342103 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-c1fc3190-7405-42e5-a9ee-66340d807921 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:51:21.342103 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:21.342103 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:21.342103 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:21.342103 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:21.342103 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:21.342103 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:21.342103 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:21.342103 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:21.342103 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:21.342103 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:21.342103 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:21.342103 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 09:51:21.342103 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 09:51:21.342103 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 09:51:21.342103 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 09:51:21.343001 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:21.343001 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:21.343001 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:21.343001 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:21.343001 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:21.343001 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:21.343001 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:21.343001 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:21.343001 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:21.343001 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:21.343001 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:21.343001 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:21.343001 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:21.343001 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:21.343001 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:21.343001 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:21.343001 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 09:51:21.343892 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 09:51:21.343892 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:51:21.343892 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:51:21.343892 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 415/848] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 10 09:51:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:51:21.349206 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fc3190-7405-42e5-a9ee-66340d807921 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:21.362874 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-6be86cbc-6016-44e8-a318-0fab5c4ffdcd None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:51:21.364199 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-6be86cbc-6016-44e8-a318-0fab5c4ffdcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:51:21.411147 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:21.444048 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 434/849] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:51:21 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 09:51:21.461028 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fc3190-7405-42e5-a9ee-66340d807921 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:21.467388 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be86cbc-6016-44e8-a318-0fab5c4ffdcd None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:21.482041 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:21.509320 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e082821f-1b02-4660-b570-71eafc0cc009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:21.510136 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e082821f-1b02-4660-b570-71eafc0cc009 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:21.510514 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e082821f-1b02-4660-b570-71eafc0cc009 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:21.512757 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e082821f-1b02-4660-b570-71eafc0cc009 None admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:21.513523 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e082821f-1b02-4660-b570-71eafc0cc009 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:21.513898 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e082821f-1b02-4660-b570-71eafc0cc009 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:21.515846 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e082821f-1b02-4660-b570-71eafc0cc009 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:21.536076 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 416/850] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 10 09:51:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 09:51:21.537931 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e082821f-1b02-4660-b570-71eafc0cc009 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:21.579630 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be86cbc-6016-44e8-a318-0fab5c4ffdcd None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:21.615816 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d96aab-38b7-40f0-a49d-d725085bd76e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:21.616448 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d96aab-38b7-40f0-a49d-d725085bd76e None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:21.616723 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d96aab-38b7-40f0-a49d-d725085bd76e None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:21.616991 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d96aab-38b7-40f0-a49d-d725085bd76e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:21.629772 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d96aab-38b7-40f0-a49d-d725085bd76e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 09:51:21.635104 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-96d96aab-38b7-40f0-a49d-d725085bd76e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 09:51:21.635104 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:21.635104 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:21.635104 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:21.635104 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:21.635104 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:21.635104 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:21.635104 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:21.635104 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:21.635104 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:21.635104 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:21.635104 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:21.635104 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 09:51:21.635104 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 09:51:21.635104 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 09:51:21.635104 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 09:51:21.636125 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 09:51:21.636125 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 09:51:21.636125 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 09:51:21.636125 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 09:51:21.636125 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:21.636125 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:21.636125 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:21.636125 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:21.636125 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:21.636125 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:21.636125 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:21.636125 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:21.636125 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:21.636125 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:21.636125 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:21.636125 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:21.637186 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:21.637186 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:21.637186 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:21.637186 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:21.637186 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 09:51:21.637186 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 09:51:21.637186 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 09:51:21.637186 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 09:51:21.637186 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 09:51:21.637186 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 09:51:21.637186 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 09:51:21.637186 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:51:21.644164 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 435/851] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Aug 10 09:51:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:51:21.644164 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0817ca-fb40-40f8-bf95-86f09f9ce0df None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:21.644164 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0817ca-fb40-40f8-bf95-86f09f9ce0df None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:21.644164 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0817ca-fb40-40f8-bf95-86f09f9ce0df None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:21.645094 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 436/852] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:51:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:51:21.645784 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0817ca-fb40-40f8-bf95-86f09f9ce0df None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:21.654023 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e082821f-1b02-4660-b570-71eafc0cc009 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:21.686783 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:21.697221 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2c5041-85b7-4b6b-b23f-d8598052473a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:21.697960 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2c5041-85b7-4b6b-b23f-d8598052473a None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:21.698239 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2c5041-85b7-4b6b-b23f-d8598052473a None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:21.698518 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2c5041-85b7-4b6b-b23f-d8598052473a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:21.705887 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2c5041-85b7-4b6b-b23f-d8598052473a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:21.707352 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2c5041-85b7-4b6b-b23f-d8598052473a None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:21.718949 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-3c2c5041-85b7-4b6b-b23f-d8598052473a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 09:51:21.718949 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:21.718949 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:21.718949 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:21.718949 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:21.718949 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:21.718949 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:21.718949 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:21.718949 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:21.718949 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:21.718949 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:21.718949 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:21.718949 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 09:51:21.718949 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 09:51:21.718949 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 09:51:21.719849 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 09:51:21.719849 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:21.719849 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:21.719849 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:21.719849 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:21.719849 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:21.719849 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:21.719849 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:21.719849 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:21.719849 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:21.719849 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:21.719849 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:21.719849 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:21.719849 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:21.719849 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:21.719849 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:21.719849 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:21.720714 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 09:51:21.720714 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 09:51:21.720714 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 09:51:21.720714 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 09:51:21.720714 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 09:51:21.720714 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 09:51:21.720714 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 09:51:21.720714 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:51:21.720714 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 417/853] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 10 09:51:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:51:21.723399 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e988fb-bd38-4d8a-9c11-aba9e8519cd5 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:21.723399 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e988fb-bd38-4d8a-9c11-aba9e8519cd5 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:21.723399 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e988fb-bd38-4d8a-9c11-aba9e8519cd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:21.740283 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-59e988fb-bd38-4d8a-9c11-aba9e8519cd5 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:51:21.741568 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-59e988fb-bd38-4d8a-9c11-aba9e8519cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:51:21.765280 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0817ca-fb40-40f8-bf95-86f09f9ce0df None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:21.769902 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:21.801150 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce35ca0f-eb48-4245-9233-79d25b92e7ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:21.801738 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce35ca0f-eb48-4245-9233-79d25b92e7ab None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:21.802018 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce35ca0f-eb48-4245-9233-79d25b92e7ab None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:21.802290 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce35ca0f-eb48-4245-9233-79d25b92e7ab None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:21.802955 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce35ca0f-eb48-4245-9233-79d25b92e7ab None admin] RBAC: Adding query filter params (name=service) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:21.803318 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce35ca0f-eb48-4245-9233-79d25b92e7ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:21.804702 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce35ca0f-eb48-4245-9233-79d25b92e7ab None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:21.819774 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 418/854] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:51:21 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 09:51:21.820280 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 437/855] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Aug 10 09:51:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 09:51:21.820374 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e988fb-bd38-4d8a-9c11-aba9e8519cd5 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:21.820628 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce35ca0f-eb48-4245-9233-79d25b92e7ab None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:21.919496 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:21.919986 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e988fb-bd38-4d8a-9c11-aba9e8519cd5 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:21.927755 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce35ca0f-eb48-4245-9233-79d25b92e7ab None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:21.954340 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5904931-c75d-4b73-950f-bbb036dcc77a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:21.954921 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5904931-c75d-4b73-950f-bbb036dcc77a None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:21.955196 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5904931-c75d-4b73-950f-bbb036dcc77a None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:21.955703 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5904931-c75d-4b73-950f-bbb036dcc77a None admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:21.956151 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5904931-c75d-4b73-950f-bbb036dcc77a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:21.956449 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5904931-c75d-4b73-950f-bbb036dcc77a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:21.957988 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5904931-c75d-4b73-950f-bbb036dcc77a None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:21.963633 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b93aad1-e911-4922-850e-9d4c0c2173d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:21.964386 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b93aad1-e911-4922-850e-9d4c0c2173d3 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:21.964776 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b93aad1-e911-4922-850e-9d4c0c2173d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:21.965168 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b93aad1-e911-4922-850e-9d4c0c2173d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:21.974792 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 419/856] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Aug 10 09:51:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:21.974792 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5904931-c75d-4b73-950f-bbb036dcc77a None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:21.976724 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b93aad1-e911-4922-850e-9d4c0c2173d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:21.978250 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b93aad1-e911-4922-850e-9d4c0c2173d3 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:21.992968 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-5b93aad1-e911-4922-850e-9d4c0c2173d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:51:21.992968 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:21.992968 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:21.992968 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:21.992968 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:21.992968 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:21.992968 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:21.992968 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:21.992968 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:21.992968 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:21.992968 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:21.992968 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:21.992968 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 09:51:21.992968 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 09:51:21.992968 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 09:51:21.992968 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 09:51:21.994148 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:21.994148 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:21.994148 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:21.994148 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:21.994148 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:21.994148 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:21.994148 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:21.994148 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:21.994148 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:21.994148 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:21.994148 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:21.994148 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:21.994148 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:21.994148 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:21.994148 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:21.994148 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:21.994148 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 09:51:21.995218 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 09:51:21.995218 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:51:21.995218 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:51:22.000618 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 438/857] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 10 09:51:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:51:22.001296 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b93aad1-e911-4922-850e-9d4c0c2173d3 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:22.004138 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:22.081139 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5904931-c75d-4b73-950f-bbb036dcc77a None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:22.103720 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b93aad1-e911-4922-850e-9d4c0c2173d3 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:22.117458 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41dd382-4b9e-4ef6-96d9-ce516cf17ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:22.118237 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41dd382-4b9e-4ef6-96d9-ce516cf17ec5 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:22.118623 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41dd382-4b9e-4ef6-96d9-ce516cf17ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:22.118996 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41dd382-4b9e-4ef6-96d9-ce516cf17ec5 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:22.119689 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41dd382-4b9e-4ef6-96d9-ce516cf17ec5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:22.121194 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41dd382-4b9e-4ef6-96d9-ce516cf17ec5 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:22.129857 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-f41dd382-4b9e-4ef6-96d9-ce516cf17ec5 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 10 09:51:22.129857 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:22.129857 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 09:51:22.129857 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 09:51:22.129857 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 09:51:22.129857 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 09:51:22.129857 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 09:51:22.129857 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 09:51:22.129857 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 10 09:51:22.129857 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:51:22.129857 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 09:51:22.129857 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:51:22.129857 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:22.129857 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:22.129857 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:22.129857 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:22.130970 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:22.130970 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:22.130970 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:22.130970 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:22.130970 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:22.130970 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:22.130970 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:22.130970 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 09:51:22.130970 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 09:51:22.130970 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 09:51:22.130970 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 09:51:22.130970 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:22.130970 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:22.130970 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:22.130970 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:22.130970 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:22.130970 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:22.132073 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:22.132073 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:22.132073 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:22.132073 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:22.132073 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:22.132073 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:22.132073 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:22.132073 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:22.132073 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:22.132073 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:22.132073 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 09:51:22.132073 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 09:51:22.132073 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 10 09:51:22.132073 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:51:22.138720 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 420/858] 10.222.0.27 () {56 vars in 1132 bytes} [Wed Aug 10 09:51:21 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:51:22.138720 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41dd382-4b9e-4ef6-96d9-ce516cf17ec5 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:22.146891 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d201bcbb-f62e-4675-a7ad-5fc1964a8e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:22.147493 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d201bcbb-f62e-4675-a7ad-5fc1964a8e22 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:22.147778 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d201bcbb-f62e-4675-a7ad-5fc1964a8e22 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:22.148047 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d201bcbb-f62e-4675-a7ad-5fc1964a8e22 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:22.148771 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d201bcbb-f62e-4675-a7ad-5fc1964a8e22 None admin] RBAC: Adding query filter params (role.id=eb04edc46b3742d7a0f0ead26f68bc22, scope.project.id=d47d5b72a00642a1a239b785110643ef, user.id=b801551d29ff4687ab8c1ce8cfa51614) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:22.149166 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d201bcbb-f62e-4675-a7ad-5fc1964a8e22 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:22.150535 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d201bcbb-f62e-4675-a7ad-5fc1964a8e22 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:22.156849 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 439/859] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 10 09:51:22 2022] GET /identity/v3/role_assignments?user.id=b801551d29ff4687ab8c1ce8cfa51614&scope.project.id=d47d5b72a00642a1a239b785110643ef&role.id=eb04edc46b3742d7a0f0ead26f68bc22 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:22.157499 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d201bcbb-f62e-4675-a7ad-5fc1964a8e22 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:22.177153 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:22.241539 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:22.256760 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41dd382-4b9e-4ef6-96d9-ce516cf17ec5 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:22.298286 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d201bcbb-f62e-4675-a7ad-5fc1964a8e22 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:22.309248 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d9d443-d05c-4c34-8e21-5baceb5700b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:22.310146 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d9d443-d05c-4c34-8e21-5baceb5700b7 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:22.310672 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d9d443-d05c-4c34-8e21-5baceb5700b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:22.311109 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d9d443-d05c-4c34-8e21-5baceb5700b7 None admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:22.311917 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d9d443-d05c-4c34-8e21-5baceb5700b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:22.312481 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d9d443-d05c-4c34-8e21-5baceb5700b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:22.314069 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d9d443-d05c-4c34-8e21-5baceb5700b7 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:22.332582 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 421/860] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 10 09:51:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:22.334748 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d9d443-d05c-4c34-8e21-5baceb5700b7 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:22.343875 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d87189-f5c8-431e-a02e-fee315f81b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:22.344498 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d87189-f5c8-431e-a02e-fee315f81b8c None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:22.344777 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d87189-f5c8-431e-a02e-fee315f81b8c None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:22.345048 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d87189-f5c8-431e-a02e-fee315f81b8c None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:22.345856 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d87189-f5c8-431e-a02e-fee315f81b8c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:22.346195 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d87189-f5c8-431e-a02e-fee315f81b8c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:22.348301 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d87189-f5c8-431e-a02e-fee315f81b8c None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:22.352956 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 440/861] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Aug 10 09:51:22 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:22.359179 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d87189-f5c8-431e-a02e-fee315f81b8c None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:22.447436 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:22.471791 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d87189-f5c8-431e-a02e-fee315f81b8c None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:22.476738 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d9d443-d05c-4c34-8e21-5baceb5700b7 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:22.507313 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3980e2-accb-4756-a70e-b5349e1ee634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:22.507950 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3980e2-accb-4756-a70e-b5349e1ee634 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:22.508207 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3980e2-accb-4756-a70e-b5349e1ee634 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:22.508478 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3980e2-accb-4756-a70e-b5349e1ee634 None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:22.509135 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3980e2-accb-4756-a70e-b5349e1ee634 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:22.509437 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3980e2-accb-4756-a70e-b5349e1ee634 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:22.510806 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3980e2-accb-4756-a70e-b5349e1ee634 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:22.518784 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 441/862] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Aug 10 09:51:22 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:22.529584 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217185aa-a12a-47d6-827f-f8e8d99cb187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:22.530600 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217185aa-a12a-47d6-827f-f8e8d99cb187 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:22.531035 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217185aa-a12a-47d6-827f-f8e8d99cb187 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:22.531491 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217185aa-a12a-47d6-827f-f8e8d99cb187 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:22.541270 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217185aa-a12a-47d6-827f-f8e8d99cb187 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:22.543073 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217185aa-a12a-47d6-827f-f8e8d99cb187 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:22.556727 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-217185aa-a12a-47d6-827f-f8e8d99cb187 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 10 09:51:22.556727 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:22.556727 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:22.556727 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:22.556727 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:22.556727 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:22.556727 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:22.556727 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:22.556727 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:22.556727 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:22.556727 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:22.556727 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:22.556727 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 09:51:22.556727 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 09:51:22.556727 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 09:51:22.556727 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 09:51:22.557987 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:22.557987 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:22.557987 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 09:51:22.557987 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 09:51:22.557987 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 09:51:22.557987 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 09:51:22.557987 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:22.557987 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:22.557987 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:22.557987 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:22.557987 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:22.557987 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:22.557987 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:22.557987 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:22.557987 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:22.557987 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:22.557987 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:22.557987 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:22.558945 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:22.558945 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:22.558945 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 09:51:22.558945 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 09:51:22.558945 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 09:51:22.558945 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 09:51:22.558945 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 09:51:22.558945 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 09:51:22.558945 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 10 09:51:22.558945 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:51:22.565210 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 422/863] 10.222.0.27 () {56 vars in 1117 bytes} [Wed Aug 10 09:51:22 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:51:22.567327 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3980e2-accb-4756-a70e-b5349e1ee634 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:22.681984 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3980e2-accb-4756-a70e-b5349e1ee634 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:22.717460 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87511d65-52b8-4160-aff4-f91155dd2586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:22.718079 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87511d65-52b8-4160-aff4-f91155dd2586 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:22.718361 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87511d65-52b8-4160-aff4-f91155dd2586 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:22.718631 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87511d65-52b8-4160-aff4-f91155dd2586 None admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:22.719377 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87511d65-52b8-4160-aff4-f91155dd2586 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:22.719674 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87511d65-52b8-4160-aff4-f91155dd2586 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:22.721188 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87511d65-52b8-4160-aff4-f91155dd2586 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:22.731708 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:22.744129 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 442/864] 10.222.0.27 () {56 vars in 1149 bytes} [Wed Aug 10 09:51:22 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:22.745755 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217185aa-a12a-47d6-827f-f8e8d99cb187 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:22.757993 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:22.852325 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217185aa-a12a-47d6-827f-f8e8d99cb187 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:22.887852 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fb8842-9d3f-4aa0-8c68-d8a4a9ca3a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:22.888466 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb8842-9d3f-4aa0-8c68-d8a4a9ca3a85 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:22.888749 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb8842-9d3f-4aa0-8c68-d8a4a9ca3a85 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:22.889021 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb8842-9d3f-4aa0-8c68-d8a4a9ca3a85 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:22.962400 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fb8842-9d3f-4aa0-8c68-d8a4a9ca3a85 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:22.963870 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fb8842-9d3f-4aa0-8c68-d8a4a9ca3a85 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:22.974089 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:23.064286 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 423/865] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 10 09:51:22 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 09:51:23.070155 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87511d65-52b8-4160-aff4-f91155dd2586 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:23.171587 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87511d65-52b8-4160-aff4-f91155dd2586 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:23.206477 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5559f8c6-fde4-417c-b0f6-9b26014ab18f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:23.207112 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5559f8c6-fde4-417c-b0f6-9b26014ab18f None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:23.207393 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5559f8c6-fde4-417c-b0f6-9b26014ab18f None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:23.207667 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5559f8c6-fde4-417c-b0f6-9b26014ab18f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:23.218008 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5559f8c6-fde4-417c-b0f6-9b26014ab18f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:23.219533 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5559f8c6-fde4-417c-b0f6-9b26014ab18f None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:23.234279 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-5559f8c6-fde4-417c-b0f6-9b26014ab18f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:51:23.234279 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:23.234279 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:23.234279 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:23.234279 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:23.234279 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:23.234279 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:23.234279 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:23.234279 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:23.234279 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:23.234279 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:23.234279 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:23.234279 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 09:51:23.234279 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 09:51:23.234279 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 09:51:23.234279 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 09:51:23.235219 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:23.235219 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:23.235219 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:23.235219 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:23.235219 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:23.235219 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:23.235219 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:23.235219 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:23.235219 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:23.235219 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:23.235219 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:23.235219 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:23.235219 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:23.235219 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:23.235219 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:23.235219 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:23.235219 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 09:51:23.236107 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 09:51:23.236107 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:51:23.236107 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:51:23.236107 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 443/866] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 10 09:51:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 09:51:23.242168 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fb8842-9d3f-4aa0-8c68-d8a4a9ca3a85 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:23.276117 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4507f60a-30a1-4048-8836-e10bbc47bca5 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:23.276466 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4507f60a-30a1-4048-8836-e10bbc47bca5 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:23.276745 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4507f60a-30a1-4048-8836-e10bbc47bca5 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:23.278478 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 444/867] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:51:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 09:51:23.283492 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8256b158-5eac-4240-ae53-633552ff0aa7 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:23.283772 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8256b158-5eac-4240-ae53-633552ff0aa7 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:23.284043 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8256b158-5eac-4240-ae53-633552ff0aa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:23.302731 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-8256b158-5eac-4240-ae53-633552ff0aa7 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:51:23.304096 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-8256b158-5eac-4240-ae53-633552ff0aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:51:23.352203 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:23.352825 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fb8842-9d3f-4aa0-8c68-d8a4a9ca3a85 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:23.363177 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:23.381525 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 445/868] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:51:23 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 09:51:23.389620 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525f8745-fcd1-4207-bbbe-3cf7d48ab406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:23.390245 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525f8745-fcd1-4207-bbbe-3cf7d48ab406 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:23.390523 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525f8745-fcd1-4207-bbbe-3cf7d48ab406 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:23.390791 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525f8745-fcd1-4207-bbbe-3cf7d48ab406 None admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:23.391512 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525f8745-fcd1-4207-bbbe-3cf7d48ab406 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:23.391821 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525f8745-fcd1-4207-bbbe-3cf7d48ab406 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:23.393298 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525f8745-fcd1-4207-bbbe-3cf7d48ab406 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:23.401960 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8256b158-5eac-4240-ae53-633552ff0aa7 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:23.406548 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 424/869] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 10 09:51:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:23.412270 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525f8745-fcd1-4207-bbbe-3cf7d48ab406 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:23.510728 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8256b158-5eac-4240-ae53-633552ff0aa7 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:23.517726 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525f8745-fcd1-4207-bbbe-3cf7d48ab406 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:23.545723 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d4ecc0-0f16-427e-b24f-0faf2f74c70f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:23.546420 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d4ecc0-0f16-427e-b24f-0faf2f74c70f None admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:23.546778 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d4ecc0-0f16-427e-b24f-0faf2f74c70f None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:23.547121 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d4ecc0-0f16-427e-b24f-0faf2f74c70f None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:23.547999 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d4ecc0-0f16-427e-b24f-0faf2f74c70f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:23.549324 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d4ecc0-0f16-427e-b24f-0faf2f74c70f None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:23.552838 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f27ad0e-96a2-4892-b164-38417aa5eed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:23.553695 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f27ad0e-96a2-4892-b164-38417aa5eed7 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:23.554113 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f27ad0e-96a2-4892-b164-38417aa5eed7 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:23.554540 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f27ad0e-96a2-4892-b164-38417aa5eed7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:23.562650 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f27ad0e-96a2-4892-b164-38417aa5eed7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:23.564447 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f27ad0e-96a2-4892-b164-38417aa5eed7 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:23.575882 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 446/870] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Aug 10 09:51:23 2022] POST /identity/v3/services => generated 251 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 09:51:23.582783 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-4f27ad0e-96a2-4892-b164-38417aa5eed7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 09:51:23.582783 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:23.582783 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:23.582783 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:23.582783 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:23.582783 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:23.582783 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:23.582783 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:23.582783 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:23.582783 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:23.582783 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:23.582783 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:23.582783 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 09:51:23.582783 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 09:51:23.582783 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 09:51:23.583814 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 09:51:23.583814 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:23.583814 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:23.583814 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:23.583814 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:23.583814 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:23.583814 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:23.583814 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:23.583814 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:23.583814 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:23.583814 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:23.583814 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:23.583814 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:23.583814 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:23.583814 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:23.583814 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:23.583814 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:23.584756 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 09:51:23.584756 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 09:51:23.584756 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 09:51:23.584756 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 09:51:23.584756 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 09:51:23.584756 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 09:51:23.584756 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 09:51:23.584756 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:51:23.588974 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 425/871] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 10 09:51:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:51:23.591445 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d4ecc0-0f16-427e-b24f-0faf2f74c70f None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:23.641301 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:23.717537 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d4ecc0-0f16-427e-b24f-0faf2f74c70f None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:23.755506 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5dd6cd-28ca-4bb5-8e9c-ae5dc1af2b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:23.756157 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5dd6cd-28ca-4bb5-8e9c-ae5dc1af2b16 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:23.756464 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5dd6cd-28ca-4bb5-8e9c-ae5dc1af2b16 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:23.756785 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5dd6cd-28ca-4bb5-8e9c-ae5dc1af2b16 None admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:23.757503 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5dd6cd-28ca-4bb5-8e9c-ae5dc1af2b16 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:23.757814 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5dd6cd-28ca-4bb5-8e9c-ae5dc1af2b16 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:23.759272 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5dd6cd-28ca-4bb5-8e9c-ae5dc1af2b16 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:23.772816 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 447/872] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Aug 10 09:51:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:23.778781 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f27ad0e-96a2-4892-b164-38417aa5eed7 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:23.809433 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:23.884885 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f27ad0e-96a2-4892-b164-38417aa5eed7 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:23.918940 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609864ee-1dcf-4a96-87a9-c1a963ca2aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:23.919548 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609864ee-1dcf-4a96-87a9-c1a963ca2aaf None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:23.919827 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609864ee-1dcf-4a96-87a9-c1a963ca2aaf None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:23.920101 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609864ee-1dcf-4a96-87a9-c1a963ca2aaf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:23.920835 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609864ee-1dcf-4a96-87a9-c1a963ca2aaf None admin] RBAC: Adding query filter params (role.id=c0cf832e3b184857b8eaed2f68da1532, scope.project.id=d47d5b72a00642a1a239b785110643ef, user.id=179709fe7d8343689f096ac0d9a333b0) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:23.921175 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609864ee-1dcf-4a96-87a9-c1a963ca2aaf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:23.922689 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609864ee-1dcf-4a96-87a9-c1a963ca2aaf None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:23.937182 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 426/873] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 10 09:51:23 2022] GET /identity/v3/role_assignments?user.id=179709fe7d8343689f096ac0d9a333b0&scope.project.id=d47d5b72a00642a1a239b785110643ef&role.id=c0cf832e3b184857b8eaed2f68da1532 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:24.326664 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c6c196-e4d1-4e3b-9c3b-65a1bb717104 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:24.327065 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c6c196-e4d1-4e3b-9c3b-65a1bb717104 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:24.327237 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c6c196-e4d1-4e3b-9c3b-65a1bb717104 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:24.328797 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 448/874] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:51:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:51:24.333996 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57929eb-26bd-4d7b-b428-7bf1cbd14462 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:24.334633 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57929eb-26bd-4d7b-b428-7bf1cbd14462 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:24.334633 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57929eb-26bd-4d7b-b428-7bf1cbd14462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:24.353032 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-f57929eb-26bd-4d7b-b428-7bf1cbd14462 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:51:24.354270 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-f57929eb-26bd-4d7b-b428-7bf1cbd14462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:51:24.424572 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 427/875] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:51:24 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 09:51:24.447837 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c6c196-e4d1-4e3b-9c3b-65a1bb717104 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:24.551404 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:24.560712 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c6c196-e4d1-4e3b-9c3b-65a1bb717104 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:24.583604 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d139a46-fbda-4762-872b-69df98e06426 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:24.583795 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d139a46-fbda-4762-872b-69df98e06426 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:24.584081 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d139a46-fbda-4762-872b-69df98e06426 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:24.586393 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 428/876] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:51:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 09:51:24.591088 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fe4cc5-b603-4a93-9d05-6268fd7c426f None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:24.591376 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fe4cc5-b603-4a93-9d05-6268fd7c426f None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:24.591653 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fe4cc5-b603-4a93-9d05-6268fd7c426f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:24.598223 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e7ca49-7abf-463a-bb54-7c10936cf43e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:24.600077 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e7ca49-7abf-463a-bb54-7c10936cf43e None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:24.600563 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e7ca49-7abf-463a-bb54-7c10936cf43e None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:24.601034 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e7ca49-7abf-463a-bb54-7c10936cf43e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:24.601862 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e7ca49-7abf-463a-bb54-7c10936cf43e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:24.603418 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e7ca49-7abf-463a-bb54-7c10936cf43e None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:24.610092 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-a0fe4cc5-b603-4a93-9d05-6268fd7c426f None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:51:24.611296 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-a0fe4cc5-b603-4a93-9d05-6268fd7c426f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:51:24.615010 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-c2e7ca49-7abf-463a-bb54-7c10936cf43e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 09:51:24.615010 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:24.615010 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 09:51:24.615010 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 09:51:24.615010 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 09:51:24.615010 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 09:51:24.615010 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 09:51:24.615010 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 09:51:24.615010 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 09:51:24.615010 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:51:24.615010 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 09:51:24.615010 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:51:24.615010 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:24.615010 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:24.615010 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:24.615010 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:24.615010 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:24.616075 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:24.616075 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:24.616075 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:24.616075 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:24.616075 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:24.616075 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:24.616075 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 09:51:24.616075 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 09:51:24.616075 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 09:51:24.616075 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 09:51:24.616075 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:24.616075 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:24.616075 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:24.616075 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:24.616075 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:24.616075 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:24.616911 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:24.616911 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:24.616911 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:24.616911 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:24.616911 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:24.616911 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:24.616911 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:24.616911 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:24.616911 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:24.616911 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:24.616911 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 09:51:24.616911 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 09:51:24.616911 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 09:51:24.616911 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:51:24.620097 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 449/877] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Aug 10 09:51:24 2022] GET /identity/v3/services/object-store => generated 93 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:51:24.625630 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e7ca49-7abf-463a-bb54-7c10936cf43e None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:24.633802 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:24.703650 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 429/878] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:51:24 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 09:51:24.725391 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fe4cc5-b603-4a93-9d05-6268fd7c426f None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:24.739713 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e7ca49-7abf-463a-bb54-7c10936cf43e None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:24.782285 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a8354c-9244-4503-bb34-9d476b6c00e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:24.783000 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a8354c-9244-4503-bb34-9d476b6c00e2 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:24.783602 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a8354c-9244-4503-bb34-9d476b6c00e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:24.783946 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a8354c-9244-4503-bb34-9d476b6c00e2 None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:24.784710 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a8354c-9244-4503-bb34-9d476b6c00e2 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:24.785104 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a8354c-9244-4503-bb34-9d476b6c00e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:24.786993 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a8354c-9244-4503-bb34-9d476b6c00e2 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:24.793636 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 450/879] 10.222.0.27 () {56 vars in 1122 bytes} [Wed Aug 10 09:51:24 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 09:51:24.798814 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a8354c-9244-4503-bb34-9d476b6c00e2 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:24.835194 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:24.853856 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fe4cc5-b603-4a93-9d05-6268fd7c426f None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:24.897588 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aadb97-4ed4-4b3e-aed8-5a7ea24b9372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:24.898940 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aadb97-4ed4-4b3e-aed8-5a7ea24b9372 None admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:24.899880 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aadb97-4ed4-4b3e-aed8-5a7ea24b9372 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:24.900330 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aadb97-4ed4-4b3e-aed8-5a7ea24b9372 None admin] PATH_INFO: `/v3/services` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:24.901459 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aadb97-4ed4-4b3e-aed8-5a7ea24b9372 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:24.903960 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aadb97-4ed4-4b3e-aed8-5a7ea24b9372 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:24.913010 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a8354c-9244-4503-bb34-9d476b6c00e2 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:24.925581 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 430/880] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Aug 10 09:51:24 2022] POST /identity/v3/services => generated 269 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 09:51:24.964225 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f401c806-6ab3-495b-b587-39f851c4d1c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:24.965262 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f401c806-6ab3-495b-b587-39f851c4d1c8 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:24.965743 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f401c806-6ab3-495b-b587-39f851c4d1c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:24.966224 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f401c806-6ab3-495b-b587-39f851c4d1c8 None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:24.967045 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f401c806-6ab3-495b-b587-39f851c4d1c8 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:24.967517 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f401c806-6ab3-495b-b587-39f851c4d1c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:24.969271 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f401c806-6ab3-495b-b587-39f851c4d1c8 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:24.975473 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 451/881] 10.222.0.27 () {56 vars in 1122 bytes} [Wed Aug 10 09:51:24 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:25.721181 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c44b99-18a0-41c8-8295-e9dc4d930c80 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:25.721525 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c44b99-18a0-41c8-8295-e9dc4d930c80 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:25.721745 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c44b99-18a0-41c8-8295-e9dc4d930c80 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:25.723362 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 431/882] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:51:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:51:25.728882 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34033217-2c5d-4ae5-a5d5-1eaed76abba5 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:25.729360 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34033217-2c5d-4ae5-a5d5-1eaed76abba5 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:25.729529 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34033217-2c5d-4ae5-a5d5-1eaed76abba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:25.747899 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-34033217-2c5d-4ae5-a5d5-1eaed76abba5 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:51:25.749133 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-34033217-2c5d-4ae5-a5d5-1eaed76abba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:51:25.823244 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 452/883] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:51:25 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 09:51:25.841137 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c44b99-18a0-41c8-8295-e9dc4d930c80 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:25.856844 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:25.950562 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c44b99-18a0-41c8-8295-e9dc4d930c80 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:25.987696 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5037c50c-06e1-4598-8b85-9fdf7b530c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:25.988331 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5037c50c-06e1-4598-8b85-9fdf7b530c81 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:25.988608 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5037c50c-06e1-4598-8b85-9fdf7b530c81 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:25.988878 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5037c50c-06e1-4598-8b85-9fdf7b530c81 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:25.989589 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5037c50c-06e1-4598-8b85-9fdf7b530c81 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:25.991033 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5037c50c-06e1-4598-8b85-9fdf7b530c81 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:25.999996 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-5037c50c-06e1-4598-8b85-9fdf7b530c81 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 10 09:51:25.999996 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:25.999996 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 09:51:25.999996 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 09:51:25.999996 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 09:51:25.999996 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 09:51:25.999996 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 09:51:25.999996 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 09:51:25.999996 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 10 09:51:25.999996 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:51:25.999996 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 09:51:25.999996 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:51:25.999996 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:25.999996 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:25.999996 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:25.999996 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:25.999996 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:26.002195 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:26.002195 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:26.002195 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:26.002195 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:26.002195 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:26.002195 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:26.002195 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 09:51:26.002195 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 09:51:26.002195 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 09:51:26.002195 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 09:51:26.002195 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:26.002195 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:26.002195 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:26.002195 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:26.002195 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:26.002195 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:26.004120 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:26.004120 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:26.004120 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:26.004120 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:26.004120 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:26.004120 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:26.004120 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:26.004120 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:26.004120 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:26.004120 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:26.004120 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 09:51:26.004120 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 09:51:26.004120 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 10 09:51:26.004120 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:51:26.004120 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 432/884] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Aug 10 09:51:25 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:51:26.009097 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34033217-2c5d-4ae5-a5d5-1eaed76abba5 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:26.023011 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:26.094473 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febe822a-26e2-43cb-ae40-024681a6c63e None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:26.094932 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febe822a-26e2-43cb-ae40-024681a6c63e None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:26.095300 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febe822a-26e2-43cb-ae40-024681a6c63e None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:26.097114 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 433/885] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:51:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:51:26.102764 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22186f0a-8f66-402e-9d99-11c83f61949c None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:26.103616 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22186f0a-8f66-402e-9d99-11c83f61949c None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:26.103616 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22186f0a-8f66-402e-9d99-11c83f61949c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:26.116010 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34033217-2c5d-4ae5-a5d5-1eaed76abba5 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:26.123003 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-22186f0a-8f66-402e-9d99-11c83f61949c None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:51:26.124410 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-22186f0a-8f66-402e-9d99-11c83f61949c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:51:26.153216 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d4b727-f7d1-4063-a997-6468923120a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:26.154090 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d4b727-f7d1-4063-a997-6468923120a0 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:26.154514 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d4b727-f7d1-4063-a997-6468923120a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:26.154949 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d4b727-f7d1-4063-a997-6468923120a0 None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:26.155736 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d4b727-f7d1-4063-a997-6468923120a0 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:26.156182 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d4b727-f7d1-4063-a997-6468923120a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:26.157716 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d4b727-f7d1-4063-a997-6468923120a0 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:26.163055 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 453/886] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Aug 10 09:51:26 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:26.168465 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d4b727-f7d1-4063-a997-6468923120a0 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:26.201426 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 434/887] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:51:26 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 09:51:26.224909 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22186f0a-8f66-402e-9d99-11c83f61949c None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:26.235031 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:26.258445 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:26.284099 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d4b727-f7d1-4063-a997-6468923120a0 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:26.320993 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaab91aa-df92-4813-883e-cd19e80ab37d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:26.321862 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaab91aa-df92-4813-883e-cd19e80ab37d None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:26.322227 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaab91aa-df92-4813-883e-cd19e80ab37d None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:26.322589 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaab91aa-df92-4813-883e-cd19e80ab37d None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:26.323355 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaab91aa-df92-4813-883e-cd19e80ab37d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:26.323751 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaab91aa-df92-4813-883e-cd19e80ab37d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:26.325369 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaab91aa-df92-4813-883e-cd19e80ab37d None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:26.330946 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 454/888] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Aug 10 09:51:26 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 09:51:26.336618 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaab91aa-df92-4813-883e-cd19e80ab37d None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:26.346293 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22186f0a-8f66-402e-9d99-11c83f61949c None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:26.384004 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe8c962-7ed7-4377-b508-b48a370353c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:26.384771 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe8c962-7ed7-4377-b508-b48a370353c0 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:26.385176 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe8c962-7ed7-4377-b508-b48a370353c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:26.385547 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe8c962-7ed7-4377-b508-b48a370353c0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:26.396502 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe8c962-7ed7-4377-b508-b48a370353c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 09:51:26.402236 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-abe8c962-7ed7-4377-b508-b48a370353c0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 10 09:51:26.402236 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:26.402236 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:26.402236 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:26.402236 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:26.402236 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:26.402236 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:26.402236 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:26.402236 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:26.402236 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:26.402236 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:26.402236 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:26.402236 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 09:51:26.402236 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 09:51:26.402236 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 09:51:26.402236 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 09:51:26.403461 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 09:51:26.403461 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 09:51:26.403461 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 09:51:26.403461 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 09:51:26.403461 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:26.403461 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:26.403461 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:26.403461 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:26.403461 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:26.403461 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:26.403461 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:26.403461 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:26.403461 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:26.403461 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:26.403461 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:26.403461 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:26.404518 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:26.404518 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:26.404518 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:26.404518 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:26.404518 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 09:51:26.404518 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 09:51:26.404518 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 09:51:26.404518 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 09:51:26.404518 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 09:51:26.404518 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 09:51:26.404518 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 10 09:51:26.404518 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:51:26.411561 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 435/889] 10.222.0.27 () {56 vars in 1120 bytes} [Wed Aug 10 09:51:26 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 09:51:26.412270 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe8c962-7ed7-4377-b508-b48a370353c0 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:26.468133 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaab91aa-df92-4813-883e-cd19e80ab37d None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:26.493792 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:26.519293 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d485233-2068-4c35-bbf5-9d8744a9412b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:26.520574 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d485233-2068-4c35-bbf5-9d8744a9412b None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:26.521033 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d485233-2068-4c35-bbf5-9d8744a9412b None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:26.521773 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d485233-2068-4c35-bbf5-9d8744a9412b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:26.523201 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d485233-2068-4c35-bbf5-9d8744a9412b None admin] RBAC: Adding query filter params (interface=public, service_id=404e1920867b4cacb7e8b48be1a0dc76, region_id=RegionOne) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:26.523810 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d485233-2068-4c35-bbf5-9d8744a9412b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:26.526052 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d485233-2068-4c35-bbf5-9d8744a9412b None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:26.531204 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe8c962-7ed7-4377-b508-b48a370353c0 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:26.536946 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 455/890] 10.222.0.27 () {56 vars in 1251 bytes} [Wed Aug 10 09:51:26 2022] GET /identity/v3/endpoints?service_id=404e1920867b4cacb7e8b48be1a0dc76&interface=public®ion_id=RegionOne => generated 194 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:26.546285 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d485233-2068-4c35-bbf5-9d8744a9412b None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:26.558814 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:26.580449 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d3e2c8-1699-414c-ae4d-afcbfd085f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:26.581471 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d3e2c8-1699-414c-ae4d-afcbfd085f02 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:26.581897 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d3e2c8-1699-414c-ae4d-afcbfd085f02 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:26.582336 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d3e2c8-1699-414c-ae4d-afcbfd085f02 None admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:26.583154 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d3e2c8-1699-414c-ae4d-afcbfd085f02 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:26.583719 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d3e2c8-1699-414c-ae4d-afcbfd085f02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:26.585485 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d3e2c8-1699-414c-ae4d-afcbfd085f02 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:26.594623 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 436/891] 10.222.0.27 () {56 vars in 1115 bytes} [Wed Aug 10 09:51:26 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 09:51:26.601398 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d3e2c8-1699-414c-ae4d-afcbfd085f02 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:26.666879 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d485233-2068-4c35-bbf5-9d8744a9412b None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:26.707715 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239973ab-443c-4629-a969-b9bc2288bb66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:26.708516 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239973ab-443c-4629-a969-b9bc2288bb66 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:26.708880 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239973ab-443c-4629-a969-b9bc2288bb66 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:26.709369 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239973ab-443c-4629-a969-b9bc2288bb66 None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:26.710204 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239973ab-443c-4629-a969-b9bc2288bb66 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:26.711790 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239973ab-443c-4629-a969-b9bc2288bb66 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:26.718433 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 456/892] 10.222.0.27 () {56 vars in 1087 bytes} [Wed Aug 10 09:51:26 2022] GET /identity/v3/services => generated 1268 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 09:51:26.733239 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d3e2c8-1699-414c-ae4d-afcbfd085f02 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:26.764139 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:26.775399 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246ac1e7-1489-4513-bfe0-7f31998e9ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:26.776326 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246ac1e7-1489-4513-bfe0-7f31998e9ebb None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:26.776749 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246ac1e7-1489-4513-bfe0-7f31998e9ebb None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:26.777200 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246ac1e7-1489-4513-bfe0-7f31998e9ebb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:26.791300 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246ac1e7-1489-4513-bfe0-7f31998e9ebb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:26.793191 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246ac1e7-1489-4513-bfe0-7f31998e9ebb None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:26.809970 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-246ac1e7-1489-4513-bfe0-7f31998e9ebb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:51:26.809970 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:26.809970 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:26.809970 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:26.809970 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:26.809970 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:26.809970 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:26.809970 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:26.809970 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:26.809970 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:26.809970 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:26.809970 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:26.809970 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 09:51:26.809970 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 09:51:26.809970 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 09:51:26.809970 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 09:51:26.811187 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:26.811187 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:26.811187 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:26.811187 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:26.811187 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:26.811187 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:26.811187 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:26.811187 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:26.811187 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:26.811187 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:26.811187 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:26.811187 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:26.811187 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:26.811187 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:26.811187 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:26.811187 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:26.811187 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 09:51:26.812283 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 09:51:26.812283 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:51:26.812283 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:51:26.814181 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 437/893] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 10 09:51:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:51:26.821231 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239973ab-443c-4629-a969-b9bc2288bb66 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:26.895077 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:26.928397 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239973ab-443c-4629-a969-b9bc2288bb66 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:26.963203 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea797fde-b964-4e81-b372-57f2627eda63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:26.963814 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea797fde-b964-4e81-b372-57f2627eda63 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:26.964092 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea797fde-b964-4e81-b372-57f2627eda63 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:26.964362 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea797fde-b964-4e81-b372-57f2627eda63 None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:26.965102 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea797fde-b964-4e81-b372-57f2627eda63 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:26.965412 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea797fde-b964-4e81-b372-57f2627eda63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:26.966787 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea797fde-b964-4e81-b372-57f2627eda63 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:26.979485 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 457/894] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 10 09:51:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:26.985056 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246ac1e7-1489-4513-bfe0-7f31998e9ebb None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:27.012737 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a9c305-13f2-42d1-8631-3ad86d76f08c None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:27.013031 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a9c305-13f2-42d1-8631-3ad86d76f08c None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:27.013318 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a9c305-13f2-42d1-8631-3ad86d76f08c None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:27.014913 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 458/895] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:51:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 09:51:27.019822 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf5b4c9-65c4-48de-8e27-7a23f3d47dbe None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:27.020109 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf5b4c9-65c4-48de-8e27-7a23f3d47dbe None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:27.020379 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf5b4c9-65c4-48de-8e27-7a23f3d47dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:27.043432 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-2bf5b4c9-65c4-48de-8e27-7a23f3d47dbe None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:51:27.044883 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-2bf5b4c9-65c4-48de-8e27-7a23f3d47dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:51:27.096373 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246ac1e7-1489-4513-bfe0-7f31998e9ebb None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:27.118766 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 459/896] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:51:27 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 09:51:27.120369 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392ea91e-4c7f-4944-a528-e7e26390558c None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:27.120654 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392ea91e-4c7f-4944-a528-e7e26390558c None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:27.120933 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392ea91e-4c7f-4944-a528-e7e26390558c None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:27.122345 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 460/897] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:51:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:51:27.127584 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d895792-c078-4f63-999a-1ac55402cf96 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:27.127759 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d895792-c078-4f63-999a-1ac55402cf96 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:27.128038 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d895792-c078-4f63-999a-1ac55402cf96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:27.139205 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3913d699-9e19-4c9d-9985-26ffdce2aaae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:27.140117 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3913d699-9e19-4c9d-9985-26ffdce2aaae None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:27.140691 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3913d699-9e19-4c9d-9985-26ffdce2aaae None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:27.141041 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3913d699-9e19-4c9d-9985-26ffdce2aaae None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:27.147291 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-7d895792-c078-4f63-999a-1ac55402cf96 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:51:27.148956 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-7d895792-c078-4f63-999a-1ac55402cf96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:51:27.149223 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3913d699-9e19-4c9d-9985-26ffdce2aaae None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:27.150690 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3913d699-9e19-4c9d-9985-26ffdce2aaae None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:27.163240 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-3913d699-9e19-4c9d-9985-26ffdce2aaae None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 10 09:51:27.163240 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:27.163240 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:27.163240 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:27.163240 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:27.163240 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:27.163240 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:27.163240 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:27.163240 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:27.163240 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:27.163240 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:27.163240 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:27.163240 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 09:51:27.163240 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 09:51:27.163240 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 09:51:27.163240 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 09:51:27.164425 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:27.164425 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:27.164425 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 09:51:27.164425 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 09:51:27.164425 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 09:51:27.164425 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 09:51:27.164425 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:27.164425 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:27.164425 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:27.164425 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:27.164425 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:27.164425 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:27.164425 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:27.164425 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:27.164425 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:27.164425 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:27.164425 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:27.164425 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:27.165585 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:27.165585 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:27.165585 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 09:51:27.165585 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 09:51:27.165585 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 09:51:27.165585 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 09:51:27.165585 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 09:51:27.165585 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 09:51:27.165585 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 10 09:51:27.165585 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:51:27.171105 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 438/898] 10.222.0.27 () {56 vars in 1117 bytes} [Wed Aug 10 09:51:26 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 09:51:27.171105 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3913d699-9e19-4c9d-9985-26ffdce2aaae None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:27.212952 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:27.222515 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:27.233088 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 461/899] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:51:27 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 09:51:27.233849 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d895792-c078-4f63-999a-1ac55402cf96 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:27.281764 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3913d699-9e19-4c9d-9985-26ffdce2aaae None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:27.319694 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7ab38d-4f5d-4324-a599-a4f11bfecb73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:27.320295 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ab38d-4f5d-4324-a599-a4f11bfecb73 None admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:27.320570 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ab38d-4f5d-4324-a599-a4f11bfecb73 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:27.320843 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ab38d-4f5d-4324-a599-a4f11bfecb73 None admin] PATH_INFO: `/v3/services` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:27.321509 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7ab38d-4f5d-4324-a599-a4f11bfecb73 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:27.322875 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7ab38d-4f5d-4324-a599-a4f11bfecb73 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:27.349094 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 439/900] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Aug 10 09:51:27 2022] POST /identity/v3/services => generated 241 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 09:51:27.349094 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7ab38d-4f5d-4324-a599-a4f11bfecb73 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:27.362404 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d895792-c078-4f63-999a-1ac55402cf96 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:27.424379 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94932bae-77cd-491c-9b1e-6f209daca3cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:27.425046 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94932bae-77cd-491c-9b1e-6f209daca3cc None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:27.425352 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94932bae-77cd-491c-9b1e-6f209daca3cc None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:27.425629 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94932bae-77cd-491c-9b1e-6f209daca3cc None admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:27.426436 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94932bae-77cd-491c-9b1e-6f209daca3cc None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:27.426702 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94932bae-77cd-491c-9b1e-6f209daca3cc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:27.428257 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94932bae-77cd-491c-9b1e-6f209daca3cc None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:27.456054 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:27.457781 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 462/901] 10.222.0.27 () {56 vars in 1149 bytes} [Wed Aug 10 09:51:27 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:27.463885 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94932bae-77cd-491c-9b1e-6f209daca3cc None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:27.465400 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7ab38d-4f5d-4324-a599-a4f11bfecb73 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:27.509231 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a958993-4f9c-4870-8544-5bbb3b564fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:27.509930 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a958993-4f9c-4870-8544-5bbb3b564fa1 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:27.510223 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a958993-4f9c-4870-8544-5bbb3b564fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:27.510529 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a958993-4f9c-4870-8544-5bbb3b564fa1 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:27.511123 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a958993-4f9c-4870-8544-5bbb3b564fa1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:27.512500 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a958993-4f9c-4870-8544-5bbb3b564fa1 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:27.523076 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-4a958993-4f9c-4870-8544-5bbb3b564fa1 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 10 09:51:27.523076 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:27.523076 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 09:51:27.523076 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 09:51:27.523076 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 09:51:27.523076 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 09:51:27.523076 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 09:51:27.523076 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 09:51:27.523076 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 10 09:51:27.523076 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:51:27.523076 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 09:51:27.523076 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:51:27.523076 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:27.523076 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:27.523076 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:27.523076 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:27.524057 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:27.524057 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:27.524057 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:27.524057 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:27.524057 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:27.524057 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:27.524057 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:27.524057 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 09:51:27.524057 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 09:51:27.524057 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 09:51:27.524057 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 09:51:27.524057 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:27.524057 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:27.524057 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:27.524057 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:27.524057 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:27.524057 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:27.524942 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:27.524942 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:27.524942 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:27.524942 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:27.524942 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:27.524942 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:27.524942 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:27.524942 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:27.524942 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:27.524942 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:27.524942 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 09:51:27.524942 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 09:51:27.524942 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 10 09:51:27.524942 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:51:27.524942 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 440/902] 10.222.0.27 () {56 vars in 1132 bytes} [Wed Aug 10 09:51:27 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:51:27.530988 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:27.531417 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a958993-4f9c-4870-8544-5bbb3b564fa1 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:27.601183 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94932bae-77cd-491c-9b1e-6f209daca3cc None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:27.637429 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5225d636-7e19-480d-841e-d7a9ba7f55c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:27.638416 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5225d636-7e19-480d-841e-d7a9ba7f55c1 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:27.638553 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5225d636-7e19-480d-841e-d7a9ba7f55c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:27.638737 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5225d636-7e19-480d-841e-d7a9ba7f55c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:27.650956 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a958993-4f9c-4870-8544-5bbb3b564fa1 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:27.692444 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebe59cc-3acd-4f8e-92ad-6e11fdca9e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:27.693969 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebe59cc-3acd-4f8e-92ad-6e11fdca9e7d None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:27.694507 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebe59cc-3acd-4f8e-92ad-6e11fdca9e7d None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:27.694992 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebe59cc-3acd-4f8e-92ad-6e11fdca9e7d None admin] PATH_INFO: `/v3/services` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:27.695824 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebe59cc-3acd-4f8e-92ad-6e11fdca9e7d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:27.696325 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebe59cc-3acd-4f8e-92ad-6e11fdca9e7d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:27.697982 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebe59cc-3acd-4f8e-92ad-6e11fdca9e7d None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:27.703439 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 441/903] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Aug 10 09:51:27 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:27.709904 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebe59cc-3acd-4f8e-92ad-6e11fdca9e7d None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:27.714036 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5225d636-7e19-480d-841e-d7a9ba7f55c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:27.716716 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5225d636-7e19-480d-841e-d7a9ba7f55c1 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:27.741318 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:27.775794 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:27.825380 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebe59cc-3acd-4f8e-92ad-6e11fdca9e7d None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:27.840408 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 463/904] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 10 09:51:27 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 09:51:27.849100 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5225d636-7e19-480d-841e-d7a9ba7f55c1 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:27.872497 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9f514a-a521-4e78-a95c-d8093d4490e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:27.873625 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9f514a-a521-4e78-a95c-d8093d4490e5 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:27.874110 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9f514a-a521-4e78-a95c-d8093d4490e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:27.874604 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9f514a-a521-4e78-a95c-d8093d4490e5 None admin] PATH_INFO: `/v3/services` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:27.875467 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9f514a-a521-4e78-a95c-d8093d4490e5 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:27.876077 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9f514a-a521-4e78-a95c-d8093d4490e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:27.877758 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9f514a-a521-4e78-a95c-d8093d4490e5 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:27.889202 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 442/905] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Aug 10 09:51:27 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 09:51:27.891176 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9f514a-a521-4e78-a95c-d8093d4490e5 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:27.972564 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5225d636-7e19-480d-841e-d7a9ba7f55c1 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:27.997289 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9f514a-a521-4e78-a95c-d8093d4490e5 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:28.009414 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:28.014991 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426dd618-c40d-43c1-858e-b1a9e1136127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:28.015800 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426dd618-c40d-43c1-858e-b1a9e1136127 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:28.016172 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426dd618-c40d-43c1-858e-b1a9e1136127 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:28.016457 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426dd618-c40d-43c1-858e-b1a9e1136127 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:28.031035 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426dd618-c40d-43c1-858e-b1a9e1136127 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:28.032668 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426dd618-c40d-43c1-858e-b1a9e1136127 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:28.035879 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:28.039905 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa517d1-e6f8-4043-86ff-183b949fd3c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:28.041584 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa517d1-e6f8-4043-86ff-183b949fd3c4 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:28.042087 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa517d1-e6f8-4043-86ff-183b949fd3c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:28.042676 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa517d1-e6f8-4043-86ff-183b949fd3c4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:28.043588 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa517d1-e6f8-4043-86ff-183b949fd3c4 None admin] RBAC: Adding query filter params (interface=public, service_id=77f2c3d155e5460cb8bf99ae8f4ab2bc, region_id=RegionOne) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:28.044098 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa517d1-e6f8-4043-86ff-183b949fd3c4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:28.045703 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa517d1-e6f8-4043-86ff-183b949fd3c4 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:28.050007 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-426dd618-c40d-43c1-858e-b1a9e1136127 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:51:28.050007 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:28.050007 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:28.050007 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:28.050007 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:28.050007 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:28.050007 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:28.050007 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:28.050007 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:28.050007 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:28.050007 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:28.050007 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:28.050007 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 09:51:28.050007 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 09:51:28.050007 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 09:51:28.050007 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 09:51:28.050955 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:28.050955 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:28.050955 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:28.050955 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:28.050955 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:28.050955 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:28.050955 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:28.050955 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:28.050955 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:28.050955 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:28.050955 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:28.050955 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:28.050955 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:28.050955 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:28.050955 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:28.050955 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:28.050955 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 09:51:28.051844 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 09:51:28.051844 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:51:28.051844 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:51:28.058553 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 464/907] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 10 09:51:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 09:51:28.058553 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426dd618-c40d-43c1-858e-b1a9e1136127 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:28.058934 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 443/907] 10.222.0.27 () {56 vars in 1251 bytes} [Wed Aug 10 09:51:27 2022] GET /identity/v3/endpoints?service_id=77f2c3d155e5460cb8bf99ae8f4ab2bc&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 09:51:28.060302 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa517d1-e6f8-4043-86ff-183b949fd3c4 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:28.170883 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa517d1-e6f8-4043-86ff-183b949fd3c4 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:28.184877 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426dd618-c40d-43c1-858e-b1a9e1136127 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:28.214746 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc126c2-e885-4c3d-8255-72e48cd00fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:28.215618 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc126c2-e885-4c3d-8255-72e48cd00fde None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:28.215911 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc126c2-e885-4c3d-8255-72e48cd00fde None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:28.216180 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc126c2-e885-4c3d-8255-72e48cd00fde None admin] PATH_INFO: `/v3/services` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:28.216804 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc126c2-e885-4c3d-8255-72e48cd00fde None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:28.218735 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc126c2-e885-4c3d-8255-72e48cd00fde None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:28.223430 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e159b8-273a-4c94-a12b-604f01867193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:28.224286 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e159b8-273a-4c94-a12b-604f01867193 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:28.224774 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e159b8-273a-4c94-a12b-604f01867193 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:28.226355 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e159b8-273a-4c94-a12b-604f01867193 None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:28.226470 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 444/908] 10.222.0.27 () {56 vars in 1087 bytes} [Wed Aug 10 09:51:28 2022] GET /identity/v3/services => generated 1497 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 09:51:28.227343 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e159b8-273a-4c94-a12b-604f01867193 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:28.233103 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e159b8-273a-4c94-a12b-604f01867193 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:28.233103 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e159b8-273a-4c94-a12b-604f01867193 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:28.244777 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 465/909] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 10 09:51:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:28.250720 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc126c2-e885-4c3d-8255-72e48cd00fde None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:28.275623 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:28.361659 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc126c2-e885-4c3d-8255-72e48cd00fde None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:28.398235 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2126a99a-bb18-43eb-b300-9a71bd8a80fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:28.398894 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2126a99a-bb18-43eb-b300-9a71bd8a80fa None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:28.399156 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2126a99a-bb18-43eb-b300-9a71bd8a80fa None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:28.399430 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2126a99a-bb18-43eb-b300-9a71bd8a80fa None admin] PATH_INFO: `/v3/projects/service` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:28.407025 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2126a99a-bb18-43eb-b300-9a71bd8a80fa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:28.408526 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2126a99a-bb18-43eb-b300-9a71bd8a80fa None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:28.421695 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-2126a99a-bb18-43eb-b300-9a71bd8a80fa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 09:51:28.421695 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:28.421695 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:28.421695 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:28.421695 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:28.421695 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:28.421695 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:28.421695 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:28.421695 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:28.421695 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:28.421695 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:28.421695 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:28.421695 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 09:51:28.421695 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 09:51:28.421695 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 09:51:28.422663 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 09:51:28.422663 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:28.422663 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:28.422663 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:28.422663 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:28.422663 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:28.422663 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:28.422663 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:28.422663 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:28.422663 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:28.422663 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:28.422663 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:28.422663 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:28.422663 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:28.422663 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:28.422663 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:28.422663 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:28.423984 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 09:51:28.423984 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 09:51:28.423984 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 09:51:28.423984 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 09:51:28.423984 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 09:51:28.423984 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 09:51:28.423984 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 09:51:28.423984 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:51:28.423984 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 445/910] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 10 09:51:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:51:28.428975 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e159b8-273a-4c94-a12b-604f01867193 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:28.489194 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:28.536150 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e159b8-273a-4c94-a12b-604f01867193 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:28.571247 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9673a2fc-2fa9-4bc7-b21a-905e791d0228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:28.571860 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9673a2fc-2fa9-4bc7-b21a-905e791d0228 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:28.572139 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9673a2fc-2fa9-4bc7-b21a-905e791d0228 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:28.572421 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9673a2fc-2fa9-4bc7-b21a-905e791d0228 None admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:28.573128 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9673a2fc-2fa9-4bc7-b21a-905e791d0228 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:28.573438 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9673a2fc-2fa9-4bc7-b21a-905e791d0228 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:28.574875 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9673a2fc-2fa9-4bc7-b21a-905e791d0228 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:28.587135 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 466/911] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Aug 10 09:51:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:28.593083 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2126a99a-bb18-43eb-b300-9a71bd8a80fa None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:28.676690 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:28.698534 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2126a99a-bb18-43eb-b300-9a71bd8a80fa None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:28.732938 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60021f7-f037-4dfb-9c49-91248a8c4ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:28.733918 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60021f7-f037-4dfb-9c49-91248a8c4ee9 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:28.734404 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60021f7-f037-4dfb-9c49-91248a8c4ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:28.734878 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60021f7-f037-4dfb-9c49-91248a8c4ee9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:28.735827 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60021f7-f037-4dfb-9c49-91248a8c4ee9 None admin] RBAC: Adding query filter params (role.id=0dd53da12ae74208933c961c29f12ec0, scope.project.id=d47d5b72a00642a1a239b785110643ef, user.id=179709fe7d8343689f096ac0d9a333b0) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:28.736339 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60021f7-f037-4dfb-9c49-91248a8c4ee9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:28.738009 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60021f7-f037-4dfb-9c49-91248a8c4ee9 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:28.744395 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 446/912] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 10 09:51:28 2022] GET /identity/v3/role_assignments?user.id=179709fe7d8343689f096ac0d9a333b0&scope.project.id=d47d5b72a00642a1a239b785110643ef&role.id=0dd53da12ae74208933c961c29f12ec0 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:28.774907 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705a9fa8-dcc1-494f-b8fd-d140d2c2f6be None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:28.775267 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705a9fa8-dcc1-494f-b8fd-d140d2c2f6be None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:28.775454 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705a9fa8-dcc1-494f-b8fd-d140d2c2f6be None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:28.777162 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 467/913] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:51:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:51:28.782914 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae32bc0c-e88a-4659-8ea4-0d37fecb16d5 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:28.783350 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae32bc0c-e88a-4659-8ea4-0d37fecb16d5 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:28.783713 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae32bc0c-e88a-4659-8ea4-0d37fecb16d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:28.803842 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-ae32bc0c-e88a-4659-8ea4-0d37fecb16d5 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:51:28.805106 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-ae32bc0c-e88a-4659-8ea4-0d37fecb16d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:51:28.881475 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 447/914] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:51:28 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 09:51:28.903817 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705a9fa8-dcc1-494f-b8fd-d140d2c2f6be None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:29.008555 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705a9fa8-dcc1-494f-b8fd-d140d2c2f6be None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:29.025329 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:29.043293 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f906bc98-7ecf-41b7-9f8c-8b3bffcd28a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:29.044581 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f906bc98-7ecf-41b7-9f8c-8b3bffcd28a7 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:29.044862 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f906bc98-7ecf-41b7-9f8c-8b3bffcd28a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:29.045163 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f906bc98-7ecf-41b7-9f8c-8b3bffcd28a7 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:29.045755 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f906bc98-7ecf-41b7-9f8c-8b3bffcd28a7 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:29.047131 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f906bc98-7ecf-41b7-9f8c-8b3bffcd28a7 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:29.056384 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-f906bc98-7ecf-41b7-9f8c-8b3bffcd28a7 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 10 09:51:29.056384 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:29.056384 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 09:51:29.056384 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 09:51:29.056384 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 09:51:29.056384 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 09:51:29.056384 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 09:51:29.056384 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 09:51:29.056384 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 10 09:51:29.056384 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:51:29.056384 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 09:51:29.056384 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:51:29.056384 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:29.056384 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:29.056384 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:29.056384 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:29.056384 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:29.057450 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:29.057450 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:29.057450 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:29.057450 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:29.057450 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:29.057450 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:29.057450 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 09:51:29.057450 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 09:51:29.057450 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 09:51:29.057450 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 09:51:29.057450 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:29.057450 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:29.057450 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:29.057450 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:29.057450 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:29.057450 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:29.058282 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:29.058282 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:29.058282 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:29.058282 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:29.058282 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:29.058282 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:29.058282 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:29.058282 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:29.058282 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:29.058282 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:29.058282 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 09:51:29.058282 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 09:51:29.058282 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 10 09:51:29.058282 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:51:29.058282 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 468/915] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Aug 10 09:51:28 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:51:29.065790 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae32bc0c-e88a-4659-8ea4-0d37fecb16d5 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:29.144173 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:29.171559 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae32bc0c-e88a-4659-8ea4-0d37fecb16d5 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:29.206941 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cb4b6b-437c-47c4-9221-51f0f9618b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:29.207935 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cb4b6b-437c-47c4-9221-51f0f9618b97 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:29.208412 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cb4b6b-437c-47c4-9221-51f0f9618b97 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:29.208875 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cb4b6b-437c-47c4-9221-51f0f9618b97 None admin] PATH_INFO: `/v3/services` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:29.209828 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cb4b6b-437c-47c4-9221-51f0f9618b97 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:29.210400 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cb4b6b-437c-47c4-9221-51f0f9618b97 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:29.211966 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cb4b6b-437c-47c4-9221-51f0f9618b97 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:29.216963 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 448/916] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Aug 10 09:51:29 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:29.226276 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f906bc98-7ecf-41b7-9f8c-8b3bffcd28a7 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:29.329490 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f906bc98-7ecf-41b7-9f8c-8b3bffcd28a7 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:29.364548 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bef013-f4c6-451b-9d6f-0ea0a1336fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:29.365192 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bef013-f4c6-451b-9d6f-0ea0a1336fdc None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:29.365563 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bef013-f4c6-451b-9d6f-0ea0a1336fdc None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:29.365778 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bef013-f4c6-451b-9d6f-0ea0a1336fdc None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:29.366520 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bef013-f4c6-451b-9d6f-0ea0a1336fdc None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:29.366826 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bef013-f4c6-451b-9d6f-0ea0a1336fdc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:29.368264 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bef013-f4c6-451b-9d6f-0ea0a1336fdc None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:29.373476 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 469/917] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Aug 10 09:51:29 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:29.379262 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cb4b6b-437c-47c4-9221-51f0f9618b97 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:29.409573 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4419934-3827-4249-95c2-c635a25b0adc None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:29.409923 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4419934-3827-4249-95c2-c635a25b0adc None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:29.410114 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4419934-3827-4249-95c2-c635a25b0adc None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:29.411699 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 470/918] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:51:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 09:51:29.416601 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b960b4-70c5-4631-8f6f-49aadc9eadfe None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:29.416876 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b960b4-70c5-4631-8f6f-49aadc9eadfe None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:29.417179 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b960b4-70c5-4631-8f6f-49aadc9eadfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:29.435672 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-64b960b4-70c5-4631-8f6f-49aadc9eadfe None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:51:29.436850 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-64b960b4-70c5-4631-8f6f-49aadc9eadfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:51:29.492733 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:29.494719 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cb4b6b-437c-47c4-9221-51f0f9618b97 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:29.533679 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb74d34-e104-427d-9064-1d962363a5ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:29.534345 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb74d34-e104-427d-9064-1d962363a5ec None admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:29.534621 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb74d34-e104-427d-9064-1d962363a5ec None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:29.534923 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb74d34-e104-427d-9064-1d962363a5ec None admin] PATH_INFO: `/v3/endpoints` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:29.535611 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb74d34-e104-427d-9064-1d962363a5ec None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:29.536998 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb74d34-e104-427d-9064-1d962363a5ec None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:29.541371 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 471/919] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:51:29 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 09:51:29.546545 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:29.562095 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b960b4-70c5-4631-8f6f-49aadc9eadfe None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:29.573665 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 449/920] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 10 09:51:29 2022] POST /identity/v3/endpoints => generated 346 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 09:51:29.677058 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b960b4-70c5-4631-8f6f-49aadc9eadfe None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:29.719655 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51cbf44-7669-431b-b0d2-62c6123af0f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:29.720302 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51cbf44-7669-431b-b0d2-62c6123af0f5 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:29.720578 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51cbf44-7669-431b-b0d2-62c6123af0f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:29.720847 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51cbf44-7669-431b-b0d2-62c6123af0f5 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:29.721462 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51cbf44-7669-431b-b0d2-62c6123af0f5 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:29.722839 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51cbf44-7669-431b-b0d2-62c6123af0f5 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:29.732382 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-d51cbf44-7669-431b-b0d2-62c6123af0f5 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 09:51:29.732382 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:29.732382 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 09:51:29.732382 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 09:51:29.732382 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 09:51:29.732382 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 09:51:29.732382 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 09:51:29.732382 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 09:51:29.732382 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 09:51:29.732382 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:51:29.732382 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 09:51:29.732382 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:51:29.732382 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:29.732382 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:29.732382 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:29.732382 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:29.732382 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:29.733631 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:29.733631 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:29.733631 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:29.733631 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:29.733631 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:29.733631 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:29.733631 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 09:51:29.733631 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 09:51:29.733631 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 09:51:29.733631 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 09:51:29.733631 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:29.733631 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:29.733631 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:29.733631 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:29.733631 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:29.733631 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:29.734650 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:29.734650 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:29.734650 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:29.734650 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:29.734650 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:29.734650 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:29.734650 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:29.734650 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:29.734650 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:29.734650 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:29.734650 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 09:51:29.734650 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 09:51:29.734650 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 09:51:29.734650 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:51:29.734650 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 472/921] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Aug 10 09:51:29 2022] GET /identity/v3/services/object-store => generated 93 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 09:51:29.741884 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb74d34-e104-427d-9064-1d962363a5ec None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:29.850422 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb74d34-e104-427d-9064-1d962363a5ec None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:29.885462 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8cca90-2a84-4322-88b7-614e240dde3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:29.886089 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8cca90-2a84-4322-88b7-614e240dde3f None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:29.886370 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8cca90-2a84-4322-88b7-614e240dde3f None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:29.886637 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8cca90-2a84-4322-88b7-614e240dde3f None admin] PATH_INFO: `/v3/services` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:29.887349 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8cca90-2a84-4322-88b7-614e240dde3f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:29.887649 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8cca90-2a84-4322-88b7-614e240dde3f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:29.889035 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8cca90-2a84-4322-88b7-614e240dde3f None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:29.894590 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 450/922] 10.222.0.27 () {56 vars in 1122 bytes} [Wed Aug 10 09:51:29 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 09:51:29.900493 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51cbf44-7669-431b-b0d2-62c6123af0f5 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:29.937993 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:30.007550 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51cbf44-7669-431b-b0d2-62c6123af0f5 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:30.042261 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ebdd4c-103a-4b90-ada7-43e375eb237f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:30.043256 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ebdd4c-103a-4b90-ada7-43e375eb237f None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:30.043732 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ebdd4c-103a-4b90-ada7-43e375eb237f None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:30.044212 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ebdd4c-103a-4b90-ada7-43e375eb237f None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:30.045035 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ebdd4c-103a-4b90-ada7-43e375eb237f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:30.045577 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ebdd4c-103a-4b90-ada7-43e375eb237f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:30.047159 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ebdd4c-103a-4b90-ada7-43e375eb237f None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:30.052652 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 473/923] 10.222.0.27 () {56 vars in 1122 bytes} [Wed Aug 10 09:51:29 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 09:51:30.058937 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8cca90-2a84-4322-88b7-614e240dde3f None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:30.129468 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:30.162879 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8cca90-2a84-4322-88b7-614e240dde3f None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:30.198781 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed86038-87c7-4129-9aca-59137403610c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:30.199497 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed86038-87c7-4129-9aca-59137403610c None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:30.199775 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed86038-87c7-4129-9aca-59137403610c None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:30.200044 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed86038-87c7-4129-9aca-59137403610c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:30.200758 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed86038-87c7-4129-9aca-59137403610c None admin] RBAC: Adding query filter params (interface=public, service_id=189b1c19563246cabbf9c4647c87ef58, region_id=RegionOne) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:30.201083 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed86038-87c7-4129-9aca-59137403610c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:30.202473 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed86038-87c7-4129-9aca-59137403610c None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:30.208391 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 451/924] 10.222.0.27 () {56 vars in 1251 bytes} [Wed Aug 10 09:51:30 2022] GET /identity/v3/endpoints?service_id=189b1c19563246cabbf9c4647c87ef58&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:30.213965 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ebdd4c-103a-4b90-ada7-43e375eb237f None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:30.313817 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:30.317771 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ebdd4c-103a-4b90-ada7-43e375eb237f None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:30.352696 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f33222d-9532-4196-9933-6392ed0b8926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:30.353379 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f33222d-9532-4196-9933-6392ed0b8926 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:30.353656 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f33222d-9532-4196-9933-6392ed0b8926 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:30.353930 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f33222d-9532-4196-9933-6392ed0b8926 None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:30.354545 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f33222d-9532-4196-9933-6392ed0b8926 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:30.355986 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f33222d-9532-4196-9933-6392ed0b8926 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:30.362690 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 474/925] 10.222.0.27 () {56 vars in 1087 bytes} [Wed Aug 10 09:51:30 2022] GET /identity/v3/services => generated 1497 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 09:51:30.418553 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbd64ed-dfc9-4e0c-998d-b28012897757 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:30.418897 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbd64ed-dfc9-4e0c-998d-b28012897757 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:30.419119 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbd64ed-dfc9-4e0c-998d-b28012897757 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:30.420933 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 452/926] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:51:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:51:30.426823 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7664a3b-c76b-494e-97d2-f1aeb39bd368 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:30.427127 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7664a3b-c76b-494e-97d2-f1aeb39bd368 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:30.427387 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7664a3b-c76b-494e-97d2-f1aeb39bd368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:30.447063 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-e7664a3b-c76b-494e-97d2-f1aeb39bd368 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:51:30.448301 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-e7664a3b-c76b-494e-97d2-f1aeb39bd368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:51:30.529199 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 475/927] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:51:30 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 09:51:30.545807 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbd64ed-dfc9-4e0c-998d-b28012897757 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:30.652837 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbd64ed-dfc9-4e0c-998d-b28012897757 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:30.676575 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:30.689479 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e1855f-1a93-4a26-9aa4-70638fa0d475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:30.690171 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e1855f-1a93-4a26-9aa4-70638fa0d475 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:30.690449 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e1855f-1a93-4a26-9aa4-70638fa0d475 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:30.690777 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e1855f-1a93-4a26-9aa4-70638fa0d475 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:30.691375 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e1855f-1a93-4a26-9aa4-70638fa0d475 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:30.692756 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e1855f-1a93-4a26-9aa4-70638fa0d475 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:30.702745 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-c3e1855f-1a93-4a26-9aa4-70638fa0d475 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 10 09:51:30.702745 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:30.702745 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 09:51:30.702745 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 09:51:30.702745 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 09:51:30.702745 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 09:51:30.702745 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 09:51:30.702745 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 09:51:30.702745 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 10 09:51:30.702745 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:51:30.702745 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 09:51:30.702745 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:51:30.702745 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:30.702745 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:30.702745 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:30.702745 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:30.704853 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:30.704853 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:30.704853 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:30.704853 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:30.704853 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:30.704853 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:30.704853 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:30.704853 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 09:51:30.704853 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 09:51:30.704853 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 09:51:30.704853 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 09:51:30.704853 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:30.704853 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:30.704853 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:30.704853 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:30.704853 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:30.704853 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:30.706956 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:30.706956 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:30.706956 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:30.706956 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:30.706956 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:30.706956 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:30.706956 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:30.706956 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:30.706956 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:30.706956 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:30.706956 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 09:51:30.706956 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 09:51:30.706956 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 10 09:51:30.706956 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:51:30.706956 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 453/928] 10.222.0.27 () {56 vars in 1132 bytes} [Wed Aug 10 09:51:30 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:51:30.712214 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7664a3b-c76b-494e-97d2-f1aeb39bd368 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:30.803057 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:30.813125 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7664a3b-c76b-494e-97d2-f1aeb39bd368 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:30.848067 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ff0578-a421-4f8c-8e92-06230ce69b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:30.849029 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ff0578-a421-4f8c-8e92-06230ce69b2f None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:30.849535 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ff0578-a421-4f8c-8e92-06230ce69b2f None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:30.850084 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ff0578-a421-4f8c-8e92-06230ce69b2f None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:30.850906 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ff0578-a421-4f8c-8e92-06230ce69b2f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:30.851409 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ff0578-a421-4f8c-8e92-06230ce69b2f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:30.852684 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096d26f6-d6f9-46a3-8845-5e7baeea10cd None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:30.852976 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096d26f6-d6f9-46a3-8845-5e7baeea10cd None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:30.853366 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096d26f6-d6f9-46a3-8845-5e7baeea10cd None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:30.853623 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ff0578-a421-4f8c-8e92-06230ce69b2f None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:30.855038 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 454/929] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:51:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:51:30.859794 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0710502-0254-480c-bed4-f831fee829bd None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:30.860078 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0710502-0254-480c-bed4-f831fee829bd None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:30.860351 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0710502-0254-480c-bed4-f831fee829bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:30.863272 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 476/930] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Aug 10 09:51:30 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:30.869188 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ff0578-a421-4f8c-8e92-06230ce69b2f None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:30.882693 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-a0710502-0254-480c-bed4-f831fee829bd None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:51:30.884062 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-a0710502-0254-480c-bed4-f831fee829bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:51:30.954501 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 455/931] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:51:30 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 09:51:30.975447 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ff0578-a421-4f8c-8e92-06230ce69b2f None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:30.976562 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0710502-0254-480c-bed4-f831fee829bd None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:31.018093 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc0342d-1f96-499a-aa71-214b6740e66f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:31.018714 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc0342d-1f96-499a-aa71-214b6740e66f None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:31.019302 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc0342d-1f96-499a-aa71-214b6740e66f None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:31.019583 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc0342d-1f96-499a-aa71-214b6740e66f None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:31.020507 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc0342d-1f96-499a-aa71-214b6740e66f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:31.020817 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc0342d-1f96-499a-aa71-214b6740e66f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:31.022426 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc0342d-1f96-499a-aa71-214b6740e66f None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:31.033155 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 477/932] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Aug 10 09:51:30 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 09:51:31.034953 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc0342d-1f96-499a-aa71-214b6740e66f None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:31.061691 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:31.082910 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0710502-0254-480c-bed4-f831fee829bd None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:31.101448 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:31.127014 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbd784b-6e2a-4e7f-9a71-6185b7a9ced6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:31.128069 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbd784b-6e2a-4e7f-9a71-6185b7a9ced6 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:31.128562 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbd784b-6e2a-4e7f-9a71-6185b7a9ced6 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:31.129038 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbd784b-6e2a-4e7f-9a71-6185b7a9ced6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:31.140957 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbd784b-6e2a-4e7f-9a71-6185b7a9ced6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 09:51:31.146952 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-6dbd784b-6e2a-4e7f-9a71-6185b7a9ced6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 10 09:51:31.146952 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:31.146952 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:31.146952 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:31.146952 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:31.146952 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:31.146952 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:31.146952 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:31.146952 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:31.146952 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:31.146952 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:31.146952 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:31.146952 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 09:51:31.146952 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 09:51:31.146952 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 09:51:31.146952 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 09:51:31.147908 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 09:51:31.147908 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 09:51:31.147908 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 09:51:31.147908 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 09:51:31.147908 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:31.147908 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:31.147908 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:31.147908 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:31.147908 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:31.147908 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:31.147908 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:31.147908 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:31.147908 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:31.147908 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:31.147908 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:31.147908 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:31.148745 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:31.148745 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:31.148745 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:31.148745 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:31.148745 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 09:51:31.148745 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 09:51:31.148745 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 09:51:31.148745 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 09:51:31.148745 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 09:51:31.148745 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 09:51:31.148745 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 10 09:51:31.148745 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:51:31.156332 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 456/933] 10.222.0.27 () {56 vars in 1120 bytes} [Wed Aug 10 09:51:30 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 09:51:31.158004 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbd784b-6e2a-4e7f-9a71-6185b7a9ced6 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:31.160176 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc0342d-1f96-499a-aa71-214b6740e66f None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:31.204814 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4234b4d9-ccd3-46a2-8980-f21e33007dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:31.205477 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4234b4d9-ccd3-46a2-8980-f21e33007dae None admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:31.205755 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4234b4d9-ccd3-46a2-8980-f21e33007dae None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:31.206028 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4234b4d9-ccd3-46a2-8980-f21e33007dae None admin] PATH_INFO: `/v3/endpoints` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:31.206700 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4234b4d9-ccd3-46a2-8980-f21e33007dae None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:31.208976 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4234b4d9-ccd3-46a2-8980-f21e33007dae None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:31.241173 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 478/934] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 10 09:51:31 2022] POST /identity/v3/endpoints => generated 347 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 09:51:31.287738 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbd784b-6e2a-4e7f-9a71-6185b7a9ced6 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:31.333163 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1f62df-5c50-4781-88be-98f519313983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:31.334240 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f62df-5c50-4781-88be-98f519313983 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:31.334721 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f62df-5c50-4781-88be-98f519313983 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:31.335278 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f62df-5c50-4781-88be-98f519313983 None admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:31.336240 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1f62df-5c50-4781-88be-98f519313983 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:31.336793 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1f62df-5c50-4781-88be-98f519313983 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:31.338554 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1f62df-5c50-4781-88be-98f519313983 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:31.352957 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 457/935] 10.222.0.27 () {56 vars in 1115 bytes} [Wed Aug 10 09:51:31 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:31.358950 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4234b4d9-ccd3-46a2-8980-f21e33007dae None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:31.447349 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:31.475040 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4234b4d9-ccd3-46a2-8980-f21e33007dae None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:31.511381 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a394a9c5-e12e-4261-9cd1-b984d6eff028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:31.512403 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a394a9c5-e12e-4261-9cd1-b984d6eff028 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:31.512909 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a394a9c5-e12e-4261-9cd1-b984d6eff028 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:31.513422 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a394a9c5-e12e-4261-9cd1-b984d6eff028 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:31.525058 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a394a9c5-e12e-4261-9cd1-b984d6eff028 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:31.526990 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a394a9c5-e12e-4261-9cd1-b984d6eff028 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:31.541945 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-a394a9c5-e12e-4261-9cd1-b984d6eff028 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:51:31.541945 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:31.541945 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:31.541945 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:31.541945 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:31.541945 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:31.541945 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:31.541945 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:31.541945 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:31.541945 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:31.541945 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:31.541945 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:31.541945 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 09:51:31.541945 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 09:51:31.541945 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 09:51:31.541945 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 09:51:31.542963 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:31.542963 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:31.542963 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:31.542963 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:31.542963 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:31.542963 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:31.542963 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:31.542963 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:31.542963 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:31.542963 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:31.542963 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:31.542963 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:31.542963 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:31.542963 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:31.542963 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:31.542963 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:31.542963 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 09:51:31.543916 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 09:51:31.543916 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:51:31.543916 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:51:31.546073 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 479/936] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 10 09:51:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:51:31.552076 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1f62df-5c50-4781-88be-98f519313983 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:31.591138 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:31.665812 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1f62df-5c50-4781-88be-98f519313983 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:31.701586 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cda132-94f5-4acd-84d8-3bc04922f88d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:31.702211 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cda132-94f5-4acd-84d8-3bc04922f88d None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:31.702491 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cda132-94f5-4acd-84d8-3bc04922f88d None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:31.702764 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cda132-94f5-4acd-84d8-3bc04922f88d None admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:31.703325 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02ca32b-b9f2-417a-b85f-82457ba36c8a None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:31.703436 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cda132-94f5-4acd-84d8-3bc04922f88d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:31.703607 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02ca32b-b9f2-417a-b85f-82457ba36c8a None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:31.703702 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cda132-94f5-4acd-84d8-3bc04922f88d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:31.703878 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02ca32b-b9f2-417a-b85f-82457ba36c8a None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:31.705170 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cda132-94f5-4acd-84d8-3bc04922f88d None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:31.705656 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 480/937] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:51:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:51:31.710823 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce02b524-60ac-44a5-a7e1-1cebd4d8e166 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:31.711101 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce02b524-60ac-44a5-a7e1-1cebd4d8e166 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:31.711375 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce02b524-60ac-44a5-a7e1-1cebd4d8e166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:31.721551 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 458/938] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 10 09:51:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:31.729253 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cda132-94f5-4acd-84d8-3bc04922f88d None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:31.731109 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-ce02b524-60ac-44a5-a7e1-1cebd4d8e166 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:51:31.732285 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-ce02b524-60ac-44a5-a7e1-1cebd4d8e166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:51:31.808611 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 481/939] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:51:31 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 09:51:31.831933 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce02b524-60ac-44a5-a7e1-1cebd4d8e166 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:31.841491 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:31.844925 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cda132-94f5-4acd-84d8-3bc04922f88d None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:31.881667 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cf8d91-9bd6-4520-8f2b-6517f91fc142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:31.882552 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cf8d91-9bd6-4520-8f2b-6517f91fc142 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:31.882980 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cf8d91-9bd6-4520-8f2b-6517f91fc142 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:31.883425 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cf8d91-9bd6-4520-8f2b-6517f91fc142 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:31.891233 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cf8d91-9bd6-4520-8f2b-6517f91fc142 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:31.892303 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:31.893084 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cf8d91-9bd6-4520-8f2b-6517f91fc142 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:31.905600 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-23cf8d91-9bd6-4520-8f2b-6517f91fc142 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 10 09:51:31.905600 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:31.905600 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:31.905600 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:31.905600 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:31.905600 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:31.905600 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:31.905600 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:31.905600 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:31.905600 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:31.905600 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:31.905600 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:31.905600 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 09:51:31.905600 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 09:51:31.905600 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 09:51:31.905600 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 09:51:31.906778 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:31.906778 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:31.906778 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 09:51:31.906778 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 09:51:31.906778 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 09:51:31.906778 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 09:51:31.906778 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:31.906778 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:31.906778 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:31.906778 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:31.906778 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:31.906778 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:31.906778 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:31.906778 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:31.906778 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:31.906778 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:31.906778 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:31.906778 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:31.907868 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:31.907868 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:31.907868 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 09:51:31.907868 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 09:51:31.907868 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 09:51:31.907868 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 09:51:31.907868 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 09:51:31.907868 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 09:51:31.907868 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 10 09:51:31.907868 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:51:31.914836 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 459/940] 10.222.0.27 () {56 vars in 1117 bytes} [Wed Aug 10 09:51:31 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 09:51:31.915926 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cf8d91-9bd6-4520-8f2b-6517f91fc142 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:31.937226 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce02b524-60ac-44a5-a7e1-1cebd4d8e166 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:31.973055 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214b1c5d-dc4c-49b4-a186-4ffe039d6893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:31.973706 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214b1c5d-dc4c-49b4-a186-4ffe039d6893 None admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:31.973988 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214b1c5d-dc4c-49b4-a186-4ffe039d6893 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:31.974261 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214b1c5d-dc4c-49b4-a186-4ffe039d6893 None admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:31.974990 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214b1c5d-dc4c-49b4-a186-4ffe039d6893 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:31.976396 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214b1c5d-dc4c-49b4-a186-4ffe039d6893 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:31.979102 dv-cinder-850836-5-smb devstack@keystone.service[80231]: WARNING keystone.server.flask.common [None req-214b1c5d-dc4c-49b4-a186-4ffe039d6893 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 10 09:51:31.999971 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.sql.core [None req-214b1c5d-dc4c-49b4-a186-4ffe039d6893 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 10 09:51:31.999971 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 10 09:51:31.999971 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [parameters: {'id': '8e918baff86d42f49869ccf51682ba3a', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 10 09:51:31.999971 dv-cinder-850836-5-smb devstack@keystone.service[80231]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80231) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 10 09:51:32.008154 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-214b1c5d-dc4c-49b4-a186-4ffe039d6893 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8e918baff86d42f49869ccf51682ba3a.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8e918baff86d42f49869ccf51682ba3a. Aug 10 09:51:32.008154 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:32.008154 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 10 09:51:32.008154 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 10 09:51:32.008154 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 10 09:51:32.008154 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 10 09:51:32.008154 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 10 09:51:32.008154 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application result = self._query(query) Aug 10 09:51:32.008154 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 10 09:51:32.008154 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application conn.query(q) Aug 10 09:51:32.008154 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 10 09:51:32.008154 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 10 09:51:32.008154 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 10 09:51:32.008971 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application result.read() Aug 10 09:51:32.008971 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 10 09:51:32.008971 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 10 09:51:32.008971 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 10 09:51:32.008971 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 10 09:51:32.008971 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 10 09:51:32.008971 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 10 09:51:32.008971 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 10 09:51:32.008971 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 10 09:51:32.008971 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 10 09:51:32.008971 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:51:32.008971 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 10 09:51:32.008971 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:51:32.008971 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:32.008971 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 10 09:51:32.008971 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 10 09:51:32.008971 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 10 09:51:32.008971 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 10 09:51:32.010147 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 10 09:51:32.010147 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application next(self.gen) Aug 10 09:51:32.010147 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 10 09:51:32.010147 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application yield resource Aug 10 09:51:32.010147 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 10 09:51:32.010147 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application next(self.gen) Aug 10 09:51:32.010147 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 10 09:51:32.010147 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self.session.rollback() Aug 10 09:51:32.010147 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 09:51:32.010147 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self.force_reraise() Aug 10 09:51:32.010147 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 09:51:32.010147 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise self.value Aug 10 09:51:32.010147 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 10 09:51:32.010147 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 10 09:51:32.010147 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 10 09:51:32.010147 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application session.commit() Aug 10 09:51:32.010147 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 10 09:51:32.011322 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 10 09:51:32.011322 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 10 09:51:32.011322 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._prepare_impl() Aug 10 09:51:32.011322 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 10 09:51:32.011322 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self.session.flush() Aug 10 09:51:32.011322 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 10 09:51:32.011322 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._flush(objects) Aug 10 09:51:32.011322 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 10 09:51:32.011322 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 10 09:51:32.011322 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 10 09:51:32.011322 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application compat.raise_( Aug 10 09:51:32.011322 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 10 09:51:32.011322 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception Aug 10 09:51:32.011322 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 10 09:51:32.011322 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application flush_context.execute() Aug 10 09:51:32.011322 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 10 09:51:32.011322 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rec.execute(self) Aug 10 09:51:32.012412 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 10 09:51:32.012412 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 10 09:51:32.012412 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 10 09:51:32.012412 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 10 09:51:32.012412 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 10 09:51:32.012412 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 10 09:51:32.012412 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 10 09:51:32.012412 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 10 09:51:32.012412 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 10 09:51:32.012412 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 10 09:51:32.012412 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 10 09:51:32.012412 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 10 09:51:32.012412 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 10 09:51:32.012412 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 10 09:51:32.012412 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 10 09:51:32.013417 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 10 09:51:32.013417 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 10 09:51:32.013417 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception Aug 10 09:51:32.013417 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 10 09:51:32.013417 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 10 09:51:32.013417 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 10 09:51:32.013417 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 10 09:51:32.013417 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 10 09:51:32.013417 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application result = self._query(query) Aug 10 09:51:32.013417 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 10 09:51:32.013417 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application conn.query(q) Aug 10 09:51:32.013417 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 10 09:51:32.013417 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 10 09:51:32.013417 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 10 09:51:32.013417 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application result.read() Aug 10 09:51:32.013417 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 10 09:51:32.013417 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 10 09:51:32.014402 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 10 09:51:32.014402 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 10 09:51:32.014402 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 10 09:51:32.014402 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 10 09:51:32.014402 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 10 09:51:32.014402 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 10 09:51:32.014402 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 10 09:51:32.014402 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 10 09:51:32.014402 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [parameters: {'id': '8e918baff86d42f49869ccf51682ba3a', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 10 09:51:32.014402 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 10 09:51:32.014402 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:51:32.014402 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 09:51:32.014402 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:51:32.014402 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:32.014402 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 10 09:51:32.015443 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 10 09:51:32.015443 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 10 09:51:32.015443 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 10 09:51:32.015443 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 10 09:51:32.015443 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:51:32.015443 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 09:51:32.015443 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:51:32.015443 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:32.015443 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:32.015443 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:32.015443 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:32.015443 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:32.015443 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:32.015443 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:32.015443 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:32.015443 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:32.015443 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:32.016609 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:32.016609 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 10 09:51:32.016609 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 10 09:51:32.016609 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:32.016609 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:32.016609 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 10 09:51:32.016609 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 10 09:51:32.016609 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8e918baff86d42f49869ccf51682ba3a. Aug 10 09:51:32.016609 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:51:32.016609 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 482/941] 10.222.0.27 () {60 vars in 1140 bytes} [Wed Aug 10 09:51:31 2022] POST /identity/v3/projects => generated 262 bytes in 178 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 10 09:51:32.018257 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214b1c5d-dc4c-49b4-a186-4ffe039d6893 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:32.039544 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cf8d91-9bd6-4520-8f2b-6517f91fc142 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:32.086918 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6150042d-508b-4b7b-a89f-1bc321aeea58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:32.087962 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6150042d-508b-4b7b-a89f-1bc321aeea58 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:32.088876 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6150042d-508b-4b7b-a89f-1bc321aeea58 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:32.089356 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6150042d-508b-4b7b-a89f-1bc321aeea58 None admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:32.090594 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6150042d-508b-4b7b-a89f-1bc321aeea58 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:32.091109 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6150042d-508b-4b7b-a89f-1bc321aeea58 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:32.093839 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6150042d-508b-4b7b-a89f-1bc321aeea58 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:32.121333 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 460/942] 10.222.0.27 () {56 vars in 1149 bytes} [Wed Aug 10 09:51:31 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:32.126994 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6150042d-508b-4b7b-a89f-1bc321aeea58 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:32.130903 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214b1c5d-dc4c-49b4-a186-4ffe039d6893 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:32.145705 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:32.153339 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:32.181706 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bba0250-95d1-4958-9dae-e2fe3f55c24e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:32.182481 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bba0250-95d1-4958-9dae-e2fe3f55c24e None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:32.182862 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bba0250-95d1-4958-9dae-e2fe3f55c24e None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:32.183233 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bba0250-95d1-4958-9dae-e2fe3f55c24e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:32.191999 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bba0250-95d1-4958-9dae-e2fe3f55c24e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:32.195028 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bba0250-95d1-4958-9dae-e2fe3f55c24e None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:32.210556 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-6bba0250-95d1-4958-9dae-e2fe3f55c24e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 09:51:32.210556 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:32.210556 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:32.210556 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:32.210556 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:32.210556 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:32.210556 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:32.210556 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:32.210556 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:32.210556 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:32.210556 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:32.210556 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:32.210556 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 09:51:32.210556 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 09:51:32.210556 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 09:51:32.211668 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 09:51:32.211668 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:32.211668 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:32.211668 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:32.211668 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:32.211668 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:32.211668 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:32.211668 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:32.211668 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:32.211668 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:32.211668 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:32.211668 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:32.211668 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:32.211668 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:32.211668 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:32.211668 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:32.211668 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:32.212808 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 09:51:32.212808 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 09:51:32.212808 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 09:51:32.212808 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 09:51:32.212808 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 09:51:32.212808 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 09:51:32.212808 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 09:51:32.212808 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:51:32.219375 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 483/943] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 10 09:51:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:51:32.221108 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bba0250-95d1-4958-9dae-e2fe3f55c24e None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:32.266303 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6150042d-508b-4b7b-a89f-1bc321aeea58 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:32.310844 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9480921c-d724-4a13-b147-47d16755fbdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:32.312330 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9480921c-d724-4a13-b147-47d16755fbdf None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:32.312786 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9480921c-d724-4a13-b147-47d16755fbdf None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:32.313485 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9480921c-d724-4a13-b147-47d16755fbdf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:32.326914 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9480921c-d724-4a13-b147-47d16755fbdf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:32.329297 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9480921c-d724-4a13-b147-47d16755fbdf None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:32.349881 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-9480921c-d724-4a13-b147-47d16755fbdf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:51:32.349881 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:32.349881 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:32.349881 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:32.349881 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:32.349881 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:32.349881 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:32.349881 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:32.349881 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:32.349881 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:32.349881 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:32.349881 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:32.349881 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 09:51:32.349881 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 09:51:32.349881 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 09:51:32.349881 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 09:51:32.351015 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:32.351015 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:32.351015 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:32.351015 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:32.351015 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:32.351015 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:32.351015 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:32.351015 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:32.351015 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:32.351015 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:32.351015 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:32.351015 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:32.351015 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:32.351015 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:32.351015 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:32.351015 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:32.351015 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 09:51:32.352091 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 09:51:32.352091 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:51:32.352091 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:51:32.358341 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bba0250-95d1-4958-9dae-e2fe3f55c24e None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:32.358479 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 461/944] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 10 09:51:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:51:32.360058 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9480921c-d724-4a13-b147-47d16755fbdf None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:32.399942 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ab110f-862e-4b36-81e0-f6ac24acde07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:32.400848 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ab110f-862e-4b36-81e0-f6ac24acde07 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:32.401306 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ab110f-862e-4b36-81e0-f6ac24acde07 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:32.401722 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ab110f-862e-4b36-81e0-f6ac24acde07 None admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:32.402539 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ab110f-862e-4b36-81e0-f6ac24acde07 None admin] RBAC: Adding query filter params (name=service) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:32.402987 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ab110f-862e-4b36-81e0-f6ac24acde07 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:32.404594 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ab110f-862e-4b36-81e0-f6ac24acde07 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:32.429185 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 484/945] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Aug 10 09:51:32 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:32.433355 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:32.454274 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692a7fa3-3746-4efc-83f3-0e0dbb984721 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:32.454634 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692a7fa3-3746-4efc-83f3-0e0dbb984721 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:32.454835 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692a7fa3-3746-4efc-83f3-0e0dbb984721 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:32.456421 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 485/946] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:51:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 09:51:32.462659 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14be6c7-1cba-4925-9441-5e84e229095f None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:32.462942 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14be6c7-1cba-4925-9441-5e84e229095f None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:32.463222 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14be6c7-1cba-4925-9441-5e84e229095f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:32.482981 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-f14be6c7-1cba-4925-9441-5e84e229095f None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:51:32.484571 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-f14be6c7-1cba-4925-9441-5e84e229095f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:51:32.489506 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9480921c-d724-4a13-b147-47d16755fbdf None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:32.524212 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:32.528465 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea161f0-a640-44b8-8134-5656eaf33d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:32.529375 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea161f0-a640-44b8-8134-5656eaf33d03 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:32.529824 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea161f0-a640-44b8-8134-5656eaf33d03 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:32.530233 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea161f0-a640-44b8-8134-5656eaf33d03 None admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:32.531049 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea161f0-a640-44b8-8134-5656eaf33d03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:32.531561 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea161f0-a640-44b8-8134-5656eaf33d03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:32.533143 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea161f0-a640-44b8-8134-5656eaf33d03 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:32.547013 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 462/947] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 10 09:51:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:32.553942 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea161f0-a640-44b8-8134-5656eaf33d03 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:32.577485 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 486/948] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:51:32 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 09:51:32.593137 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14be6c7-1cba-4925-9441-5e84e229095f None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:32.670895 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea161f0-a640-44b8-8134-5656eaf33d03 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:32.700624 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:32.715714 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb14dda-9173-47da-9d55-3493bb78c943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:32.716352 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb14dda-9173-47da-9d55-3493bb78c943 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:32.716635 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb14dda-9173-47da-9d55-3493bb78c943 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:32.716909 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb14dda-9173-47da-9d55-3493bb78c943 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:32.723906 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb14dda-9173-47da-9d55-3493bb78c943 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:32.727014 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14be6c7-1cba-4925-9441-5e84e229095f None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:32.727139 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb14dda-9173-47da-9d55-3493bb78c943 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:32.744366 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-adb14dda-9173-47da-9d55-3493bb78c943 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 09:51:32.744366 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:32.744366 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:32.744366 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:32.744366 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:32.744366 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:32.744366 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:32.744366 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:32.744366 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:32.744366 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:32.744366 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:32.744366 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:32.744366 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 09:51:32.744366 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 09:51:32.744366 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 09:51:32.745549 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 09:51:32.745549 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:32.745549 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:32.745549 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:32.745549 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:32.745549 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:32.745549 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:32.745549 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:32.745549 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:32.745549 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:32.745549 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:32.745549 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:32.745549 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:32.745549 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:32.745549 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:32.745549 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:32.745549 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:32.746633 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 09:51:32.746633 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 09:51:32.746633 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 09:51:32.746633 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 09:51:32.746633 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 09:51:32.746633 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 09:51:32.746633 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 09:51:32.746633 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:51:32.753295 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 463/949] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 10 09:51:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 09:51:32.756562 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb14dda-9173-47da-9d55-3493bb78c943 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:32.772801 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2173ab77-b2a4-4bb4-ab90-fa5dba135d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:32.773740 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2173ab77-b2a4-4bb4-ab90-fa5dba135d6b None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:32.774121 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2173ab77-b2a4-4bb4-ab90-fa5dba135d6b None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:32.774510 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2173ab77-b2a4-4bb4-ab90-fa5dba135d6b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:32.775178 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2173ab77-b2a4-4bb4-ab90-fa5dba135d6b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:32.776650 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2173ab77-b2a4-4bb4-ab90-fa5dba135d6b None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:32.786203 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-2173ab77-b2a4-4bb4-ab90-fa5dba135d6b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 09:51:32.786203 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:32.786203 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 09:51:32.786203 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 09:51:32.786203 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 09:51:32.786203 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 09:51:32.786203 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 09:51:32.786203 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 09:51:32.786203 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 09:51:32.786203 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:51:32.786203 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 09:51:32.786203 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:51:32.786203 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:32.786203 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:32.786203 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:32.786203 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:32.786203 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:32.787498 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:32.787498 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:32.787498 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:32.787498 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:32.787498 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:32.787498 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:32.787498 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 09:51:32.787498 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 09:51:32.787498 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 09:51:32.787498 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 09:51:32.787498 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:32.787498 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:32.787498 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:32.787498 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:32.787498 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:32.787498 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:32.788572 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:32.788572 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:32.788572 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:32.788572 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:32.788572 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:32.788572 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:32.788572 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:32.788572 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:32.788572 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:32.788572 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:32.788572 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 09:51:32.788572 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 09:51:32.788572 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 09:51:32.788572 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:51:32.790694 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 487/950] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Aug 10 09:51:32 2022] GET /identity/v3/services/object-store => generated 93 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 09:51:32.796683 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2173ab77-b2a4-4bb4-ab90-fa5dba135d6b None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:32.837536 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:32.891990 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb14dda-9173-47da-9d55-3493bb78c943 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:32.904459 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2173ab77-b2a4-4bb4-ab90-fa5dba135d6b None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:32.937266 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f795173e-be55-4053-bb05-093effc1cf22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:32.938469 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f795173e-be55-4053-bb05-093effc1cf22 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:32.938898 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f795173e-be55-4053-bb05-093effc1cf22 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:32.939313 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f795173e-be55-4053-bb05-093effc1cf22 None admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:32.940153 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f795173e-be55-4053-bb05-093effc1cf22 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:32.940723 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f795173e-be55-4053-bb05-093effc1cf22 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:32.942119 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dee482-c272-4b98-8b60-9aa83be57484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:32.942598 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f795173e-be55-4053-bb05-093effc1cf22 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:32.943282 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dee482-c272-4b98-8b60-9aa83be57484 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:32.943679 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dee482-c272-4b98-8b60-9aa83be57484 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:32.944043 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dee482-c272-4b98-8b60-9aa83be57484 None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:32.944765 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dee482-c272-4b98-8b60-9aa83be57484 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:32.945203 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dee482-c272-4b98-8b60-9aa83be57484 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:32.946913 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dee482-c272-4b98-8b60-9aa83be57484 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:32.956912 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 488/951] 10.222.0.27 () {56 vars in 1122 bytes} [Wed Aug 10 09:51:32 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 09:51:32.957931 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dee482-c272-4b98-8b60-9aa83be57484 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:32.963679 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 464/952] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Aug 10 09:51:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 09:51:32.966027 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f795173e-be55-4053-bb05-093effc1cf22 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:33.018357 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:33.084407 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:33.087307 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f795173e-be55-4053-bb05-093effc1cf22 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:33.097610 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dee482-c272-4b98-8b60-9aa83be57484 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:33.136607 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9030b72-3477-4070-a7df-b6da707b0814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:33.137709 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9030b72-3477-4070-a7df-b6da707b0814 None admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:33.138254 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9030b72-3477-4070-a7df-b6da707b0814 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:33.138592 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640ced25-54fe-4dd3-bd78-2f866e4b6063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:33.138984 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9030b72-3477-4070-a7df-b6da707b0814 None admin] PATH_INFO: `/v3/projects/d47d5b72a00642a1a239b785110643ef/users/179709fe7d8343689f096ac0d9a333b0/roles/0dd53da12ae74208933c961c29f12ec0` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:33.139200 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ced25-54fe-4dd3-bd78-2f866e4b6063 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:33.139472 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ced25-54fe-4dd3-bd78-2f866e4b6063 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:33.139736 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ced25-54fe-4dd3-bd78-2f866e4b6063 None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:33.140366 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640ced25-54fe-4dd3-bd78-2f866e4b6063 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:33.140744 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640ced25-54fe-4dd3-bd78-2f866e4b6063 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:33.142147 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640ced25-54fe-4dd3-bd78-2f866e4b6063 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:33.142836 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9030b72-3477-4070-a7df-b6da707b0814 None admin] RBAC: Authorizing `identity:create_grant(project_id=d47d5b72a00642a1a239b785110643ef, user_id=179709fe7d8343689f096ac0d9a333b0, role_id=0dd53da12ae74208933c961c29f12ec0)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:33.145406 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9030b72-3477-4070-a7df-b6da707b0814 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:33.151544 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 489/953] 10.222.0.27 () {56 vars in 1122 bytes} [Wed Aug 10 09:51:32 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:33.153883 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640ced25-54fe-4dd3-bd78-2f866e4b6063 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:33.162786 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 465/954] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Aug 10 09:51:32 2022] PUT /identity/v3/projects/d47d5b72a00642a1a239b785110643ef/users/179709fe7d8343689f096ac0d9a333b0/roles/0dd53da12ae74208933c961c29f12ec0 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 09:51:33.271774 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640ced25-54fe-4dd3-bd78-2f866e4b6063 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:33.310988 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2032a104-0129-4293-abd3-98cd3d7f1c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:33.311614 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2032a104-0129-4293-abd3-98cd3d7f1c37 None admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:33.311887 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2032a104-0129-4293-abd3-98cd3d7f1c37 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:33.312155 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2032a104-0129-4293-abd3-98cd3d7f1c37 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:33.312823 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2032a104-0129-4293-abd3-98cd3d7f1c37 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:33.314230 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2032a104-0129-4293-abd3-98cd3d7f1c37 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:33.339932 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 490/955] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 10 09:51:33 2022] POST /identity/v3/endpoints => generated 349 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 09:51:33.359581 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0dc892-4268-4067-b849-2407d7aaceec None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:33.359944 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0dc892-4268-4067-b849-2407d7aaceec None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:33.360142 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0dc892-4268-4067-b849-2407d7aaceec None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:33.361909 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 466/956] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:51:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:51:33.367821 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e97d5-a259-4418-a9ec-a4b6ddbb43a1 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:33.368170 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e97d5-a259-4418-a9ec-a4b6ddbb43a1 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:33.368465 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e97d5-a259-4418-a9ec-a4b6ddbb43a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:33.388489 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-e29e97d5-a259-4418-a9ec-a4b6ddbb43a1 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:51:33.389779 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-e29e97d5-a259-4418-a9ec-a4b6ddbb43a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:51:33.398665 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:33.472595 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 491/957] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:51:33 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 09:51:33.494681 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0dc892-4268-4067-b849-2407d7aaceec None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:33.603820 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0dc892-4268-4067-b849-2407d7aaceec None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:33.606250 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:33.644202 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae70b488-0e83-4eb2-abac-1a1d1e9dbc8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:33.644830 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae70b488-0e83-4eb2-abac-1a1d1e9dbc8f None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:33.645130 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae70b488-0e83-4eb2-abac-1a1d1e9dbc8f None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:33.645405 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae70b488-0e83-4eb2-abac-1a1d1e9dbc8f None admin] PATH_INFO: `/v3/services/compute` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:33.645986 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae70b488-0e83-4eb2-abac-1a1d1e9dbc8f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:33.647485 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae70b488-0e83-4eb2-abac-1a1d1e9dbc8f None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:33.656742 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-ae70b488-0e83-4eb2-abac-1a1d1e9dbc8f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 10 09:51:33.656742 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:33.656742 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 09:51:33.656742 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 09:51:33.656742 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 09:51:33.656742 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 09:51:33.656742 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 09:51:33.656742 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 09:51:33.656742 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 10 09:51:33.656742 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:51:33.656742 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 09:51:33.656742 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:51:33.656742 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:33.656742 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:33.656742 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:33.656742 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:33.656742 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:33.658005 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:33.658005 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:33.658005 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:33.658005 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:33.658005 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:33.658005 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:33.658005 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 09:51:33.658005 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 09:51:33.658005 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 09:51:33.658005 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 09:51:33.658005 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:33.658005 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:33.658005 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:33.658005 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:33.658005 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:33.658005 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:33.659388 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:33.659388 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:33.659388 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:33.659388 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:33.659388 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:33.659388 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:33.659388 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:33.659388 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:33.659388 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:33.659388 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:33.659388 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 09:51:33.659388 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 09:51:33.659388 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 10 09:51:33.659388 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:51:33.659388 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 467/958] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 10 09:51:33 2022] GET /identity/v3/services/compute => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:51:33.664109 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29e97d5-a259-4418-a9ec-a4b6ddbb43a1 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:33.767378 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29e97d5-a259-4418-a9ec-a4b6ddbb43a1 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:33.801341 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc89018-bc78-433e-82e8-bae93ca541fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:33.801950 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc89018-bc78-433e-82e8-bae93ca541fe None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:33.802227 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc89018-bc78-433e-82e8-bae93ca541fe None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:33.802494 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc89018-bc78-433e-82e8-bae93ca541fe None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:33.803231 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc89018-bc78-433e-82e8-bae93ca541fe None admin] RBAC: Adding query filter params (name=compute) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:33.803529 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc89018-bc78-433e-82e8-bae93ca541fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:33.804892 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc89018-bc78-433e-82e8-bae93ca541fe None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:33.809917 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 492/959] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Aug 10 09:51:33 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:33.815443 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae70b488-0e83-4eb2-abac-1a1d1e9dbc8f None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:33.919195 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae70b488-0e83-4eb2-abac-1a1d1e9dbc8f None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:33.953525 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e888321e-041a-4b1e-b034-af93192497e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:33.954129 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e888321e-041a-4b1e-b034-af93192497e1 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:33.954404 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e888321e-041a-4b1e-b034-af93192497e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:33.954671 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e888321e-041a-4b1e-b034-af93192497e1 None admin] PATH_INFO: `/v3/services` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:33.955300 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e888321e-041a-4b1e-b034-af93192497e1 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:33.955598 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e888321e-041a-4b1e-b034-af93192497e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:33.956971 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e888321e-041a-4b1e-b034-af93192497e1 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:33.961993 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 468/960] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Aug 10 09:51:33 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:34.653841 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f423d782-bb15-4821-a7fc-9c0bb615436f None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:34.654505 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f423d782-bb15-4821-a7fc-9c0bb615436f None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:34.654824 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f423d782-bb15-4821-a7fc-9c0bb615436f None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:34.657513 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 493/961] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:51:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:51:34.663382 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa549f-add3-49d8-9a3d-168555089921 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:34.663934 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa549f-add3-49d8-9a3d-168555089921 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:34.663934 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa549f-add3-49d8-9a3d-168555089921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:34.682798 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-08fa549f-add3-49d8-9a3d-168555089921 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:51:34.684056 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-08fa549f-add3-49d8-9a3d-168555089921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:51:34.711283 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:34.754619 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 469/962] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:51:34 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 09:51:34.778599 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f423d782-bb15-4821-a7fc-9c0bb615436f None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:34.781577 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:34.879649 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f423d782-bb15-4821-a7fc-9c0bb615436f None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:34.917858 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd2407e-8410-48b6-b6fb-1e4d1483ca73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:34.918382 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd2407e-8410-48b6-b6fb-1e4d1483ca73 None admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:34.918657 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd2407e-8410-48b6-b6fb-1e4d1483ca73 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:34.918923 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd2407e-8410-48b6-b6fb-1e4d1483ca73 None admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:34.919564 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd2407e-8410-48b6-b6fb-1e4d1483ca73 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:34.920995 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd2407e-8410-48b6-b6fb-1e4d1483ca73 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:34.937934 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.sql.core [None req-9fd2407e-8410-48b6-b6fb-1e4d1483ca73 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 10 09:51:34.937934 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 10 09:51:34.937934 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [parameters: {'user_id': '5c115d4cf69e40c7871068283876a628', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 10 09:51:34.937934 dv-cinder-850836-5-smb devstack@keystone.service[80231]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80231) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 10 09:51:34.945689 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-9fd2407e-8410-48b6-b6fb-1e4d1483ca73 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 10 09:51:34.945689 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:34.945689 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 10 09:51:34.945689 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 10 09:51:34.945689 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 10 09:51:34.945689 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 10 09:51:34.945689 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 10 09:51:34.945689 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application result = self._query(query) Aug 10 09:51:34.945689 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 10 09:51:34.945689 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application conn.query(q) Aug 10 09:51:34.945689 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 10 09:51:34.945689 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 10 09:51:34.945689 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 10 09:51:34.945689 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application result.read() Aug 10 09:51:34.945689 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 10 09:51:34.946618 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 10 09:51:34.946618 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 10 09:51:34.946618 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 10 09:51:34.946618 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 10 09:51:34.946618 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 10 09:51:34.946618 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 10 09:51:34.946618 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 10 09:51:34.946618 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 10 09:51:34.946618 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:51:34.946618 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 10 09:51:34.946618 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:51:34.946618 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:34.946618 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 10 09:51:34.946618 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 10 09:51:34.946618 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 10 09:51:34.946618 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 10 09:51:34.946618 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 10 09:51:34.946618 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application next(self.gen) Aug 10 09:51:34.947970 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 10 09:51:34.947970 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application yield resource Aug 10 09:51:34.947970 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 10 09:51:34.947970 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application next(self.gen) Aug 10 09:51:34.947970 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 10 09:51:34.947970 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self.session.rollback() Aug 10 09:51:34.947970 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 09:51:34.947970 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self.force_reraise() Aug 10 09:51:34.947970 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 09:51:34.947970 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise self.value Aug 10 09:51:34.947970 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 10 09:51:34.947970 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 10 09:51:34.947970 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 10 09:51:34.947970 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application session.commit() Aug 10 09:51:34.947970 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 10 09:51:34.947970 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 10 09:51:34.947970 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 10 09:51:34.948908 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._prepare_impl() Aug 10 09:51:34.948908 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 10 09:51:34.948908 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self.session.flush() Aug 10 09:51:34.948908 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 10 09:51:34.948908 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._flush(objects) Aug 10 09:51:34.948908 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 10 09:51:34.948908 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 10 09:51:34.948908 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 10 09:51:34.948908 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application compat.raise_( Aug 10 09:51:34.948908 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 10 09:51:34.948908 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception Aug 10 09:51:34.948908 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 10 09:51:34.948908 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application flush_context.execute() Aug 10 09:51:34.948908 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 10 09:51:34.948908 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rec.execute(self) Aug 10 09:51:34.948908 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 10 09:51:34.948908 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 10 09:51:34.949908 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 10 09:51:34.949908 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 10 09:51:34.949908 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 10 09:51:34.949908 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 10 09:51:34.949908 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 10 09:51:34.949908 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 10 09:51:34.949908 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 10 09:51:34.949908 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 10 09:51:34.949908 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 10 09:51:34.949908 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 10 09:51:34.949908 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 10 09:51:34.949908 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 10 09:51:34.949908 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 10 09:51:34.949908 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 10 09:51:34.949908 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 10 09:51:34.949908 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception Aug 10 09:51:34.950788 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 10 09:51:34.950788 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 10 09:51:34.950788 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 10 09:51:34.950788 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 10 09:51:34.950788 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 10 09:51:34.950788 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application result = self._query(query) Aug 10 09:51:34.950788 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 10 09:51:34.950788 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application conn.query(q) Aug 10 09:51:34.950788 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 10 09:51:34.950788 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 10 09:51:34.950788 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 10 09:51:34.950788 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application result.read() Aug 10 09:51:34.950788 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 10 09:51:34.950788 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 10 09:51:34.950788 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 10 09:51:34.950788 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 10 09:51:34.951947 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 10 09:51:34.951947 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 10 09:51:34.951947 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 10 09:51:34.951947 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 10 09:51:34.951947 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 10 09:51:34.951947 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 10 09:51:34.951947 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [parameters: {'user_id': '5c115d4cf69e40c7871068283876a628', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 10 09:51:34.951947 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 10 09:51:34.951947 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:51:34.951947 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 09:51:34.951947 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:51:34.951947 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:34.951947 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:34.951947 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:34.951947 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:34.952789 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:34.952789 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:34.952789 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:34.952789 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:34.952789 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:34.952789 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:34.952789 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:34.952789 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 10 09:51:34.952789 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 10 09:51:34.952789 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:34.952789 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:34.952789 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 09:51:34.952789 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 09:51:34.952789 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 09:51:34.952789 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 09:51:34.952789 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 10 09:51:34.952789 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 10 09:51:34.953841 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 10 09:51:34.953841 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 10 09:51:34.953841 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 10 09:51:34.953841 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 10 09:51:34.953841 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 10 09:51:34.953841 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:51:34.953841 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 494/963] 10.222.0.27 () {60 vars in 1131 bytes} [Wed Aug 10 09:51:34 2022] POST /identity/v3/users => generated 160 bytes in 169 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:51:34.954298 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fa549f-add3-49d8-9a3d-168555089921 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:35.066944 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fa549f-add3-49d8-9a3d-168555089921 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:35.103275 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f928f731-d0e6-4f56-898b-d53d7b83c05c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:35.103906 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f928f731-d0e6-4f56-898b-d53d7b83c05c None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:35.104189 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f928f731-d0e6-4f56-898b-d53d7b83c05c None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:35.104464 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f928f731-d0e6-4f56-898b-d53d7b83c05c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:35.111953 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f928f731-d0e6-4f56-898b-d53d7b83c05c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:35.113458 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f928f731-d0e6-4f56-898b-d53d7b83c05c None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:35.125288 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-f928f731-d0e6-4f56-898b-d53d7b83c05c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 10 09:51:35.125288 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:35.125288 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:35.125288 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:35.125288 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:35.125288 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:35.125288 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:35.125288 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:35.125288 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:35.125288 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:35.125288 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:35.125288 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:35.125288 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 09:51:35.125288 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 09:51:35.125288 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 09:51:35.125288 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 09:51:35.127714 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:35.127714 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:35.127714 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 09:51:35.127714 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 09:51:35.127714 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 09:51:35.127714 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 09:51:35.127714 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:35.127714 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:35.127714 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:35.127714 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:35.127714 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:35.127714 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:35.127714 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:35.127714 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:35.127714 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:35.127714 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:35.127714 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:35.127714 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:35.129550 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:35.129550 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:35.129550 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 09:51:35.129550 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 09:51:35.129550 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 09:51:35.129550 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 09:51:35.129550 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 09:51:35.129550 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 09:51:35.129550 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 10 09:51:35.129550 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:51:35.129550 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 470/964] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 10 09:51:34 2022] GET /identity/v3/users/cinder => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:51:35.132660 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd2407e-8410-48b6-b6fb-1e4d1483ca73 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:35.200902 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:35.240341 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd2407e-8410-48b6-b6fb-1e4d1483ca73 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:35.269966 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6291804-21d6-4d60-b2ca-26d7c59eb882 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:35.270305 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6291804-21d6-4d60-b2ca-26d7c59eb882 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:35.270763 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6291804-21d6-4d60-b2ca-26d7c59eb882 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:35.272703 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 471/965] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:51:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 09:51:35.275422 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1c4e5e-1a28-4ab8-9cec-957ef46c708e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:35.276297 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1c4e5e-1a28-4ab8-9cec-957ef46c708e None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:35.276878 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1c4e5e-1a28-4ab8-9cec-957ef46c708e None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:35.277390 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1c4e5e-1a28-4ab8-9cec-957ef46c708e None admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:35.279234 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ccc3e2-a830-4659-aa14-575f72a2c3bc None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:35.279351 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1c4e5e-1a28-4ab8-9cec-957ef46c708e None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:35.279436 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ccc3e2-a830-4659-aa14-575f72a2c3bc None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:35.279436 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ccc3e2-a830-4659-aa14-575f72a2c3bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:35.279578 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1c4e5e-1a28-4ab8-9cec-957ef46c708e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:35.280257 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1c4e5e-1a28-4ab8-9cec-957ef46c708e None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:35.298300 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-87ccc3e2-a830-4659-aa14-575f72a2c3bc None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:51:35.299828 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-87ccc3e2-a830-4659-aa14-575f72a2c3bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:51:35.317537 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:35.322311 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 495/966] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Aug 10 09:51:35 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:35.377581 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 472/967] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:51:35 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 09:51:35.401779 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1c4e5e-1a28-4ab8-9cec-957ef46c708e None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:35.513619 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1c4e5e-1a28-4ab8-9cec-957ef46c708e None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:35.537640 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:35.549963 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa2be57-01fc-4437-bac0-a3c2b39b4a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:35.550704 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa2be57-01fc-4437-bac0-a3c2b39b4a2a None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:35.550928 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa2be57-01fc-4437-bac0-a3c2b39b4a2a None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:35.551198 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa2be57-01fc-4437-bac0-a3c2b39b4a2a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:35.552224 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38fa911-67c6-44db-8a98-ed02e1a754aa None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:35.552517 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38fa911-67c6-44db-8a98-ed02e1a754aa None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:35.552833 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38fa911-67c6-44db-8a98-ed02e1a754aa None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:35.554253 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 473/968] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:51:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 09:51:35.559481 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaae6725-ec88-4433-9144-1f5d8e2fe19c None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:35.559769 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaae6725-ec88-4433-9144-1f5d8e2fe19c None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:35.560052 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaae6725-ec88-4433-9144-1f5d8e2fe19c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:35.563125 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa2be57-01fc-4437-bac0-a3c2b39b4a2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 09:51:35.568248 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-1fa2be57-01fc-4437-bac0-a3c2b39b4a2a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 10 09:51:35.568248 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:35.568248 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:35.568248 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:35.568248 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:35.568248 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:35.568248 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:35.568248 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:35.568248 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:35.568248 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:35.568248 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:35.568248 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:35.568248 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 09:51:35.568248 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 09:51:35.568248 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 09:51:35.568248 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 09:51:35.569591 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 09:51:35.569591 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 09:51:35.569591 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 09:51:35.569591 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 09:51:35.569591 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:35.569591 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:35.569591 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:35.569591 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:35.569591 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:35.569591 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:35.569591 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:35.569591 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:35.569591 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:35.569591 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:35.569591 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:35.569591 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:35.571328 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:35.571328 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:35.571328 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:35.571328 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:35.571328 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 09:51:35.571328 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 09:51:35.571328 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 09:51:35.571328 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 09:51:35.571328 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 09:51:35.571328 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 09:51:35.571328 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 10 09:51:35.571328 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:51:35.571328 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 496/969] 10.222.0.27 () {56 vars in 1120 bytes} [Wed Aug 10 09:51:35 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:51:35.581135 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa2be57-01fc-4437-bac0-a3c2b39b4a2a None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:35.589198 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-aaae6725-ec88-4433-9144-1f5d8e2fe19c None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:51:35.590682 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-aaae6725-ec88-4433-9144-1f5d8e2fe19c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:51:35.662069 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 474/970] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:51:35 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 09:51:35.684220 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaae6725-ec88-4433-9144-1f5d8e2fe19c None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:35.684749 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa2be57-01fc-4437-bac0-a3c2b39b4a2a None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:35.720096 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7b25cf-1867-4f18-8ffe-d33c37cd0dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:35.721080 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b25cf-1867-4f18-8ffe-d33c37cd0dcc None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:35.721367 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b25cf-1867-4f18-8ffe-d33c37cd0dcc None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:35.721631 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b25cf-1867-4f18-8ffe-d33c37cd0dcc None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:35.722289 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7b25cf-1867-4f18-8ffe-d33c37cd0dcc None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:35.722586 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7b25cf-1867-4f18-8ffe-d33c37cd0dcc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:35.723945 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7b25cf-1867-4f18-8ffe-d33c37cd0dcc None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:35.732748 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 497/971] 10.222.0.27 () {56 vars in 1115 bytes} [Wed Aug 10 09:51:35 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 09:51:35.738089 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7b25cf-1867-4f18-8ffe-d33c37cd0dcc None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:35.767035 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:35.787739 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:35.788539 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaae6725-ec88-4433-9144-1f5d8e2fe19c None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:35.827451 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcbfc74-167a-415f-8206-9928ad2a7adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:35.828229 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcbfc74-167a-415f-8206-9928ad2a7adf None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:35.828509 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcbfc74-167a-415f-8206-9928ad2a7adf None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:35.828776 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcbfc74-167a-415f-8206-9928ad2a7adf None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:35.830436 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcbfc74-167a-415f-8206-9928ad2a7adf None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:35.831814 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcbfc74-167a-415f-8206-9928ad2a7adf None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:35.840588 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-ebcbfc74-167a-415f-8206-9928ad2a7adf None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 09:51:35.840588 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:35.840588 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 09:51:35.840588 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 09:51:35.840588 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 09:51:35.840588 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 09:51:35.840588 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 09:51:35.840588 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 09:51:35.840588 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 09:51:35.840588 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:51:35.840588 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 09:51:35.840588 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:51:35.840588 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:35.840588 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:35.840588 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:35.840588 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:35.840588 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:35.841684 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:35.841684 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:35.841684 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:35.841684 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:35.841684 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:35.841684 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:35.841684 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 09:51:35.841684 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 09:51:35.841684 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 09:51:35.841684 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 09:51:35.841684 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:35.841684 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:35.841684 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:35.841684 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:35.841684 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:35.841684 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:35.842570 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:35.842570 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:35.842570 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:35.842570 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:35.842570 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:35.842570 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:35.842570 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:35.842570 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:35.842570 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:35.842570 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:35.842570 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 09:51:35.842570 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 09:51:35.842570 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 09:51:35.842570 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:51:35.842570 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 475/972] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Aug 10 09:51:35 2022] GET /identity/v3/services/object-store => generated 93 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 09:51:35.847899 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcbfc74-167a-415f-8206-9928ad2a7adf None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:35.852385 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7b25cf-1867-4f18-8ffe-d33c37cd0dcc None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:35.886297 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798d006b-0dfa-40f5-a29a-51d32fd6827a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:35.887010 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d006b-0dfa-40f5-a29a-51d32fd6827a None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:35.887288 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d006b-0dfa-40f5-a29a-51d32fd6827a None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:35.887566 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d006b-0dfa-40f5-a29a-51d32fd6827a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:35.898696 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798d006b-0dfa-40f5-a29a-51d32fd6827a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:35.900205 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798d006b-0dfa-40f5-a29a-51d32fd6827a None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:35.915780 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-798d006b-0dfa-40f5-a29a-51d32fd6827a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:51:35.915780 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:35.915780 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:35.915780 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:35.915780 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:35.915780 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:35.915780 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:35.915780 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:35.915780 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:35.915780 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:35.915780 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:35.915780 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:35.915780 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 09:51:35.915780 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 09:51:35.915780 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 09:51:35.915780 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 09:51:35.916770 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:35.916770 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:35.916770 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:35.916770 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:35.916770 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:35.916770 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:35.916770 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:35.916770 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:35.916770 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:35.916770 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:35.916770 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:35.916770 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:35.916770 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:35.916770 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:35.916770 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:35.916770 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:35.916770 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 09:51:35.917843 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 09:51:35.917843 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:51:35.917843 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:51:35.921866 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 498/973] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 10 09:51:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 09:51:35.922586 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798d006b-0dfa-40f5-a29a-51d32fd6827a None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:35.958227 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcbfc74-167a-415f-8206-9928ad2a7adf None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:35.994620 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a47fb62-b8a4-45be-b219-4dd3f5281548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:35.995227 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a47fb62-b8a4-45be-b219-4dd3f5281548 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:35.995516 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a47fb62-b8a4-45be-b219-4dd3f5281548 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:35.995785 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a47fb62-b8a4-45be-b219-4dd3f5281548 None admin] PATH_INFO: `/v3/services` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:35.996423 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a47fb62-b8a4-45be-b219-4dd3f5281548 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:35.996738 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a47fb62-b8a4-45be-b219-4dd3f5281548 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:35.998143 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a47fb62-b8a4-45be-b219-4dd3f5281548 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:36.002939 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 476/974] 10.222.0.27 () {56 vars in 1122 bytes} [Wed Aug 10 09:51:35 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:36.003943 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3d0617-6d37-4426-8931-2c4b7c2e059f None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:36.004229 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3d0617-6d37-4426-8931-2c4b7c2e059f None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:36.004497 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3d0617-6d37-4426-8931-2c4b7c2e059f None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:36.009111 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 477/975] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:51:36 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:51:36.009111 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3d0617-6d37-4426-8931-2c4b7c2e059f None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:36.020700 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:36.022685 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:36.028620 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798d006b-0dfa-40f5-a29a-51d32fd6827a None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:36.060535 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348bcc4c-13e4-4489-acb7-44e279a28a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:36.061170 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348bcc4c-13e4-4489-acb7-44e279a28a33 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:36.061452 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348bcc4c-13e4-4489-acb7-44e279a28a33 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:36.061743 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348bcc4c-13e4-4489-acb7-44e279a28a33 None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:36.062374 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348bcc4c-13e4-4489-acb7-44e279a28a33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:36.062676 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348bcc4c-13e4-4489-acb7-44e279a28a33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:36.064054 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348bcc4c-13e4-4489-acb7-44e279a28a33 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:36.075922 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 499/976] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 10 09:51:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:36.077181 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df90082b-21f0-4f65-9c7a-4818c3157cb1 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:36.077466 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df90082b-21f0-4f65-9c7a-4818c3157cb1 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:36.077742 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df90082b-21f0-4f65-9c7a-4818c3157cb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:36.095097 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-df90082b-21f0-4f65-9c7a-4818c3157cb1 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:51:36.096594 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-df90082b-21f0-4f65-9c7a-4818c3157cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:51:36.112465 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3d0617-6d37-4426-8931-2c4b7c2e059f None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:36.145673 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9bd29b-8bb7-4b14-8ac1-74916485ff95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:36.146276 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9bd29b-8bb7-4b14-8ac1-74916485ff95 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:36.146581 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9bd29b-8bb7-4b14-8ac1-74916485ff95 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:36.146846 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9bd29b-8bb7-4b14-8ac1-74916485ff95 None admin] PATH_INFO: `/v3/services` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:36.147471 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9bd29b-8bb7-4b14-8ac1-74916485ff95 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:36.147767 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9bd29b-8bb7-4b14-8ac1-74916485ff95 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:36.149151 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9bd29b-8bb7-4b14-8ac1-74916485ff95 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:36.153842 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 478/977] 10.222.0.27 () {56 vars in 1122 bytes} [Wed Aug 10 09:51:36 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 09:51:36.154592 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9bd29b-8bb7-4b14-8ac1-74916485ff95 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:36.165454 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 500/978] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:51:36 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 09:51:36.166379 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df90082b-21f0-4f65-9c7a-4818c3157cb1 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:36.235154 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:36.248076 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:36.261353 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9bd29b-8bb7-4b14-8ac1-74916485ff95 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:36.262927 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df90082b-21f0-4f65-9c7a-4818c3157cb1 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:36.295370 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a6466c-5772-4437-980c-33687717bd41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:36.295910 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a6466c-5772-4437-980c-33687717bd41 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:36.296191 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a6466c-5772-4437-980c-33687717bd41 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:36.296490 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a6466c-5772-4437-980c-33687717bd41 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:36.297031 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca3a3a5-9788-4544-902a-8bb227e1f74c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:36.297669 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca3a3a5-9788-4544-902a-8bb227e1f74c None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:36.297950 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca3a3a5-9788-4544-902a-8bb227e1f74c None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:36.298214 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca3a3a5-9788-4544-902a-8bb227e1f74c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:36.298930 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca3a3a5-9788-4544-902a-8bb227e1f74c None admin] RBAC: Adding query filter params (interface=admin, service_id=189b1c19563246cabbf9c4647c87ef58, region_id=RegionOne) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:36.299243 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca3a3a5-9788-4544-902a-8bb227e1f74c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:36.300613 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca3a3a5-9788-4544-902a-8bb227e1f74c None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:36.304002 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a6466c-5772-4437-980c-33687717bd41 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:36.305464 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a6466c-5772-4437-980c-33687717bd41 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:36.305836 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 501/979] 10.222.0.27 () {56 vars in 1249 bytes} [Wed Aug 10 09:51:36 2022] GET /identity/v3/endpoints?service_id=189b1c19563246cabbf9c4647c87ef58&interface=admin®ion_id=RegionOne => generated 193 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:36.306542 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca3a3a5-9788-4544-902a-8bb227e1f74c None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:36.316210 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-45a6466c-5772-4437-980c-33687717bd41 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 10 09:51:36.316210 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:36.316210 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:36.316210 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:36.316210 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:36.316210 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:36.316210 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:36.316210 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:36.316210 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:36.316210 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:36.316210 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:36.316210 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:36.316210 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 09:51:36.316210 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 09:51:36.316210 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 09:51:36.316210 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 09:51:36.317349 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:36.317349 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:36.317349 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 09:51:36.317349 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 09:51:36.317349 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 09:51:36.317349 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 09:51:36.317349 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:36.317349 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:36.317349 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:36.317349 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:36.317349 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:36.317349 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:36.317349 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:36.317349 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:36.317349 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:36.317349 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:36.317349 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:36.317349 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:36.318903 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:36.318903 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:36.318903 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 09:51:36.318903 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 09:51:36.318903 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 09:51:36.318903 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 09:51:36.318903 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 09:51:36.318903 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 09:51:36.318903 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 10 09:51:36.318903 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:51:36.318903 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 479/980] 10.222.0.27 () {56 vars in 1117 bytes} [Wed Aug 10 09:51:36 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:51:36.318903 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a6466c-5772-4437-980c-33687717bd41 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:36.411926 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca3a3a5-9788-4544-902a-8bb227e1f74c None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:36.416320 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a6466c-5772-4437-980c-33687717bd41 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:36.446494 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3135e45c-d30a-4afd-9832-0990dcc8da79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:36.447104 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3135e45c-d30a-4afd-9832-0990dcc8da79 None admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:36.447385 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3135e45c-d30a-4afd-9832-0990dcc8da79 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:36.447661 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3135e45c-d30a-4afd-9832-0990dcc8da79 None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:36.448313 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3135e45c-d30a-4afd-9832-0990dcc8da79 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:36.448643 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77c3759-f1ec-4ea4-a82b-cd73aae5190e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:36.449279 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77c3759-f1ec-4ea4-a82b-cd73aae5190e None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:36.449557 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77c3759-f1ec-4ea4-a82b-cd73aae5190e None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:36.449712 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3135e45c-d30a-4afd-9832-0990dcc8da79 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:36.449827 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77c3759-f1ec-4ea4-a82b-cd73aae5190e None admin] PATH_INFO: `/v3/services` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:36.450433 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77c3759-f1ec-4ea4-a82b-cd73aae5190e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:36.451781 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77c3759-f1ec-4ea4-a82b-cd73aae5190e None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:36.452781 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:36.458700 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 480/981] 10.222.0.27 () {56 vars in 1087 bytes} [Wed Aug 10 09:51:36 2022] GET /identity/v3/services => generated 1497 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 09:51:36.459923 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77c3759-f1ec-4ea4-a82b-cd73aae5190e None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:36.466025 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 502/982] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Aug 10 09:51:36 2022] POST /identity/v3/services => generated 242 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 09:51:36.591692 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77c3759-f1ec-4ea4-a82b-cd73aae5190e None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:36.641503 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55df869e-f6e1-4217-addc-68a0d5f84694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:36.642120 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55df869e-f6e1-4217-addc-68a0d5f84694 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:36.642397 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55df869e-f6e1-4217-addc-68a0d5f84694 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:36.642666 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55df869e-f6e1-4217-addc-68a0d5f84694 None admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:36.643418 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55df869e-f6e1-4217-addc-68a0d5f84694 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:36.643708 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55df869e-f6e1-4217-addc-68a0d5f84694 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:36.645173 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55df869e-f6e1-4217-addc-68a0d5f84694 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:36.663367 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 481/983] 10.222.0.27 () {56 vars in 1149 bytes} [Wed Aug 10 09:51:36 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:36.669400 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3135e45c-d30a-4afd-9832-0990dcc8da79 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:36.688667 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:36.778201 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3135e45c-d30a-4afd-9832-0990dcc8da79 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:36.811692 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97da8dac-55c6-4e8f-ace5-ca8c867cc505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:36.812310 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97da8dac-55c6-4e8f-ace5-ca8c867cc505 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:36.812588 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97da8dac-55c6-4e8f-ace5-ca8c867cc505 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:36.812857 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97da8dac-55c6-4e8f-ace5-ca8c867cc505 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:36.879629 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97da8dac-55c6-4e8f-ace5-ca8c867cc505 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:36.881101 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97da8dac-55c6-4e8f-ace5-ca8c867cc505 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:36.893011 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:36.987741 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 503/984] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 10 09:51:36 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 10 09:51:36.993274 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55df869e-f6e1-4217-addc-68a0d5f84694 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:37.048634 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:37.097570 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55df869e-f6e1-4217-addc-68a0d5f84694 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:37.131471 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8a705a-933f-434a-bb86-55c8fc2d67c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:37.132018 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8a705a-933f-434a-bb86-55c8fc2d67c5 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:37.132293 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8a705a-933f-434a-bb86-55c8fc2d67c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:37.132558 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8a705a-933f-434a-bb86-55c8fc2d67c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:37.143046 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8a705a-933f-434a-bb86-55c8fc2d67c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:37.144507 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8a705a-933f-434a-bb86-55c8fc2d67c5 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:37.158931 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-bc8a705a-933f-434a-bb86-55c8fc2d67c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:51:37.158931 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:37.158931 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:37.158931 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:37.158931 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:37.158931 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:37.158931 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:37.158931 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:37.158931 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:37.158931 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:37.158931 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:37.158931 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:37.158931 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 09:51:37.158931 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 09:51:37.158931 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 09:51:37.158931 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 09:51:37.159907 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:37.159907 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:37.159907 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:37.159907 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:37.159907 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:37.159907 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:37.159907 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:37.159907 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:37.159907 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:37.159907 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:37.159907 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:37.159907 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:37.159907 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:37.159907 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:37.159907 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:37.159907 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:37.159907 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 09:51:37.166033 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 09:51:37.166033 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:51:37.166033 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:51:37.166033 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 482/985] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 10 09:51:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:51:37.166256 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97da8dac-55c6-4e8f-ace5-ca8c867cc505 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:37.266812 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97da8dac-55c6-4e8f-ace5-ca8c867cc505 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:37.277858 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:37.302103 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1094d99-3b6c-45c6-a215-8259b85da25a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:37.302719 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1094d99-3b6c-45c6-a215-8259b85da25a None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:37.303045 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1094d99-3b6c-45c6-a215-8259b85da25a None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:37.303371 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1094d99-3b6c-45c6-a215-8259b85da25a None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:37.304010 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1094d99-3b6c-45c6-a215-8259b85da25a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:37.304361 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1094d99-3b6c-45c6-a215-8259b85da25a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:37.305783 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1094d99-3b6c-45c6-a215-8259b85da25a None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:37.316967 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 504/986] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 10 09:51:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 09:51:37.322886 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8a705a-933f-434a-bb86-55c8fc2d67c5 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:37.420990 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8a705a-933f-434a-bb86-55c8fc2d67c5 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:37.423305 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:37.456044 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce58ec11-2bf2-48bf-8fc1-04665a6de4fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:37.456667 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce58ec11-2bf2-48bf-8fc1-04665a6de4fd None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:37.456945 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce58ec11-2bf2-48bf-8fc1-04665a6de4fd None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:37.457243 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce58ec11-2bf2-48bf-8fc1-04665a6de4fd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:37.464019 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce58ec11-2bf2-48bf-8fc1-04665a6de4fd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:37.465498 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce58ec11-2bf2-48bf-8fc1-04665a6de4fd None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:37.476611 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-ce58ec11-2bf2-48bf-8fc1-04665a6de4fd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 09:51:37.476611 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:37.476611 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:37.476611 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:37.476611 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:37.476611 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:37.476611 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:37.476611 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:37.476611 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:37.476611 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:37.476611 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:37.476611 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:37.476611 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 09:51:37.476611 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 09:51:37.476611 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 09:51:37.477707 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 09:51:37.477707 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:37.477707 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:37.477707 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:37.477707 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:37.477707 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:37.477707 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:37.477707 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:37.477707 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:37.477707 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:37.477707 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:37.477707 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:37.477707 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:37.477707 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:37.477707 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:37.477707 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:37.477707 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:37.478578 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 09:51:37.478578 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 09:51:37.478578 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 09:51:37.478578 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 09:51:37.478578 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 09:51:37.478578 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 09:51:37.478578 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 09:51:37.478578 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:51:37.481386 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 483/987] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 10 09:51:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:51:37.483625 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1094d99-3b6c-45c6-a215-8259b85da25a None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:37.585798 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1094d99-3b6c-45c6-a215-8259b85da25a None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:37.621239 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0c8471-f32a-4681-9270-b2442d130dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:37.621848 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0c8471-f32a-4681-9270-b2442d130dc0 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:37.622126 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0c8471-f32a-4681-9270-b2442d130dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:37.622390 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0c8471-f32a-4681-9270-b2442d130dc0 None admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:37.623086 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0c8471-f32a-4681-9270-b2442d130dc0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:37.623391 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0c8471-f32a-4681-9270-b2442d130dc0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:37.624860 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0c8471-f32a-4681-9270-b2442d130dc0 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:37.637761 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 505/988] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Aug 10 09:51:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:37.643725 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce58ec11-2bf2-48bf-8fc1-04665a6de4fd None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:37.750694 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce58ec11-2bf2-48bf-8fc1-04665a6de4fd None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:37.783132 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c592c86c-2be4-4e78-947e-0dcce1826013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:37.783727 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c592c86c-2be4-4e78-947e-0dcce1826013 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:37.784006 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c592c86c-2be4-4e78-947e-0dcce1826013 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:37.784279 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c592c86c-2be4-4e78-947e-0dcce1826013 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:37.785000 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c592c86c-2be4-4e78-947e-0dcce1826013 None admin] RBAC: Adding query filter params (role.id=0dd53da12ae74208933c961c29f12ec0, scope.project.id=d47d5b72a00642a1a239b785110643ef, user.id=179709fe7d8343689f096ac0d9a333b0) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:37.785346 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c592c86c-2be4-4e78-947e-0dcce1826013 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:37.786782 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c592c86c-2be4-4e78-947e-0dcce1826013 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:37.792718 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 484/989] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 10 09:51:37 2022] GET /identity/v3/role_assignments?user.id=179709fe7d8343689f096ac0d9a333b0&scope.project.id=d47d5b72a00642a1a239b785110643ef&role.id=0dd53da12ae74208933c961c29f12ec0 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:38.457107 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ca66ce-5eab-4d1f-8a7b-fe5be3d2f3d3 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:38.457690 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ca66ce-5eab-4d1f-8a7b-fe5be3d2f3d3 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:38.457690 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ca66ce-5eab-4d1f-8a7b-fe5be3d2f3d3 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:38.459080 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 506/990] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:51:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:51:38.464343 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6cc6ac-817a-49c0-9b54-4a551b50580b None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:38.464804 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6cc6ac-817a-49c0-9b54-4a551b50580b None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:38.464883 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6cc6ac-817a-49c0-9b54-4a551b50580b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:38.474233 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9604e29a-58ef-4a7a-bf88-07f6ab5a2117 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:38.474961 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9604e29a-58ef-4a7a-bf88-07f6ab5a2117 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:38.475463 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9604e29a-58ef-4a7a-bf88-07f6ab5a2117 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:38.477318 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 507/991] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:51:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:51:38.481780 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cdd1fe-ed63-4ec5-9f9f-3ebcb2b1eee4 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:38.482305 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cdd1fe-ed63-4ec5-9f9f-3ebcb2b1eee4 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:38.482801 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cdd1fe-ed63-4ec5-9f9f-3ebcb2b1eee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:38.483279 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-0d6cc6ac-817a-49c0-9b54-4a551b50580b None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:51:38.484467 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-0d6cc6ac-817a-49c0-9b54-4a551b50580b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:51:38.502642 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-70cdd1fe-ed63-4ec5-9f9f-3ebcb2b1eee4 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:51:38.503892 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-70cdd1fe-ed63-4ec5-9f9f-3ebcb2b1eee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:51:38.509001 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:38.530852 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:38.555688 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 485/992] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:51:38 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 09:51:38.579034 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6cc6ac-817a-49c0-9b54-4a551b50580b None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:38.582957 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 508/993] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:51:38 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 09:51:38.604809 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cdd1fe-ed63-4ec5-9f9f-3ebcb2b1eee4 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:38.689493 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6cc6ac-817a-49c0-9b54-4a551b50580b None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:38.709942 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cdd1fe-ed63-4ec5-9f9f-3ebcb2b1eee4 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:38.735797 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b202156-b5e0-416b-bf9a-4abeb3567791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:38.736434 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b202156-b5e0-416b-bf9a-4abeb3567791 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:38.736860 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b202156-b5e0-416b-bf9a-4abeb3567791 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:38.737163 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b202156-b5e0-416b-bf9a-4abeb3567791 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:38.738065 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b202156-b5e0-416b-bf9a-4abeb3567791 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:38.739629 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b202156-b5e0-416b-bf9a-4abeb3567791 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:38.748560 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb9b8c3-0702-4d8d-97f1-963513cf08b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:38.748815 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-4b202156-b5e0-416b-bf9a-4abeb3567791 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 09:51:38.748815 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:38.748815 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 09:51:38.748815 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 09:51:38.748815 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 09:51:38.748815 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 09:51:38.748815 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 09:51:38.748815 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 09:51:38.748815 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 09:51:38.748815 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:51:38.748815 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 09:51:38.748815 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:51:38.748815 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:38.748815 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:38.748815 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:38.748815 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:38.748815 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:38.749794 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:38.749794 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:38.749794 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:38.749794 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:38.749794 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:38.749794 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:38.749794 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 09:51:38.749794 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 09:51:38.749794 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 09:51:38.749794 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 09:51:38.749794 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:38.749794 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:38.749794 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:38.749794 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:38.749794 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:38.749794 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:38.756343 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:38.756343 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:38.756343 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:38.756343 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:38.756343 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:38.756343 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:38.756343 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:38.756343 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:38.756343 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:38.756343 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:38.756343 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 09:51:38.756343 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 09:51:38.756343 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 09:51:38.756343 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:51:38.757569 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb9b8c3-0702-4d8d-97f1-963513cf08b3 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:38.757569 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb9b8c3-0702-4d8d-97f1-963513cf08b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:38.757569 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb9b8c3-0702-4d8d-97f1-963513cf08b3 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:38.757768 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 486/994] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Aug 10 09:51:38 2022] GET /identity/v3/services/object-store => generated 93 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 09:51:38.757837 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb9b8c3-0702-4d8d-97f1-963513cf08b3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:38.757837 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb9b8c3-0702-4d8d-97f1-963513cf08b3 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:38.757986 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b202156-b5e0-416b-bf9a-4abeb3567791 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:38.763879 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-fbb9b8c3-0702-4d8d-97f1-963513cf08b3 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 10 09:51:38.763879 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:38.763879 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 09:51:38.763879 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 09:51:38.763879 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 09:51:38.763879 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 09:51:38.763879 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 09:51:38.763879 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 09:51:38.763879 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 10 09:51:38.763879 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:51:38.763879 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 09:51:38.763879 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:51:38.763879 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:38.763879 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:38.763879 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:38.763879 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:38.763879 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:38.764888 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:38.764888 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:38.764888 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:38.764888 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:38.764888 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:38.764888 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:38.764888 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 09:51:38.764888 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 09:51:38.764888 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 09:51:38.764888 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 09:51:38.764888 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:38.764888 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:38.764888 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:38.764888 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:38.764888 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:38.764888 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:38.765807 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:38.765807 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:38.765807 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:38.765807 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:38.765807 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:38.765807 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:38.765807 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:38.765807 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:38.765807 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:38.765807 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:38.765807 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 09:51:38.765807 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 09:51:38.765807 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 10 09:51:38.765807 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:51:38.765807 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 509/995] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 10 09:51:38 2022] GET /identity/v3/services/compute => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 09:51:38.771135 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb9b8c3-0702-4d8d-97f1-963513cf08b3 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:38.782971 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:38.800520 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:38.864479 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b202156-b5e0-416b-bf9a-4abeb3567791 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:38.877550 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb9b8c3-0702-4d8d-97f1-963513cf08b3 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:38.901234 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10e0542-3325-4ffd-8c0b-01e5445e7da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:38.901849 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10e0542-3325-4ffd-8c0b-01e5445e7da0 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:38.902131 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10e0542-3325-4ffd-8c0b-01e5445e7da0 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:38.902406 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10e0542-3325-4ffd-8c0b-01e5445e7da0 None admin] PATH_INFO: `/v3/services` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:38.903048 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10e0542-3325-4ffd-8c0b-01e5445e7da0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:38.903354 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10e0542-3325-4ffd-8c0b-01e5445e7da0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:38.904727 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10e0542-3325-4ffd-8c0b-01e5445e7da0 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:38.910074 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 487/996] 10.222.0.27 () {56 vars in 1122 bytes} [Wed Aug 10 09:51:38 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 09:51:38.912240 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5d255d-72bc-4a48-890d-4b0dc1da3ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:38.912848 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d255d-72bc-4a48-890d-4b0dc1da3ab7 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:38.913203 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d255d-72bc-4a48-890d-4b0dc1da3ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:38.913477 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d255d-72bc-4a48-890d-4b0dc1da3ab7 None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:38.914100 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5d255d-72bc-4a48-890d-4b0dc1da3ab7 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:38.914426 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5d255d-72bc-4a48-890d-4b0dc1da3ab7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:38.915488 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10e0542-3325-4ffd-8c0b-01e5445e7da0 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:38.916010 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5d255d-72bc-4a48-890d-4b0dc1da3ab7 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:38.926002 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 510/997] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Aug 10 09:51:38 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 09:51:38.926954 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5d255d-72bc-4a48-890d-4b0dc1da3ab7 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:39.008527 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:39.016661 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:39.026124 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10e0542-3325-4ffd-8c0b-01e5445e7da0 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:39.030146 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5d255d-72bc-4a48-890d-4b0dc1da3ab7 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:39.062575 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec99b91-d59b-44b1-a774-36888dd97c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:39.063178 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec99b91-d59b-44b1-a774-36888dd97c94 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:39.063456 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec99b91-d59b-44b1-a774-36888dd97c94 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:39.063724 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec99b91-d59b-44b1-a774-36888dd97c94 None admin] PATH_INFO: `/v3/services` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:39.064281 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f88f60d-e017-4757-a855-dffe7c1279c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:39.064401 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec99b91-d59b-44b1-a774-36888dd97c94 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:39.064645 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec99b91-d59b-44b1-a774-36888dd97c94 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:39.064889 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f88f60d-e017-4757-a855-dffe7c1279c0 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:39.065201 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f88f60d-e017-4757-a855-dffe7c1279c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:39.065475 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f88f60d-e017-4757-a855-dffe7c1279c0 None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:39.066048 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec99b91-d59b-44b1-a774-36888dd97c94 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:39.066143 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f88f60d-e017-4757-a855-dffe7c1279c0 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:39.066396 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f88f60d-e017-4757-a855-dffe7c1279c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:39.068106 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f88f60d-e017-4757-a855-dffe7c1279c0 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:39.071817 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 488/998] 10.222.0.27 () {56 vars in 1122 bytes} [Wed Aug 10 09:51:38 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 09:51:39.078067 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 511/999] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Aug 10 09:51:38 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 09:51:39.078585 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec99b91-d59b-44b1-a774-36888dd97c94 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:39.078765 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f88f60d-e017-4757-a855-dffe7c1279c0 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:39.177200 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f88f60d-e017-4757-a855-dffe7c1279c0 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:39.188937 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec99b91-d59b-44b1-a774-36888dd97c94 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:39.212678 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57444563-c197-42f8-9e56-aca2496147fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:39.213334 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57444563-c197-42f8-9e56-aca2496147fc None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:39.213613 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57444563-c197-42f8-9e56-aca2496147fc None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:39.213879 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57444563-c197-42f8-9e56-aca2496147fc None admin] PATH_INFO: `/v3/endpoints` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:39.214575 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57444563-c197-42f8-9e56-aca2496147fc None admin] RBAC: Adding query filter params (interface=public, service_id=33cf3a7a7cf24c6ca54a42a3eb31fb7c, region_id=RegionOne) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:39.214871 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57444563-c197-42f8-9e56-aca2496147fc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:39.216226 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57444563-c197-42f8-9e56-aca2496147fc None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:39.221318 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 512/1000] 10.222.0.27 () {56 vars in 1251 bytes} [Wed Aug 10 09:51:39 2022] GET /identity/v3/endpoints?service_id=33cf3a7a7cf24c6ca54a42a3eb31fb7c&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:39.226674 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3549a82-d0de-42a4-8240-fd0d3afdbda8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:39.226910 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57444563-c197-42f8-9e56-aca2496147fc None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:39.227685 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3549a82-d0de-42a4-8240-fd0d3afdbda8 None admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:39.228139 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3549a82-d0de-42a4-8240-fd0d3afdbda8 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:39.228587 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3549a82-d0de-42a4-8240-fd0d3afdbda8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:39.229559 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3549a82-d0de-42a4-8240-fd0d3afdbda8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:39.231234 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3549a82-d0de-42a4-8240-fd0d3afdbda8 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:39.245104 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:39.261190 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 489/1001] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 10 09:51:39 2022] POST /identity/v3/endpoints => generated 325 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 09:51:39.351262 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57444563-c197-42f8-9e56-aca2496147fc None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:39.394900 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a024eb-6191-43c2-ad65-2a1d23a3dd50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:39.395514 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a024eb-6191-43c2-ad65-2a1d23a3dd50 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:39.395783 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a024eb-6191-43c2-ad65-2a1d23a3dd50 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:39.396050 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a024eb-6191-43c2-ad65-2a1d23a3dd50 None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:39.396845 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a024eb-6191-43c2-ad65-2a1d23a3dd50 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:39.398251 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a024eb-6191-43c2-ad65-2a1d23a3dd50 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:39.405426 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 513/1002] 10.222.0.27 () {56 vars in 1087 bytes} [Wed Aug 10 09:51:39 2022] GET /identity/v3/services => generated 1727 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 09:51:39.821195 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fa7ce8-447f-4c77-9578-2f3a833bbef1 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:39.821752 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fa7ce8-447f-4c77-9578-2f3a833bbef1 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:39.821752 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fa7ce8-447f-4c77-9578-2f3a833bbef1 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:39.823231 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 490/1003] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:51:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:51:39.828282 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696f6a9c-362d-44f5-a526-a22fc9d59efa None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:39.828741 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696f6a9c-362d-44f5-a526-a22fc9d59efa None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:39.828821 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696f6a9c-362d-44f5-a526-a22fc9d59efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:39.847034 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-696f6a9c-362d-44f5-a526-a22fc9d59efa None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:51:39.848198 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-696f6a9c-362d-44f5-a526-a22fc9d59efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:51:39.914596 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 514/1004] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:51:39 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 09:51:39.935793 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fa7ce8-447f-4c77-9578-2f3a833bbef1 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:39.949811 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:40.048691 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fa7ce8-447f-4c77-9578-2f3a833bbef1 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:40.093699 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9329c93-1e01-4732-8405-2c808911c138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:40.094455 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9329c93-1e01-4732-8405-2c808911c138 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:40.094728 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9329c93-1e01-4732-8405-2c808911c138 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:40.094989 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9329c93-1e01-4732-8405-2c808911c138 None admin] PATH_INFO: `/v3/services/image` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:40.095567 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9329c93-1e01-4732-8405-2c808911c138 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:40.097000 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9329c93-1e01-4732-8405-2c808911c138 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:40.108560 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-a9329c93-1e01-4732-8405-2c808911c138 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 10 09:51:40.108560 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:40.108560 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 09:51:40.108560 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 09:51:40.108560 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 09:51:40.108560 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 09:51:40.108560 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 09:51:40.108560 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 09:51:40.108560 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 10 09:51:40.108560 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:51:40.108560 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 09:51:40.108560 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:51:40.108560 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:40.108560 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:40.108560 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:40.108560 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:40.108560 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:40.109587 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:40.109587 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:40.109587 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:40.109587 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:40.109587 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:40.109587 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:40.109587 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 09:51:40.109587 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 09:51:40.109587 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 09:51:40.109587 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 09:51:40.109587 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:40.109587 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:40.109587 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:40.109587 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:40.109587 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:40.109587 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:40.115524 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:40.115524 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:40.115524 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:40.115524 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:40.115524 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:40.115524 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:40.115524 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:40.115524 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:40.115524 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:40.115524 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:40.115524 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 09:51:40.115524 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 09:51:40.115524 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 10 09:51:40.115524 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:51:40.115524 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 491/1005] 10.222.0.27 () {56 vars in 1105 bytes} [Wed Aug 10 09:51:39 2022] GET /identity/v3/services/image => generated 86 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:51:40.116329 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696f6a9c-362d-44f5-a526-a22fc9d59efa None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:40.126436 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:40.218820 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696f6a9c-362d-44f5-a526-a22fc9d59efa None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:40.251886 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9536e129-e052-4273-95e3-d1b26f136f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:40.252490 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9536e129-e052-4273-95e3-d1b26f136f71 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:40.252764 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9536e129-e052-4273-95e3-d1b26f136f71 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:40.253030 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9536e129-e052-4273-95e3-d1b26f136f71 None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:40.253685 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9536e129-e052-4273-95e3-d1b26f136f71 None admin] RBAC: Adding query filter params (name=image) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:40.253986 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9536e129-e052-4273-95e3-d1b26f136f71 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:40.255404 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9536e129-e052-4273-95e3-d1b26f136f71 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:40.264696 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 515/1006] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 10 09:51:40 2022] GET /identity/v3/services?name=image => generated 122 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:40.265929 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9329c93-1e01-4732-8405-2c808911c138 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:40.341047 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:40.367114 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9329c93-1e01-4732-8405-2c808911c138 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:40.403853 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a88265-aecd-4413-a13a-524baa68c237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:40.404778 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a88265-aecd-4413-a13a-524baa68c237 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:40.405222 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a88265-aecd-4413-a13a-524baa68c237 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:40.405687 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a88265-aecd-4413-a13a-524baa68c237 None admin] PATH_INFO: `/v3/services` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:40.406629 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a88265-aecd-4413-a13a-524baa68c237 None admin] RBAC: Adding query filter params (type=image) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:40.407081 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a88265-aecd-4413-a13a-524baa68c237 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:40.409277 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a88265-aecd-4413-a13a-524baa68c237 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:40.421115 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 492/1007] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 10 09:51:40 2022] GET /identity/v3/services?type=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 09:51:41.252041 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e415629-8a4b-49de-ba2d-63d3a1463c6f None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:41.252606 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e415629-8a4b-49de-ba2d-63d3a1463c6f None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:41.252606 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e415629-8a4b-49de-ba2d-63d3a1463c6f None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:41.253946 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 516/1008] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:51:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:51:41.259541 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff971870-d9e7-4718-9d0b-cc8132c41990 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:41.259977 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff971870-d9e7-4718-9d0b-cc8132c41990 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:41.260055 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff971870-d9e7-4718-9d0b-cc8132c41990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:41.278766 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-ff971870-d9e7-4718-9d0b-cc8132c41990 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:51:41.279953 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-ff971870-d9e7-4718-9d0b-cc8132c41990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:51:41.349542 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 493/1009] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:51:41 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 09:51:41.372067 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e415629-8a4b-49de-ba2d-63d3a1463c6f None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:41.416963 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbc4be4-5c4d-432d-9779-8c592b427e75 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:41.417301 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbc4be4-5c4d-432d-9779-8c592b427e75 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:41.417577 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbc4be4-5c4d-432d-9779-8c592b427e75 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:41.419060 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 494/1010] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:51:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 09:51:41.423715 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e314c70c-b6d9-4448-9744-2332ede7c020 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:41.423999 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e314c70c-b6d9-4448-9744-2332ede7c020 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:41.424277 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e314c70c-b6d9-4448-9744-2332ede7c020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:41.442185 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-e314c70c-b6d9-4448-9744-2332ede7c020 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:51:41.443845 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-e314c70c-b6d9-4448-9744-2332ede7c020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:51:41.448489 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:41.482766 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e415629-8a4b-49de-ba2d-63d3a1463c6f None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:41.517000 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:41.523348 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1968c8c9-654e-4e56-ab65-d7a8cfefaac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:41.525100 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1968c8c9-654e-4e56-ab65-d7a8cfefaac6 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:41.525238 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 495/1011] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:51:41 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 09:51:41.525322 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1968c8c9-654e-4e56-ab65-d7a8cfefaac6 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:41.525322 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1968c8c9-654e-4e56-ab65-d7a8cfefaac6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:41.525632 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1968c8c9-654e-4e56-ab65-d7a8cfefaac6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:41.527060 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1968c8c9-654e-4e56-ab65-d7a8cfefaac6 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:41.529107 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 517/1012] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 10 09:51:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:41.534427 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e314c70c-b6d9-4448-9744-2332ede7c020 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:41.550125 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1968c8c9-654e-4e56-ab65-d7a8cfefaac6 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:41.638604 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e314c70c-b6d9-4448-9744-2332ede7c020 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:41.656487 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1968c8c9-654e-4e56-ab65-d7a8cfefaac6 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:41.680260 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799832be-6f65-44b6-95aa-4a501844d31d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:41.680996 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799832be-6f65-44b6-95aa-4a501844d31d None admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:41.681270 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799832be-6f65-44b6-95aa-4a501844d31d None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:41.681543 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799832be-6f65-44b6-95aa-4a501844d31d None admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:41.682194 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799832be-6f65-44b6-95aa-4a501844d31d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:41.683666 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799832be-6f65-44b6-95aa-4a501844d31d None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:41.698532 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7daa77-16f3-4d22-b365-a343ffccd3de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:41.699239 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7daa77-16f3-4d22-b365-a343ffccd3de None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:41.699581 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7daa77-16f3-4d22-b365-a343ffccd3de None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:41.699924 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7daa77-16f3-4d22-b365-a343ffccd3de None admin] PATH_INFO: `/v3/services/compute` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:41.700576 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7daa77-16f3-4d22-b365-a343ffccd3de None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:41.702024 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7daa77-16f3-4d22-b365-a343ffccd3de None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:41.710978 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-df7daa77-16f3-4d22-b365-a343ffccd3de None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 10 09:51:41.710978 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:41.710978 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 09:51:41.710978 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 09:51:41.710978 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 09:51:41.710978 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 09:51:41.710978 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 09:51:41.710978 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 09:51:41.710978 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 10 09:51:41.710978 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:51:41.710978 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 09:51:41.710978 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:51:41.710978 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:41.710978 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:41.710978 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:41.710978 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:41.710978 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:41.712038 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:41.712038 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:41.712038 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:41.712038 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:41.712038 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:41.712038 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:41.712038 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 09:51:41.712038 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 09:51:41.712038 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 09:51:41.712038 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 09:51:41.712038 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:41.712038 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:41.712038 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:41.712038 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:41.712038 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:41.712038 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:41.718760 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:41.718760 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:41.718760 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:41.718760 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:41.718760 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:41.718760 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:41.718760 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:41.718760 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:41.718760 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:41.718760 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:41.718760 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 09:51:41.718760 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 09:51:41.718760 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 10 09:51:41.718760 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:51:41.718760 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 518/1013] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 10 09:51:41 2022] GET /identity/v3/services/compute => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 09:51:41.719570 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 496/1014] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Aug 10 09:51:41 2022] POST /identity/v3/projects => generated 311 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 09:51:41.719645 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7daa77-16f3-4d22-b365-a343ffccd3de None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:41.722710 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:41.831188 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7daa77-16f3-4d22-b365-a343ffccd3de None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:41.868460 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b3523d-6ccc-4dbb-a1d6-dbb6725e38bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:41.869148 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b3523d-6ccc-4dbb-a1d6-dbb6725e38bc None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:41.869429 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b3523d-6ccc-4dbb-a1d6-dbb6725e38bc None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:41.869696 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b3523d-6ccc-4dbb-a1d6-dbb6725e38bc None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:41.870312 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b3523d-6ccc-4dbb-a1d6-dbb6725e38bc None admin] RBAC: Adding query filter params (name=compute) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:41.870634 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b3523d-6ccc-4dbb-a1d6-dbb6725e38bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:41.871991 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b3523d-6ccc-4dbb-a1d6-dbb6725e38bc None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:41.876956 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 519/1015] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Aug 10 09:51:41 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 09:51:41.883095 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799832be-6f65-44b6-95aa-4a501844d31d None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:41.934558 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:41.985905 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799832be-6f65-44b6-95aa-4a501844d31d None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:42.020839 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a468291-9f0f-42fc-8e55-7cea90efe25b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:42.021639 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a468291-9f0f-42fc-8e55-7cea90efe25b None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:42.021923 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a468291-9f0f-42fc-8e55-7cea90efe25b None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:42.022200 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a468291-9f0f-42fc-8e55-7cea90efe25b None admin] PATH_INFO: `/v3/services` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:42.022868 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a468291-9f0f-42fc-8e55-7cea90efe25b None admin] RBAC: Adding query filter params (type=compute) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:42.023183 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a468291-9f0f-42fc-8e55-7cea90efe25b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:42.024627 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a468291-9f0f-42fc-8e55-7cea90efe25b None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:42.029843 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 497/1016] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Aug 10 09:51:41 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:42.035402 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b3523d-6ccc-4dbb-a1d6-dbb6725e38bc None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:42.102419 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:42.138192 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b3523d-6ccc-4dbb-a1d6-dbb6725e38bc None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:42.172027 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc0685f-cf7e-4206-9744-59f9fb7ef2e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:42.172650 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc0685f-cf7e-4206-9744-59f9fb7ef2e6 None admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:42.172926 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc0685f-cf7e-4206-9744-59f9fb7ef2e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:42.173233 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc0685f-cf7e-4206-9744-59f9fb7ef2e6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:42.173907 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc0685f-cf7e-4206-9744-59f9fb7ef2e6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:42.175281 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc0685f-cf7e-4206-9744-59f9fb7ef2e6 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:42.196907 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 520/1017] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 10 09:51:42 2022] POST /identity/v3/endpoints => generated 334 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 09:51:42.397395 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b481589-7618-4044-87a4-0385b0ed5a55 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:42.397901 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b481589-7618-4044-87a4-0385b0ed5a55 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:42.397901 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b481589-7618-4044-87a4-0385b0ed5a55 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:42.399185 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 498/1018] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:51:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:51:42.404380 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a741da5c-07fe-4ac2-bc86-f6c33bd199d9 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:42.404832 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a741da5c-07fe-4ac2-bc86-f6c33bd199d9 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:42.404938 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a741da5c-07fe-4ac2-bc86-f6c33bd199d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:42.423545 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-a741da5c-07fe-4ac2-bc86-f6c33bd199d9 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:51:42.424772 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-a741da5c-07fe-4ac2-bc86-f6c33bd199d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:51:42.499667 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 521/1019] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:51:42 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 09:51:42.522043 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b481589-7618-4044-87a4-0385b0ed5a55 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:42.629273 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b481589-7618-4044-87a4-0385b0ed5a55 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:42.643571 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:42.665018 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b867b55-e5ec-402b-a93a-1b126fc61b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:42.665555 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b867b55-e5ec-402b-a93a-1b126fc61b7a None admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:42.665850 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b867b55-e5ec-402b-a93a-1b126fc61b7a None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:42.666119 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b867b55-e5ec-402b-a93a-1b126fc61b7a None admin] PATH_INFO: `/v3/services` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:42.666772 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b867b55-e5ec-402b-a93a-1b126fc61b7a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:42.668188 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b867b55-e5ec-402b-a93a-1b126fc61b7a None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:42.697104 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 499/1020] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Aug 10 09:51:42 2022] POST /identity/v3/services => generated 242 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 09:51:43.728579 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3217dd62-3300-413c-aed5-22026a6ade68 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:43.729141 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3217dd62-3300-413c-aed5-22026a6ade68 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:43.729141 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3217dd62-3300-413c-aed5-22026a6ade68 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:43.730552 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 522/1021] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:51:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:51:43.735871 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec3d583-3da7-4da8-95f4-89327b938e3e None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:43.736295 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec3d583-3da7-4da8-95f4-89327b938e3e None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:43.736464 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec3d583-3da7-4da8-95f4-89327b938e3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:43.755202 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-6ec3d583-3da7-4da8-95f4-89327b938e3e None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:51:43.756521 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-6ec3d583-3da7-4da8-95f4-89327b938e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:51:43.835904 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 500/1022] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:51:43 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 09:51:43.860416 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3217dd62-3300-413c-aed5-22026a6ade68 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:43.929181 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:43.995500 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3217dd62-3300-413c-aed5-22026a6ade68 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:44.030180 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20974c67-0ddb-44ea-90ba-64221852127b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:44.030813 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20974c67-0ddb-44ea-90ba-64221852127b None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:44.031095 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20974c67-0ddb-44ea-90ba-64221852127b None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:44.031373 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20974c67-0ddb-44ea-90ba-64221852127b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:44.032475 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20974c67-0ddb-44ea-90ba-64221852127b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:44.033950 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20974c67-0ddb-44ea-90ba-64221852127b None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:44.035943 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 523/1023] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 10 09:51:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:44.041732 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec3d583-3da7-4da8-95f4-89327b938e3e None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:44.142561 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:44.146097 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec3d583-3da7-4da8-95f4-89327b938e3e None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:44.183121 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742a0a92-5521-4763-90b7-0dc6d689e80e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:44.183646 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742a0a92-5521-4763-90b7-0dc6d689e80e None admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:44.183925 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742a0a92-5521-4763-90b7-0dc6d689e80e None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:44.184197 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742a0a92-5521-4763-90b7-0dc6d689e80e None admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:44.184837 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742a0a92-5521-4763-90b7-0dc6d689e80e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:44.186336 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742a0a92-5521-4763-90b7-0dc6d689e80e None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:44.212833 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 501/1024] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Aug 10 09:51:44 2022] POST /identity/v3/users => generated 285 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 09:51:44.334251 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15352b36-8ce8-4bce-970a-7fe26ca7e119 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:44.334530 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15352b36-8ce8-4bce-970a-7fe26ca7e119 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:44.334777 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15352b36-8ce8-4bce-970a-7fe26ca7e119 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:44.336420 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 524/1025] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:51:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:51:44.341998 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b293e3b0-5a7e-4f6b-9632-a45c8eec0d84 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:44.342293 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b293e3b0-5a7e-4f6b-9632-a45c8eec0d84 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:44.342557 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b293e3b0-5a7e-4f6b-9632-a45c8eec0d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:44.362479 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-b293e3b0-5a7e-4f6b-9632-a45c8eec0d84 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:51:44.363641 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-b293e3b0-5a7e-4f6b-9632-a45c8eec0d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:51:44.437546 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 502/1026] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:51:44 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 09:51:44.460904 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15352b36-8ce8-4bce-970a-7fe26ca7e119 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:44.566850 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15352b36-8ce8-4bce-970a-7fe26ca7e119 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:44.585399 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:44.606307 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515c24fa-8d4e-4437-9b81-47558e7776eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:44.606946 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515c24fa-8d4e-4437-9b81-47558e7776eb None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:44.607226 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515c24fa-8d4e-4437-9b81-47558e7776eb None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:44.607498 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515c24fa-8d4e-4437-9b81-47558e7776eb None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:44.620000 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515c24fa-8d4e-4437-9b81-47558e7776eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 09:51:44.624668 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-515c24fa-8d4e-4437-9b81-47558e7776eb None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 10 09:51:44.624668 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:44.624668 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:44.624668 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:44.624668 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:44.624668 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:44.624668 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:44.624668 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:44.624668 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:44.624668 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:44.624668 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:44.624668 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:44.624668 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 09:51:44.624668 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 09:51:44.624668 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 09:51:44.624668 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 09:51:44.625640 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 09:51:44.625640 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 09:51:44.625640 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 09:51:44.625640 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 09:51:44.625640 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:44.625640 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:44.625640 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:44.625640 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:44.625640 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:44.625640 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:44.625640 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:44.625640 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:44.625640 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:44.625640 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:44.625640 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:44.625640 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:44.631657 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:44.631657 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:44.631657 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:44.631657 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:44.631657 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 09:51:44.631657 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 09:51:44.631657 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 09:51:44.631657 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 09:51:44.631657 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 09:51:44.631657 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 09:51:44.631657 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 10 09:51:44.631657 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:51:44.631657 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 525/1027] 10.222.0.27 () {56 vars in 1120 bytes} [Wed Aug 10 09:51:44 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:51:44.633954 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b293e3b0-5a7e-4f6b-9632-a45c8eec0d84 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:44.720662 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0645a2-0915-4948-815d-e70776c4d2a5 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:44.721019 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0645a2-0915-4948-815d-e70776c4d2a5 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:44.721274 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0645a2-0915-4948-815d-e70776c4d2a5 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:44.723104 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 526/1028] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:51:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:51:44.728148 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec90fed-1e08-4a08-a998-6503ed041490 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:44.728434 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec90fed-1e08-4a08-a998-6503ed041490 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:44.728711 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec90fed-1e08-4a08-a998-6503ed041490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:44.729299 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:44.745818 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b293e3b0-5a7e-4f6b-9632-a45c8eec0d84 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:44.747727 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-fec90fed-1e08-4a08-a998-6503ed041490 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:51:44.748927 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-fec90fed-1e08-4a08-a998-6503ed041490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:51:44.782062 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aaf0cd-17f4-4be9-a186-486f244f275f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:44.782940 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aaf0cd-17f4-4be9-a186-486f244f275f None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:44.783377 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aaf0cd-17f4-4be9-a186-486f244f275f None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:44.783875 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aaf0cd-17f4-4be9-a186-486f244f275f None admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:44.784804 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90aaf0cd-17f4-4be9-a186-486f244f275f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:44.785134 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90aaf0cd-17f4-4be9-a186-486f244f275f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:44.786515 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90aaf0cd-17f4-4be9-a186-486f244f275f None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:44.795284 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 503/1029] 10.222.0.27 () {56 vars in 1115 bytes} [Wed Aug 10 09:51:44 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:44.800873 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aaf0cd-17f4-4be9-a186-486f244f275f None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:44.817273 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 527/1030] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:51:44 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 09:51:44.840049 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec90fed-1e08-4a08-a998-6503ed041490 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:44.908239 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aaf0cd-17f4-4be9-a186-486f244f275f None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:44.944246 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c27c4b-27f4-4912-a5d0-fcf2479c5b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:44.944886 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c27c4b-27f4-4912-a5d0-fcf2479c5b07 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:44.945194 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c27c4b-27f4-4912-a5d0-fcf2479c5b07 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:44.945472 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c27c4b-27f4-4912-a5d0-fcf2479c5b07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:44.946361 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec90fed-1e08-4a08-a998-6503ed041490 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:44.954551 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:44.956762 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c27c4b-27f4-4912-a5d0-fcf2479c5b07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:44.958723 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c27c4b-27f4-4912-a5d0-fcf2479c5b07 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:44.967132 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:44.974204 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-18c27c4b-27f4-4912-a5d0-fcf2479c5b07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:51:44.974204 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:44.974204 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:44.974204 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:44.974204 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:44.974204 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:44.974204 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:44.974204 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:44.974204 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:44.974204 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:44.974204 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:44.974204 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:44.974204 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 09:51:44.974204 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 09:51:44.974204 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 09:51:44.974204 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 09:51:44.975196 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:44.975196 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:44.975196 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:44.975196 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:44.975196 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:44.975196 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:44.975196 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:44.975196 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:44.975196 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:44.975196 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:44.975196 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:44.975196 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:44.975196 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:44.975196 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:44.975196 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:44.975196 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:44.975196 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 09:51:44.976106 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 09:51:44.976106 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:51:44.976106 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:51:44.976106 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 504/1031] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 10 09:51:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:51:44.981041 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c27c4b-27f4-4912-a5d0-fcf2479c5b07 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:44.989724 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2d08eb-f9ce-472c-a04a-7c181e9f8f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:44.990431 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2d08eb-f9ce-472c-a04a-7c181e9f8f78 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:44.990710 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2d08eb-f9ce-472c-a04a-7c181e9f8f78 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:44.990977 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2d08eb-f9ce-472c-a04a-7c181e9f8f78 None admin] PATH_INFO: `/v3/services/image` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:44.991571 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2d08eb-f9ce-472c-a04a-7c181e9f8f78 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:44.992950 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2d08eb-f9ce-472c-a04a-7c181e9f8f78 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:45.001933 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-ce2d08eb-f9ce-472c-a04a-7c181e9f8f78 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 10 09:51:45.001933 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:45.001933 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 09:51:45.001933 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 09:51:45.001933 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 09:51:45.001933 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 09:51:45.001933 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 09:51:45.001933 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 09:51:45.001933 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 10 09:51:45.001933 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:51:45.001933 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 09:51:45.001933 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:51:45.001933 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:45.001933 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:45.001933 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:45.001933 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:45.001933 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:45.002956 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:45.002956 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:45.002956 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:45.002956 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:45.002956 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:45.002956 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:45.002956 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 09:51:45.002956 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 09:51:45.002956 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 09:51:45.002956 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 09:51:45.002956 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:45.002956 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:45.002956 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:45.002956 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:45.002956 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:45.002956 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:45.003890 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:45.003890 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:45.003890 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:45.003890 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:45.003890 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:45.003890 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:45.003890 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:45.003890 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:45.003890 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:45.003890 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:45.003890 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 09:51:45.003890 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 09:51:45.003890 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 10 09:51:45.003890 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:51:45.003890 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 528/1032] 10.222.0.27 () {56 vars in 1105 bytes} [Wed Aug 10 09:51:44 2022] GET /identity/v3/services/image => generated 86 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 09:51:45.009269 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2d08eb-f9ce-472c-a04a-7c181e9f8f78 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:45.087077 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c27c4b-27f4-4912-a5d0-fcf2479c5b07 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:45.121319 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fe1604-4f74-402c-ad3a-2d0d49a91667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:45.121916 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fe1604-4f74-402c-ad3a-2d0d49a91667 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:45.122192 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fe1604-4f74-402c-ad3a-2d0d49a91667 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:45.122458 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fe1604-4f74-402c-ad3a-2d0d49a91667 None admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:45.123117 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fe1604-4f74-402c-ad3a-2d0d49a91667 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:45.123408 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fe1604-4f74-402c-ad3a-2d0d49a91667 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:45.123649 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2d08eb-f9ce-472c-a04a-7c181e9f8f78 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:45.124776 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fe1604-4f74-402c-ad3a-2d0d49a91667 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:45.141626 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 505/1033] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 10 09:51:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:45.142652 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fe1604-4f74-402c-ad3a-2d0d49a91667 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:45.158016 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bd5eb6-3d47-47cd-93a8-bfa0981a762d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:45.158980 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bd5eb6-3d47-47cd-93a8-bfa0981a762d None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:45.159266 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bd5eb6-3d47-47cd-93a8-bfa0981a762d None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:45.159702 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bd5eb6-3d47-47cd-93a8-bfa0981a762d None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:45.160322 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bd5eb6-3d47-47cd-93a8-bfa0981a762d None admin] RBAC: Adding query filter params (name=image) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:45.160624 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bd5eb6-3d47-47cd-93a8-bfa0981a762d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:45.162138 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bd5eb6-3d47-47cd-93a8-bfa0981a762d None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:45.167185 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 529/1034] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 10 09:51:45 2022] GET /identity/v3/services?name=image => generated 122 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:45.172587 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bd5eb6-3d47-47cd-93a8-bfa0981a762d None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:45.207909 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:45.208139 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:45.249661 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fe1604-4f74-402c-ad3a-2d0d49a91667 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:45.280165 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bd5eb6-3d47-47cd-93a8-bfa0981a762d None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:45.287337 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc27852a-3ad6-404d-80ac-6a0b1519ad09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:45.288009 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc27852a-3ad6-404d-80ac-6a0b1519ad09 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:45.288288 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc27852a-3ad6-404d-80ac-6a0b1519ad09 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:45.288557 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc27852a-3ad6-404d-80ac-6a0b1519ad09 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:45.295775 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc27852a-3ad6-404d-80ac-6a0b1519ad09 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:45.297290 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc27852a-3ad6-404d-80ac-6a0b1519ad09 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:45.308474 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-bc27852a-3ad6-404d-80ac-6a0b1519ad09 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 10 09:51:45.308474 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:45.308474 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:45.308474 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:45.308474 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:45.308474 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:45.308474 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:45.308474 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:45.308474 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:45.308474 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:45.308474 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:45.308474 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:45.308474 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 09:51:45.308474 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 09:51:45.308474 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 09:51:45.308474 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 09:51:45.309480 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:45.309480 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:45.309480 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 09:51:45.309480 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 09:51:45.309480 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 09:51:45.309480 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 09:51:45.309480 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:45.309480 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:45.309480 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:45.309480 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:45.309480 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:45.309480 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:45.309480 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:45.309480 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:45.309480 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:45.309480 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:45.309480 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:45.309480 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:45.310408 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:45.310408 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:45.310408 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 09:51:45.310408 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 09:51:45.310408 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 09:51:45.310408 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 09:51:45.310408 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 09:51:45.310408 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 09:51:45.310408 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 10 09:51:45.310408 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:51:45.310408 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 506/1035] 10.222.0.27 () {56 vars in 1093 bytes} [Wed Aug 10 09:51:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:51:45.315268 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc27852a-3ad6-404d-80ac-6a0b1519ad09 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:45.321730 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b7ddac-fd88-4e78-82d6-a8e23142cadf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:45.322355 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b7ddac-fd88-4e78-82d6-a8e23142cadf None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:45.322623 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b7ddac-fd88-4e78-82d6-a8e23142cadf None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:45.322893 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b7ddac-fd88-4e78-82d6-a8e23142cadf None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:45.323552 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b7ddac-fd88-4e78-82d6-a8e23142cadf None admin] RBAC: Adding query filter params (type=image) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:45.323855 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b7ddac-fd88-4e78-82d6-a8e23142cadf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:45.325245 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b7ddac-fd88-4e78-82d6-a8e23142cadf None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:45.331080 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 530/1036] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 10 09:51:45 2022] GET /identity/v3/services?type=image => generated 350 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 09:51:45.336859 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b7ddac-fd88-4e78-82d6-a8e23142cadf None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:45.423376 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc27852a-3ad6-404d-80ac-6a0b1519ad09 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:45.442520 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:45.451074 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:45.455511 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b7ddac-fd88-4e78-82d6-a8e23142cadf None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:45.457496 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce79e91-d38e-43fe-b9a5-3e0470cf6253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:45.458093 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce79e91-d38e-43fe-b9a5-3e0470cf6253 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:45.458368 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce79e91-d38e-43fe-b9a5-3e0470cf6253 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:45.458637 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce79e91-d38e-43fe-b9a5-3e0470cf6253 None admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:45.459429 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce79e91-d38e-43fe-b9a5-3e0470cf6253 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:45.459732 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce79e91-d38e-43fe-b9a5-3e0470cf6253 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:45.461200 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce79e91-d38e-43fe-b9a5-3e0470cf6253 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:45.478135 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 507/1037] 10.222.0.27 () {56 vars in 1133 bytes} [Wed Aug 10 09:51:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 09:51:45.483765 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce79e91-d38e-43fe-b9a5-3e0470cf6253 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:45.495904 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b09fd1-ca74-41ff-88f6-8287a1f72c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:45.496415 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b09fd1-ca74-41ff-88f6-8287a1f72c5b None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:45.496676 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b09fd1-ca74-41ff-88f6-8287a1f72c5b None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:45.496950 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b09fd1-ca74-41ff-88f6-8287a1f72c5b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:45.497690 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b09fd1-ca74-41ff-88f6-8287a1f72c5b None admin] RBAC: Adding query filter params (interface=public, service_id=4f3b6138161d4580a9b3ce59408f8af3, region_id=RegionOne) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:45.498001 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b09fd1-ca74-41ff-88f6-8287a1f72c5b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:45.499365 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b09fd1-ca74-41ff-88f6-8287a1f72c5b None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:45.504990 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 531/1038] 10.222.0.27 () {56 vars in 1251 bytes} [Wed Aug 10 09:51:45 2022] GET /identity/v3/endpoints?service_id=4f3b6138161d4580a9b3ce59408f8af3&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 09:51:45.510255 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b09fd1-ca74-41ff-88f6-8287a1f72c5b None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:45.591018 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce79e91-d38e-43fe-b9a5-3e0470cf6253 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:45.622400 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b09fd1-ca74-41ff-88f6-8287a1f72c5b None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:45.626893 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b727768-7f3a-4545-8fb3-f1ccc9120234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:45.627499 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b727768-7f3a-4545-8fb3-f1ccc9120234 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:45.627777 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b727768-7f3a-4545-8fb3-f1ccc9120234 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:45.628047 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b727768-7f3a-4545-8fb3-f1ccc9120234 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:45.655906 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4758fdda-5028-4676-8cc7-fe262dc67225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:45.656530 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4758fdda-5028-4676-8cc7-fe262dc67225 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:45.656818 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4758fdda-5028-4676-8cc7-fe262dc67225 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:45.657102 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4758fdda-5028-4676-8cc7-fe262dc67225 None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:45.657706 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4758fdda-5028-4676-8cc7-fe262dc67225 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:45.659072 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4758fdda-5028-4676-8cc7-fe262dc67225 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:45.666305 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 532/1039] 10.222.0.27 () {56 vars in 1087 bytes} [Wed Aug 10 09:51:45 2022] GET /identity/v3/services => generated 1957 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 09:51:45.688374 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:45.717015 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b727768-7f3a-4545-8fb3-f1ccc9120234 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:45.718852 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b727768-7f3a-4545-8fb3-f1ccc9120234 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:45.830286 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 508/1040] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 10 09:51:45 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 10 09:51:45.836013 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4758fdda-5028-4676-8cc7-fe262dc67225 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:45.867032 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:45.938640 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4758fdda-5028-4676-8cc7-fe262dc67225 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:45.974749 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5449edba-292a-4e33-952a-053471247998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:45.975432 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5449edba-292a-4e33-952a-053471247998 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:45.975709 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5449edba-292a-4e33-952a-053471247998 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:45.975981 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5449edba-292a-4e33-952a-053471247998 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:45.987745 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5449edba-292a-4e33-952a-053471247998 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:45.989252 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5449edba-292a-4e33-952a-053471247998 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:46.010319 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-5449edba-292a-4e33-952a-053471247998 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:51:46.010319 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:46.010319 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:46.010319 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:46.010319 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:46.010319 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:46.010319 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:46.010319 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:46.010319 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:46.010319 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:46.010319 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:46.010319 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:46.010319 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 09:51:46.010319 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 09:51:46.010319 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 09:51:46.010319 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 09:51:46.011432 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:46.011432 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:46.011432 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:46.011432 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:46.011432 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:46.011432 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:46.011432 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:46.011432 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:46.011432 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:46.011432 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:46.011432 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:46.011432 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:46.011432 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:46.011432 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:46.011432 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:46.011432 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:46.011432 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 09:51:46.012311 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 09:51:46.012311 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:51:46.012311 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:51:46.012493 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 533/1041] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 10 09:51:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 09:51:46.018480 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b727768-7f3a-4545-8fb3-f1ccc9120234 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:46.102881 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:46.126313 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b727768-7f3a-4545-8fb3-f1ccc9120234 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:46.162844 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad53e64-e7de-4706-b92d-ca9594a033bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:46.163450 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad53e64-e7de-4706-b92d-ca9594a033bf None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:46.163727 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad53e64-e7de-4706-b92d-ca9594a033bf None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:46.163998 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad53e64-e7de-4706-b92d-ca9594a033bf None admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:46.164638 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad53e64-e7de-4706-b92d-ca9594a033bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:46.164939 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad53e64-e7de-4706-b92d-ca9594a033bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:46.166349 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad53e64-e7de-4706-b92d-ca9594a033bf None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:46.178477 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 509/1042] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 10 09:51:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:46.184070 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5449edba-292a-4e33-952a-053471247998 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:46.267315 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:46.287629 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b66265-4276-4b91-a59e-535ddbfa8b7f None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:46.288036 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b66265-4276-4b91-a59e-535ddbfa8b7f None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:46.288433 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b66265-4276-4b91-a59e-535ddbfa8b7f None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:46.290055 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 510/1043] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:51:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 09:51:46.291557 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5449edba-292a-4e33-952a-053471247998 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:46.298331 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f9cce-4e9f-477c-9049-0580280a9ce8 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:46.298617 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f9cce-4e9f-477c-9049-0580280a9ce8 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:46.298884 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f9cce-4e9f-477c-9049-0580280a9ce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:46.318170 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-5c9f9cce-4e9f-477c-9049-0580280a9ce8 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:51:46.319714 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-5c9f9cce-4e9f-477c-9049-0580280a9ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:51:46.336207 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54291c23-a087-4931-b49a-238c3d1a6ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:46.336847 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54291c23-a087-4931-b49a-238c3d1a6ed6 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:46.337167 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54291c23-a087-4931-b49a-238c3d1a6ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:46.337439 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54291c23-a087-4931-b49a-238c3d1a6ed6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:46.344487 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54291c23-a087-4931-b49a-238c3d1a6ed6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:46.345983 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54291c23-a087-4931-b49a-238c3d1a6ed6 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:46.357214 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-54291c23-a087-4931-b49a-238c3d1a6ed6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 09:51:46.357214 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:46.357214 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:46.357214 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:46.357214 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:46.357214 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:46.357214 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:46.357214 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:46.357214 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:46.357214 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:46.357214 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:46.357214 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:46.357214 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 09:51:46.357214 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 09:51:46.357214 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 09:51:46.358094 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 09:51:46.358094 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:46.358094 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:46.358094 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:46.358094 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:46.358094 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:46.358094 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:46.358094 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:46.358094 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:46.358094 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:46.358094 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:46.358094 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:46.358094 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:46.358094 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:46.358094 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:46.358094 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:46.358094 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:46.359002 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 09:51:46.359002 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 09:51:46.359002 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 09:51:46.359002 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 09:51:46.359002 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 09:51:46.359002 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 09:51:46.359002 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 09:51:46.359002 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:51:46.359002 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 534/1044] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 10 09:51:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:51:46.364161 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54291c23-a087-4931-b49a-238c3d1a6ed6 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:46.395339 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 511/1045] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:51:46 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 09:51:46.418075 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9f9cce-4e9f-477c-9049-0580280a9ce8 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:46.474572 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54291c23-a087-4931-b49a-238c3d1a6ed6 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:46.486078 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:46.516257 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c3cb02-1c8a-47c7-8a16-1fea3952f36c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:46.517020 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c3cb02-1c8a-47c7-8a16-1fea3952f36c None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:46.517719 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c3cb02-1c8a-47c7-8a16-1fea3952f36c None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:46.517998 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c3cb02-1c8a-47c7-8a16-1fea3952f36c None admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:46.518953 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c3cb02-1c8a-47c7-8a16-1fea3952f36c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:46.519262 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c3cb02-1c8a-47c7-8a16-1fea3952f36c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:46.520162 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9f9cce-4e9f-477c-9049-0580280a9ce8 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:46.520819 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c3cb02-1c8a-47c7-8a16-1fea3952f36c None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:46.529861 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:46.541261 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 535/1046] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Aug 10 09:51:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 09:51:46.543460 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c3cb02-1c8a-47c7-8a16-1fea3952f36c None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:46.562859 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cda88f4-3a49-4543-a4e4-79d71c22cf95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:46.563504 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda88f4-3a49-4543-a4e4-79d71c22cf95 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:46.563793 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda88f4-3a49-4543-a4e4-79d71c22cf95 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:46.564062 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda88f4-3a49-4543-a4e4-79d71c22cf95 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:46.574893 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cda88f4-3a49-4543-a4e4-79d71c22cf95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 09:51:46.579608 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-9cda88f4-3a49-4543-a4e4-79d71c22cf95 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 09:51:46.579608 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:46.579608 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:46.579608 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:46.579608 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:46.579608 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:46.579608 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:46.579608 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:46.579608 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:46.579608 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:46.579608 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:46.579608 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:46.579608 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 09:51:46.579608 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 09:51:46.579608 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 09:51:46.579608 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 09:51:46.580551 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 09:51:46.580551 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 09:51:46.580551 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 09:51:46.580551 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 09:51:46.580551 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:46.580551 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:46.580551 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:46.580551 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:46.580551 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:46.580551 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:46.580551 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:46.580551 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:46.580551 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:46.580551 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:46.580551 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:46.580551 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:46.581432 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:46.581432 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:46.581432 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:46.581432 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:46.581432 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 09:51:46.581432 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 09:51:46.581432 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 09:51:46.581432 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 09:51:46.581432 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 09:51:46.581432 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 09:51:46.581432 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 09:51:46.581432 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:51:46.585853 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 512/1047] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Aug 10 09:51:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 09:51:46.586783 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cda88f4-3a49-4543-a4e4-79d71c22cf95 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:46.649112 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c3cb02-1c8a-47c7-8a16-1fea3952f36c None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:46.689261 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cda88f4-3a49-4543-a4e4-79d71c22cf95 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:46.695702 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cad784d-fde3-4318-84e8-aa048a3881ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:46.696458 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cad784d-fde3-4318-84e8-aa048a3881ed None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:46.696828 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cad784d-fde3-4318-84e8-aa048a3881ed None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:46.697238 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cad784d-fde3-4318-84e8-aa048a3881ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:46.698068 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cad784d-fde3-4318-84e8-aa048a3881ed None admin] RBAC: Adding query filter params (role.id=0dd53da12ae74208933c961c29f12ec0, scope.project.id=d47d5b72a00642a1a239b785110643ef, user.id=dd8580888cba41a88566da4540b1130c) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:46.698438 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cad784d-fde3-4318-84e8-aa048a3881ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:46.699936 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cad784d-fde3-4318-84e8-aa048a3881ed None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:46.705779 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 536/1048] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 10 09:51:46 2022] GET /identity/v3/role_assignments?user.id=dd8580888cba41a88566da4540b1130c&scope.project.id=d47d5b72a00642a1a239b785110643ef&role.id=0dd53da12ae74208933c961c29f12ec0 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 09:51:46.730327 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:46.739905 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2636b965-26c8-41d1-b213-5c7082c9e809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:46.740831 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2636b965-26c8-41d1-b213-5c7082c9e809 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:46.741154 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2636b965-26c8-41d1-b213-5c7082c9e809 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:46.741432 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2636b965-26c8-41d1-b213-5c7082c9e809 None admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:46.742131 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2636b965-26c8-41d1-b213-5c7082c9e809 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:46.742437 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2636b965-26c8-41d1-b213-5c7082c9e809 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:46.744418 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2636b965-26c8-41d1-b213-5c7082c9e809 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:46.754046 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 513/1049] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 10 09:51:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:46.760022 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cad784d-fde3-4318-84e8-aa048a3881ed None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:46.831432 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:46.875307 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cad784d-fde3-4318-84e8-aa048a3881ed None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:46.909340 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c1bd15-830d-40a9-a6b2-514c2f74473e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:46.909888 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c1bd15-830d-40a9-a6b2-514c2f74473e None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:46.910164 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c1bd15-830d-40a9-a6b2-514c2f74473e None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:46.910430 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c1bd15-830d-40a9-a6b2-514c2f74473e None admin] PATH_INFO: `/v3/users/110851cbe2214cffa24c27ec974336ed` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:46.923933 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c1bd15-830d-40a9-a6b2-514c2f74473e None admin] RBAC: Authorizing `identity:get_user(user_id=110851cbe2214cffa24c27ec974336ed)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:46.925400 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c1bd15-830d-40a9-a6b2-514c2f74473e None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:46.927253 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 537/1050] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 10 09:51:46 2022] GET /identity/v3/users/110851cbe2214cffa24c27ec974336ed => generated 285 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:46.932942 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2636b965-26c8-41d1-b213-5c7082c9e809 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:47.033585 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2636b965-26c8-41d1-b213-5c7082c9e809 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:47.068304 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a4e685-ff14-4ac9-bfc1-52f9c40a6285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:47.068917 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a4e685-ff14-4ac9-bfc1-52f9c40a6285 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:47.069220 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a4e685-ff14-4ac9-bfc1-52f9c40a6285 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:47.069489 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a4e685-ff14-4ac9-bfc1-52f9c40a6285 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:47.125289 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:47.136971 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a4e685-ff14-4ac9-bfc1-52f9c40a6285 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:47.138472 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a4e685-ff14-4ac9-bfc1-52f9c40a6285 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:47.236458 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 514/1051] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 10 09:51:46 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 09:51:47.242528 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c1bd15-830d-40a9-a6b2-514c2f74473e None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:47.341587 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c1bd15-830d-40a9-a6b2-514c2f74473e None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:47.362653 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:47.383383 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaef693c-8c1b-4367-b474-3a27b51458e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:47.384313 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaef693c-8c1b-4367-b474-3a27b51458e4 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:47.384725 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaef693c-8c1b-4367-b474-3a27b51458e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:47.385146 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaef693c-8c1b-4367-b474-3a27b51458e4 None admin] PATH_INFO: `/v3/projects/95fd9df34ab14a12b8b04c4fc3ebfb44` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:47.386842 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaef693c-8c1b-4367-b474-3a27b51458e4 None admin] RBAC: Authorizing `identity:get_project(project_id=95fd9df34ab14a12b8b04c4fc3ebfb44)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:47.388988 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaef693c-8c1b-4367-b474-3a27b51458e4 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:47.396527 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 538/1052] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 10 09:51:47 2022] GET /identity/v3/projects/95fd9df34ab14a12b8b04c4fc3ebfb44 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:47.398140 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a4e685-ff14-4ac9-bfc1-52f9c40a6285 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:47.491544 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:47.502714 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a4e685-ff14-4ac9-bfc1-52f9c40a6285 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:47.536166 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635d06b4-45b8-4038-bcb9-6ffae2dbfa68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:47.536762 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635d06b4-45b8-4038-bcb9-6ffae2dbfa68 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:47.537097 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635d06b4-45b8-4038-bcb9-6ffae2dbfa68 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:47.537390 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635d06b4-45b8-4038-bcb9-6ffae2dbfa68 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:47.538117 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635d06b4-45b8-4038-bcb9-6ffae2dbfa68 None admin] RBAC: Adding query filter params (role.id=eb04edc46b3742d7a0f0ead26f68bc22, scope.project.id=95fd9df34ab14a12b8b04c4fc3ebfb44, user.id=110851cbe2214cffa24c27ec974336ed) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:47.538423 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635d06b4-45b8-4038-bcb9-6ffae2dbfa68 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:47.539846 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635d06b4-45b8-4038-bcb9-6ffae2dbfa68 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:47.545539 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 515/1053] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 10 09:51:47 2022] GET /identity/v3/role_assignments?user.id=110851cbe2214cffa24c27ec974336ed&scope.project.id=95fd9df34ab14a12b8b04c4fc3ebfb44&role.id=eb04edc46b3742d7a0f0ead26f68bc22 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:47.694020 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5f1c7b-6540-4d86-942b-fde980a568cb None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:47.694309 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5f1c7b-6540-4d86-942b-fde980a568cb None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:47.694775 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5f1c7b-6540-4d86-942b-fde980a568cb None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:47.696165 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 539/1054] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:51:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:51:47.701651 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74980975-6cd5-4f77-a379-821f2e82bf61 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:47.701934 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74980975-6cd5-4f77-a379-821f2e82bf61 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:47.702202 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74980975-6cd5-4f77-a379-821f2e82bf61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:47.721580 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-74980975-6cd5-4f77-a379-821f2e82bf61 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:51:47.722757 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-74980975-6cd5-4f77-a379-821f2e82bf61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:51:47.793201 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 516/1055] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:51:47 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 09:51:47.815963 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5f1c7b-6540-4d86-942b-fde980a568cb None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:47.922794 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5f1c7b-6540-4d86-942b-fde980a568cb None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:47.957155 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33061e9d-d824-433d-8ea6-93fc09ff1757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:47.957785 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33061e9d-d824-433d-8ea6-93fc09ff1757 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:47.958072 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33061e9d-d824-433d-8ea6-93fc09ff1757 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:47.958342 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33061e9d-d824-433d-8ea6-93fc09ff1757 None admin] PATH_INFO: `/v3/services/image` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:47.958995 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33061e9d-d824-433d-8ea6-93fc09ff1757 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:47.960366 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33061e9d-d824-433d-8ea6-93fc09ff1757 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:47.969184 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-33061e9d-d824-433d-8ea6-93fc09ff1757 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 10 09:51:47.969184 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:47.969184 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 09:51:47.969184 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 09:51:47.969184 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 09:51:47.969184 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 09:51:47.969184 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 09:51:47.969184 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 09:51:47.969184 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 10 09:51:47.969184 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:51:47.969184 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 09:51:47.969184 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:51:47.969184 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:47.969184 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:47.969184 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:47.969184 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:47.969184 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:47.970135 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:47.970135 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:47.970135 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:47.970135 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:47.970135 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:47.970135 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:47.970135 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 09:51:47.970135 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 09:51:47.970135 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 09:51:47.970135 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 09:51:47.970135 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:47.970135 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:47.970135 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:47.970135 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:47.970135 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:47.970135 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:47.971046 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:47.971046 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:47.971046 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:47.971046 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:47.971046 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:47.971046 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:47.971046 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:47.971046 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:47.971046 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:47.971046 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:47.971046 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 09:51:47.971046 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 09:51:47.971046 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 10 09:51:47.971046 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:51:47.973148 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 540/1056] 10.222.0.27 () {56 vars in 1105 bytes} [Wed Aug 10 09:51:47 2022] GET /identity/v3/services/image => generated 86 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:51:47.976737 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74980975-6cd5-4f77-a379-821f2e82bf61 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:48.061047 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:48.078451 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74980975-6cd5-4f77-a379-821f2e82bf61 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:48.114017 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49536563-b4ce-43a3-a1e1-25880e629093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:48.114622 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49536563-b4ce-43a3-a1e1-25880e629093 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:48.114902 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49536563-b4ce-43a3-a1e1-25880e629093 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:48.115174 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49536563-b4ce-43a3-a1e1-25880e629093 None admin] PATH_INFO: `/v3/services` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:48.115803 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49536563-b4ce-43a3-a1e1-25880e629093 None admin] RBAC: Adding query filter params (name=image) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:48.116106 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49536563-b4ce-43a3-a1e1-25880e629093 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:48.117516 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49536563-b4ce-43a3-a1e1-25880e629093 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:48.127236 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 517/1057] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 10 09:51:47 2022] GET /identity/v3/services?name=image => generated 122 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:48.128844 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33061e9d-d824-433d-8ea6-93fc09ff1757 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:48.183693 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:48.234636 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33061e9d-d824-433d-8ea6-93fc09ff1757 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:48.269084 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147d3b6e-a4e9-45f9-bca4-4e67410f2b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:48.269700 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147d3b6e-a4e9-45f9-bca4-4e67410f2b2d None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:48.269982 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147d3b6e-a4e9-45f9-bca4-4e67410f2b2d None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:48.270256 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147d3b6e-a4e9-45f9-bca4-4e67410f2b2d None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:48.270889 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147d3b6e-a4e9-45f9-bca4-4e67410f2b2d None admin] RBAC: Adding query filter params (type=image) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:48.271191 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147d3b6e-a4e9-45f9-bca4-4e67410f2b2d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:48.272676 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147d3b6e-a4e9-45f9-bca4-4e67410f2b2d None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:48.282771 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 541/1058] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 10 09:51:48 2022] GET /identity/v3/services?type=image => generated 350 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:48.283971 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49536563-b4ce-43a3-a1e1-25880e629093 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:48.383953 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49536563-b4ce-43a3-a1e1-25880e629093 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:48.416964 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8588329-f2bb-42ef-ab2e-1eeaad411337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:48.417593 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8588329-f2bb-42ef-ab2e-1eeaad411337 None admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:48.417880 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8588329-f2bb-42ef-ab2e-1eeaad411337 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:48.418156 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8588329-f2bb-42ef-ab2e-1eeaad411337 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:48.418806 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8588329-f2bb-42ef-ab2e-1eeaad411337 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:48.420188 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8588329-f2bb-42ef-ab2e-1eeaad411337 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:48.449095 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 518/1059] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 10 09:51:48 2022] POST /identity/v3/endpoints => generated 327 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 09:51:48.687794 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7533b5f-a1f0-401c-a3f4-b722342db17a None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:48.688103 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7533b5f-a1f0-401c-a3f4-b722342db17a None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:48.688294 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7533b5f-a1f0-401c-a3f4-b722342db17a None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:48.689920 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 542/1060] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:51:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:51:48.695309 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54357038-7a2a-452e-9f61-1075dbf9566b None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:48.695605 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54357038-7a2a-452e-9f61-1075dbf9566b None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:48.695850 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54357038-7a2a-452e-9f61-1075dbf9566b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:48.703305 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:48.717451 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-54357038-7a2a-452e-9f61-1075dbf9566b None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:51:48.718683 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-54357038-7a2a-452e-9f61-1075dbf9566b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:51:48.798709 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 519/1061] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:51:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 09:51:48.821779 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7533b5f-a1f0-401c-a3f4-b722342db17a None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:48.924339 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7533b5f-a1f0-401c-a3f4-b722342db17a None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:48.940922 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:48.960186 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40413fa3-6dcc-4a6b-9d05-7f2ba8ba1ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:48.960823 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40413fa3-6dcc-4a6b-9d05-7f2ba8ba1ef7 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:48.961121 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40413fa3-6dcc-4a6b-9d05-7f2ba8ba1ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:48.961392 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40413fa3-6dcc-4a6b-9d05-7f2ba8ba1ef7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:48.972707 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40413fa3-6dcc-4a6b-9d05-7f2ba8ba1ef7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 09:51:48.977458 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-40413fa3-6dcc-4a6b-9d05-7f2ba8ba1ef7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 10 09:51:48.977458 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:48.977458 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:48.977458 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:48.977458 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:48.977458 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:48.977458 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:48.977458 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:48.977458 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:48.977458 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:48.977458 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:48.977458 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:48.977458 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 09:51:48.977458 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 09:51:48.977458 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 09:51:48.977458 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 09:51:48.978385 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 09:51:48.978385 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 09:51:48.978385 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 09:51:48.978385 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 09:51:48.978385 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:48.978385 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:48.978385 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:48.978385 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:48.978385 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:48.978385 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:48.978385 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:48.978385 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:48.978385 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:48.978385 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:48.978385 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:48.978385 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:48.979263 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:48.979263 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:48.979263 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:48.979263 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:48.979263 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 09:51:48.979263 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 09:51:48.979263 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 09:51:48.979263 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 09:51:48.979263 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 09:51:48.979263 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 09:51:48.979263 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 10 09:51:48.979263 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:51:48.981395 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 543/1062] 10.222.0.27 () {56 vars in 1120 bytes} [Wed Aug 10 09:51:48 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:51:48.984777 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54357038-7a2a-452e-9f61-1075dbf9566b None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:49.085349 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54357038-7a2a-452e-9f61-1075dbf9566b None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:49.115709 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:49.122990 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e569614-8832-45f0-8345-42afca901b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:49.123680 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e569614-8832-45f0-8345-42afca901b62 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:49.124021 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e569614-8832-45f0-8345-42afca901b62 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:49.124357 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e569614-8832-45f0-8345-42afca901b62 None admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:49.125124 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e569614-8832-45f0-8345-42afca901b62 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:49.125498 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e569614-8832-45f0-8345-42afca901b62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:49.126946 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e569614-8832-45f0-8345-42afca901b62 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:49.135706 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 520/1063] 10.222.0.27 () {56 vars in 1115 bytes} [Wed Aug 10 09:51:48 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:49.141492 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40413fa3-6dcc-4a6b-9d05-7f2ba8ba1ef7 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:49.240920 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40413fa3-6dcc-4a6b-9d05-7f2ba8ba1ef7 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:49.274029 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11332e75-181b-4dec-9d0d-159ae6cdee83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:49.274704 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11332e75-181b-4dec-9d0d-159ae6cdee83 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:49.274961 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11332e75-181b-4dec-9d0d-159ae6cdee83 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:49.275231 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11332e75-181b-4dec-9d0d-159ae6cdee83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:49.286345 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11332e75-181b-4dec-9d0d-159ae6cdee83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:49.287835 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11332e75-181b-4dec-9d0d-159ae6cdee83 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:49.302113 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-11332e75-181b-4dec-9d0d-159ae6cdee83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:51:49.302113 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:49.302113 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:49.302113 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:49.302113 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:49.302113 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:49.302113 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:49.302113 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:49.302113 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:49.302113 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:49.302113 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:49.302113 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:49.302113 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 09:51:49.302113 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 09:51:49.302113 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 09:51:49.302113 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 09:51:49.303113 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:49.303113 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:49.303113 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:49.303113 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:49.303113 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:49.303113 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:49.303113 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:49.303113 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:49.303113 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:49.303113 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:49.303113 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:49.303113 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:49.303113 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:49.303113 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:49.303113 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:49.303113 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:49.303113 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 09:51:49.303978 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 09:51:49.303978 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:51:49.303978 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:51:49.305415 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 544/1064] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 10 09:51:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:51:49.309686 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e569614-8832-45f0-8345-42afca901b62 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:49.412472 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e569614-8832-45f0-8345-42afca901b62 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:49.449719 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265b6106-9084-44ca-9815-8ad6f313a989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:49.450414 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b6106-9084-44ca-9815-8ad6f313a989 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:49.450755 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b6106-9084-44ca-9815-8ad6f313a989 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:49.451090 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b6106-9084-44ca-9815-8ad6f313a989 None admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:49.451803 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265b6106-9084-44ca-9815-8ad6f313a989 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:49.452171 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265b6106-9084-44ca-9815-8ad6f313a989 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:49.453640 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265b6106-9084-44ca-9815-8ad6f313a989 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:49.469678 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 521/1065] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 10 09:51:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:49.470952 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11332e75-181b-4dec-9d0d-159ae6cdee83 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:49.499993 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:49.506055 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf76766c-fb5d-4fc3-aa73-a6165e8a5406 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:49.506437 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf76766c-fb5d-4fc3-aa73-a6165e8a5406 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:49.506778 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf76766c-fb5d-4fc3-aa73-a6165e8a5406 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:49.508376 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 522/1066] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:51:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 09:51:49.513354 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e23e9-57af-4f82-ad0c-19b04e269653 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:49.513639 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e23e9-57af-4f82-ad0c-19b04e269653 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:49.513914 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e23e9-57af-4f82-ad0c-19b04e269653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:49.531942 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-839e23e9-57af-4f82-ad0c-19b04e269653 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:51:49.533161 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-839e23e9-57af-4f82-ad0c-19b04e269653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:51:49.578066 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11332e75-181b-4dec-9d0d-159ae6cdee83 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:49.584992 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:49.609725 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 523/1067] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:51:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 09:51:49.616550 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7308aa0-23f8-4ef0-9225-8fdb3826b578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:49.617210 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7308aa0-23f8-4ef0-9225-8fdb3826b578 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:49.617496 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7308aa0-23f8-4ef0-9225-8fdb3826b578 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:49.617763 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7308aa0-23f8-4ef0-9225-8fdb3826b578 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:49.625492 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7308aa0-23f8-4ef0-9225-8fdb3826b578 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:49.626943 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7308aa0-23f8-4ef0-9225-8fdb3826b578 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:49.632147 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839e23e9-57af-4f82-ad0c-19b04e269653 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:49.638418 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-c7308aa0-23f8-4ef0-9225-8fdb3826b578 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 10 09:51:49.638418 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:49.638418 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:49.638418 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:49.638418 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:49.638418 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:49.638418 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:49.638418 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:49.638418 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:49.638418 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:49.638418 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:49.638418 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:49.638418 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 09:51:49.638418 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 09:51:49.638418 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 09:51:49.638418 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 09:51:49.639632 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:49.639632 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:49.639632 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 09:51:49.639632 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 09:51:49.639632 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 09:51:49.639632 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 09:51:49.639632 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:49.639632 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:49.639632 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:49.639632 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:49.639632 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:49.639632 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:49.639632 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:49.639632 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:49.639632 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:49.639632 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:49.639632 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:49.639632 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:49.640867 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:49.640867 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:49.640867 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 09:51:49.640867 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 09:51:49.640867 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 09:51:49.640867 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 09:51:49.640867 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 09:51:49.640867 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 09:51:49.640867 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 10 09:51:49.640867 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:51:49.640867 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 545/1068] 10.222.0.27 () {56 vars in 1093 bytes} [Wed Aug 10 09:51:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 09:51:49.645692 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7308aa0-23f8-4ef0-9225-8fdb3826b578 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:49.741909 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:49.748707 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839e23e9-57af-4f82-ad0c-19b04e269653 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:49.755060 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7308aa0-23f8-4ef0-9225-8fdb3826b578 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:49.785012 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0545961a-5081-49f3-a126-abf644f2664b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:49.785672 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0545961a-5081-49f3-a126-abf644f2664b None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:49.785948 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0545961a-5081-49f3-a126-abf644f2664b None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:49.786214 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0545961a-5081-49f3-a126-abf644f2664b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:49.788858 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe003e7-5890-41a7-ad39-ac009c5074e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:49.789486 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe003e7-5890-41a7-ad39-ac009c5074e7 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:49.789765 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe003e7-5890-41a7-ad39-ac009c5074e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:49.790037 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe003e7-5890-41a7-ad39-ac009c5074e7 None admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:49.790760 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe003e7-5890-41a7-ad39-ac009c5074e7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:49.791068 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe003e7-5890-41a7-ad39-ac009c5074e7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:49.792493 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe003e7-5890-41a7-ad39-ac009c5074e7 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:49.796623 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0545961a-5081-49f3-a126-abf644f2664b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 09:51:49.801290 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-0545961a-5081-49f3-a126-abf644f2664b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 09:51:49.801290 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:49.801290 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:49.801290 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:49.801290 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:49.801290 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:49.801290 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:49.801290 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:49.801290 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:49.801290 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:49.801290 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:49.801290 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:49.801290 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 09:51:49.801290 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 09:51:49.801290 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 09:51:49.801290 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 09:51:49.802207 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 09:51:49.802207 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 09:51:49.802207 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 09:51:49.802207 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 09:51:49.802207 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:49.802207 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:49.802207 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:49.802207 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:49.802207 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:49.802207 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:49.802207 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:49.802207 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:49.802207 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:49.802207 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:49.802207 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:49.802207 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:49.803151 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:49.803151 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:49.803151 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:49.803151 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:49.803151 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 09:51:49.803151 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 09:51:49.803151 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 09:51:49.803151 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 09:51:49.803151 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 09:51:49.803151 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 09:51:49.803151 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 09:51:49.803151 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:51:49.803151 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 524/1069] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Aug 10 09:51:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:51:49.808322 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0545961a-5081-49f3-a126-abf644f2664b None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:49.820115 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 546/1070] 10.222.0.27 () {56 vars in 1133 bytes} [Wed Aug 10 09:51:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 09:51:49.821884 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe003e7-5890-41a7-ad39-ac009c5074e7 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:49.858743 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:49.916224 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0545961a-5081-49f3-a126-abf644f2664b None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:49.930266 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe003e7-5890-41a7-ad39-ac009c5074e7 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:49.952854 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99da4f8f-1da8-40bf-96f5-529dc6f47015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:49.953497 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99da4f8f-1da8-40bf-96f5-529dc6f47015 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:49.954190 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99da4f8f-1da8-40bf-96f5-529dc6f47015 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:49.954467 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99da4f8f-1da8-40bf-96f5-529dc6f47015 None admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:49.955144 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99da4f8f-1da8-40bf-96f5-529dc6f47015 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:49.955448 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99da4f8f-1da8-40bf-96f5-529dc6f47015 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:49.956832 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99da4f8f-1da8-40bf-96f5-529dc6f47015 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:49.965331 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 525/1071] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 10 09:51:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 09:51:49.968425 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0082d03-71ef-4016-8e91-a601405e3a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:49.969189 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0082d03-71ef-4016-8e91-a601405e3a3f None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:49.969559 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0082d03-71ef-4016-8e91-a601405e3a3f None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:49.970177 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0082d03-71ef-4016-8e91-a601405e3a3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:49.970959 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99da4f8f-1da8-40bf-96f5-529dc6f47015 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:49.981715 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0082d03-71ef-4016-8e91-a601405e3a3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:49.983920 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0082d03-71ef-4016-8e91-a601405e3a3f None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:49.992428 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:50.000829 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-f0082d03-71ef-4016-8e91-a601405e3a3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:51:50.000829 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:50.000829 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:50.000829 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:50.000829 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:50.000829 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:50.000829 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:50.000829 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:50.000829 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:50.000829 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:50.000829 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:50.000829 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:50.000829 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 09:51:50.000829 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 09:51:50.000829 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 09:51:50.000829 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 09:51:50.001956 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:50.001956 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:50.001956 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:50.001956 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:50.001956 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:50.001956 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:50.001956 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:50.001956 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:50.001956 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:50.001956 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:50.001956 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:50.001956 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:50.001956 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:50.001956 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:50.001956 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:50.001956 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:50.001956 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 09:51:50.003067 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 09:51:50.003067 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:51:50.003067 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:51:50.003067 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 547/1072] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 10 09:51:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 09:51:50.009459 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0082d03-71ef-4016-8e91-a601405e3a3f None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:50.079771 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99da4f8f-1da8-40bf-96f5-529dc6f47015 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:50.082142 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:50.115419 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0082d03-71ef-4016-8e91-a601405e3a3f None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:50.116935 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58054b6c-0cce-49fa-a1f4-2aa69077dd10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:50.117610 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58054b6c-0cce-49fa-a1f4-2aa69077dd10 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:50.117945 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58054b6c-0cce-49fa-a1f4-2aa69077dd10 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:50.118853 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58054b6c-0cce-49fa-a1f4-2aa69077dd10 None admin] PATH_INFO: `/v3/users/110851cbe2214cffa24c27ec974336ed` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:50.119540 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58054b6c-0cce-49fa-a1f4-2aa69077dd10 None admin] RBAC: Authorizing `identity:get_user(user_id=110851cbe2214cffa24c27ec974336ed)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:50.121055 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58054b6c-0cce-49fa-a1f4-2aa69077dd10 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:50.122967 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 526/1073] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 10 09:51:49 2022] GET /identity/v3/users/110851cbe2214cffa24c27ec974336ed => generated 285 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:50.128784 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58054b6c-0cce-49fa-a1f4-2aa69077dd10 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:50.154785 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5590d447-e9bf-4205-8430-4c1c409d0cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:50.155402 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5590d447-e9bf-4205-8430-4c1c409d0cd4 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:50.155675 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5590d447-e9bf-4205-8430-4c1c409d0cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:50.155956 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5590d447-e9bf-4205-8430-4c1c409d0cd4 None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:50.156591 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5590d447-e9bf-4205-8430-4c1c409d0cd4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:50.156899 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5590d447-e9bf-4205-8430-4c1c409d0cd4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:50.158297 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5590d447-e9bf-4205-8430-4c1c409d0cd4 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:50.170039 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 548/1074] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 10 09:51:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:50.175672 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5590d447-e9bf-4205-8430-4c1c409d0cd4 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:50.236880 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58054b6c-0cce-49fa-a1f4-2aa69077dd10 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:50.237854 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:50.272951 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b74153-8347-4d54-b8da-07eb925d662f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:50.273740 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b74153-8347-4d54-b8da-07eb925d662f None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:50.274120 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b74153-8347-4d54-b8da-07eb925d662f None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:50.274356 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b74153-8347-4d54-b8da-07eb925d662f None admin] PATH_INFO: `/v3/projects/95fd9df34ab14a12b8b04c4fc3ebfb44` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:50.275715 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b74153-8347-4d54-b8da-07eb925d662f None admin] RBAC: Authorizing `identity:get_project(project_id=95fd9df34ab14a12b8b04c4fc3ebfb44)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:50.277196 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b74153-8347-4d54-b8da-07eb925d662f None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:50.283796 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 527/1075] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 10 09:51:50 2022] GET /identity/v3/projects/95fd9df34ab14a12b8b04c4fc3ebfb44 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:50.284857 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b74153-8347-4d54-b8da-07eb925d662f None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:50.288255 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5590d447-e9bf-4205-8430-4c1c409d0cd4 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:50.323535 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8556f0-70d1-4f85-8fcd-8fe2eb2c1086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:50.324254 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8556f0-70d1-4f85-8fcd-8fe2eb2c1086 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:50.324599 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8556f0-70d1-4f85-8fcd-8fe2eb2c1086 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:50.324937 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8556f0-70d1-4f85-8fcd-8fe2eb2c1086 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:50.327107 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:50.331922 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8556f0-70d1-4f85-8fcd-8fe2eb2c1086 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:50.333468 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8556f0-70d1-4f85-8fcd-8fe2eb2c1086 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:50.344545 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-8a8556f0-70d1-4f85-8fcd-8fe2eb2c1086 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 09:51:50.344545 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:50.344545 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:50.344545 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:50.344545 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:50.344545 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:50.344545 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:50.344545 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:50.344545 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:50.344545 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:50.344545 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:50.344545 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:50.344545 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 09:51:50.344545 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 09:51:50.344545 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 09:51:50.345689 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 09:51:50.345689 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:50.345689 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:50.345689 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:50.345689 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:50.345689 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:50.345689 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:50.345689 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:50.345689 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:50.345689 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:50.345689 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:50.345689 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:50.345689 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:50.345689 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:50.345689 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:50.345689 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:50.345689 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:50.346651 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 09:51:50.346651 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 09:51:50.346651 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 09:51:50.346651 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 09:51:50.346651 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 09:51:50.346651 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 09:51:50.346651 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 09:51:50.346651 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:51:50.346651 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 549/1076] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 10 09:51:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 09:51:50.352003 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8556f0-70d1-4f85-8fcd-8fe2eb2c1086 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:50.391117 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b74153-8347-4d54-b8da-07eb925d662f None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:50.424894 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e24ec02-42b4-4921-88eb-d0b921eb9bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:50.425571 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e24ec02-42b4-4921-88eb-d0b921eb9bd9 None admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:50.425849 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e24ec02-42b4-4921-88eb-d0b921eb9bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:50.426122 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e24ec02-42b4-4921-88eb-d0b921eb9bd9 None admin] PATH_INFO: `/v3/projects/95fd9df34ab14a12b8b04c4fc3ebfb44/users/110851cbe2214cffa24c27ec974336ed/roles/eb04edc46b3742d7a0f0ead26f68bc22` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:50.428070 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e24ec02-42b4-4921-88eb-d0b921eb9bd9 None admin] RBAC: Authorizing `identity:create_grant(project_id=95fd9df34ab14a12b8b04c4fc3ebfb44, user_id=110851cbe2214cffa24c27ec974336ed, role_id=eb04edc46b3742d7a0f0ead26f68bc22)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:50.429557 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e24ec02-42b4-4921-88eb-d0b921eb9bd9 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:50.457097 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 528/1077] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Aug 10 09:51:50 2022] PUT /identity/v3/projects/95fd9df34ab14a12b8b04c4fc3ebfb44/users/110851cbe2214cffa24c27ec974336ed/roles/eb04edc46b3742d7a0f0ead26f68bc22 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 09:51:50.457315 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8556f0-70d1-4f85-8fcd-8fe2eb2c1086 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:50.475537 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:50.491807 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a8da76-6463-4015-9a6d-aaae8f2c0fdf None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:50.492137 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a8da76-6463-4015-9a6d-aaae8f2c0fdf None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:50.492426 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a8da76-6463-4015-9a6d-aaae8f2c0fdf None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:50.494083 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 529/1078] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:51:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 09:51:50.495340 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64595dcf-dd48-464f-8ea3-f3cd656bf0bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:50.496032 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64595dcf-dd48-464f-8ea3-f3cd656bf0bb None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:50.496370 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64595dcf-dd48-464f-8ea3-f3cd656bf0bb None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:50.496699 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64595dcf-dd48-464f-8ea3-f3cd656bf0bb None admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:50.497500 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64595dcf-dd48-464f-8ea3-f3cd656bf0bb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:50.498082 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64595dcf-dd48-464f-8ea3-f3cd656bf0bb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:50.499385 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed7c13-ab73-4659-aa25-6b5f108aa124 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:50.499555 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64595dcf-dd48-464f-8ea3-f3cd656bf0bb None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:50.499650 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed7c13-ab73-4659-aa25-6b5f108aa124 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:50.499932 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed7c13-ab73-4659-aa25-6b5f108aa124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:50.513592 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 550/1079] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Aug 10 09:51:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 09:51:50.519640 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64595dcf-dd48-464f-8ea3-f3cd656bf0bb None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:50.520377 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-03ed7c13-ab73-4659-aa25-6b5f108aa124 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:51:50.521692 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-03ed7c13-ab73-4659-aa25-6b5f108aa124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:51:50.600469 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 530/1080] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:51:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 09:51:50.621996 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ed7c13-ab73-4659-aa25-6b5f108aa124 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:50.631830 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64595dcf-dd48-464f-8ea3-f3cd656bf0bb None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:50.652097 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:50.668153 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995bda25-10b2-43ca-b653-99132dccf441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:50.668828 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995bda25-10b2-43ca-b653-99132dccf441 None admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:50.669132 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995bda25-10b2-43ca-b653-99132dccf441 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:50.669417 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995bda25-10b2-43ca-b653-99132dccf441 None admin] PATH_INFO: `/v3/projects/d47d5b72a00642a1a239b785110643ef/users/dd8580888cba41a88566da4540b1130c/roles/0dd53da12ae74208933c961c29f12ec0` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:50.676286 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995bda25-10b2-43ca-b653-99132dccf441 None admin] RBAC: Authorizing `identity:create_grant(project_id=d47d5b72a00642a1a239b785110643ef, user_id=dd8580888cba41a88566da4540b1130c, role_id=0dd53da12ae74208933c961c29f12ec0)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:50.676286 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995bda25-10b2-43ca-b653-99132dccf441 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:50.697167 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 551/1081] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Aug 10 09:51:50 2022] PUT /identity/v3/projects/d47d5b72a00642a1a239b785110643ef/users/dd8580888cba41a88566da4540b1130c/roles/0dd53da12ae74208933c961c29f12ec0 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 09:51:50.747261 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ed7c13-ab73-4659-aa25-6b5f108aa124 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:50.786414 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5efd64e-ceef-4a18-9e2d-3ac014ee76c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:50.787075 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5efd64e-ceef-4a18-9e2d-3ac014ee76c5 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:50.787355 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5efd64e-ceef-4a18-9e2d-3ac014ee76c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:50.787624 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5efd64e-ceef-4a18-9e2d-3ac014ee76c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:50.860020 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5efd64e-ceef-4a18-9e2d-3ac014ee76c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:50.861461 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5efd64e-ceef-4a18-9e2d-3ac014ee76c5 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:50.891298 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:50.967101 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 531/1082] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 10 09:51:50 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 10 09:51:50.968448 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995bda25-10b2-43ca-b653-99132dccf441 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:51.010127 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:51.074917 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995bda25-10b2-43ca-b653-99132dccf441 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:51.110146 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238a33dd-1f6b-47a2-a37c-ff0dcba2ac81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:51.110847 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a33dd-1f6b-47a2-a37c-ff0dcba2ac81 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:51.111247 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a33dd-1f6b-47a2-a37c-ff0dcba2ac81 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:51.111589 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a33dd-1f6b-47a2-a37c-ff0dcba2ac81 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:51.121942 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238a33dd-1f6b-47a2-a37c-ff0dcba2ac81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:51.123504 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238a33dd-1f6b-47a2-a37c-ff0dcba2ac81 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:51.138121 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-238a33dd-1f6b-47a2-a37c-ff0dcba2ac81 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:51:51.138121 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:51.138121 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:51.138121 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:51.138121 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:51.138121 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:51.138121 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:51.138121 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:51.138121 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:51.138121 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:51.138121 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:51.138121 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:51.138121 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 09:51:51.138121 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 09:51:51.138121 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 09:51:51.138121 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 09:51:51.139274 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:51.139274 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:51.139274 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:51.139274 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:51.139274 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:51.139274 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:51.139274 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:51.139274 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:51.139274 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:51.139274 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:51.139274 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:51.139274 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:51.139274 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:51.139274 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:51.139274 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:51.139274 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:51.139274 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 09:51:51.140379 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 09:51:51.140379 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:51:51.140379 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:51:51.141636 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 552/1083] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 10 09:51:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:51:51.147583 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5efd64e-ceef-4a18-9e2d-3ac014ee76c5 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:51.247806 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5efd64e-ceef-4a18-9e2d-3ac014ee76c5 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:51.277171 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:51.284624 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61df8ecf-3132-4eff-a399-e88f70bc43dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:51.285271 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61df8ecf-3132-4eff-a399-e88f70bc43dc None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:51.285553 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61df8ecf-3132-4eff-a399-e88f70bc43dc None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:51.285821 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61df8ecf-3132-4eff-a399-e88f70bc43dc None admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:51.286469 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61df8ecf-3132-4eff-a399-e88f70bc43dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:51.286771 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61df8ecf-3132-4eff-a399-e88f70bc43dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:51.288196 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61df8ecf-3132-4eff-a399-e88f70bc43dc None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:51.299535 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 532/1084] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 10 09:51:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:52.426381 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaf4d1f-ce6c-4a32-8abb-37256fbee2d7 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:52.426988 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaf4d1f-ce6c-4a32-8abb-37256fbee2d7 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:52.426988 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaf4d1f-ce6c-4a32-8abb-37256fbee2d7 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:52.428333 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 553/1085] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:51:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:51:52.433876 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f20091-d0f6-469f-b03a-1fc426e853d1 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:52.434291 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f20091-d0f6-469f-b03a-1fc426e853d1 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:52.434431 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f20091-d0f6-469f-b03a-1fc426e853d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:52.454203 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-e3f20091-d0f6-469f-b03a-1fc426e853d1 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:51:52.455397 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-e3f20091-d0f6-469f-b03a-1fc426e853d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:51:52.523634 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 533/1086] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:51:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 09:51:52.546196 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaf4d1f-ce6c-4a32-8abb-37256fbee2d7 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:52.639373 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:52.651052 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaf4d1f-ce6c-4a32-8abb-37256fbee2d7 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:52.671486 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf73b151-d836-4cda-b13c-bb6ed427c0ff None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:52.671772 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf73b151-d836-4cda-b13c-bb6ed427c0ff None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:52.672020 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf73b151-d836-4cda-b13c-bb6ed427c0ff None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:52.673659 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 534/1087] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:51:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 09:51:52.680969 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48799a06-1c76-4813-ba6a-efd8c0429aa1 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:52.681284 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48799a06-1c76-4813-ba6a-efd8c0429aa1 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:52.681560 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48799a06-1c76-4813-ba6a-efd8c0429aa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:52.688878 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e123a76-3506-41c9-a987-a5b0a77e8795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:52.689552 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e123a76-3506-41c9-a987-a5b0a77e8795 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:52.689831 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e123a76-3506-41c9-a987-a5b0a77e8795 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:52.690099 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e123a76-3506-41c9-a987-a5b0a77e8795 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:52.699844 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-48799a06-1c76-4813-ba6a-efd8c0429aa1 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:51:52.701032 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-48799a06-1c76-4813-ba6a-efd8c0429aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:51:52.701542 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e123a76-3506-41c9-a987-a5b0a77e8795 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 09:51:52.706171 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-1e123a76-3506-41c9-a987-a5b0a77e8795 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 09:51:52.706171 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:52.706171 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:52.706171 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:52.706171 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:52.706171 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:52.706171 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:52.706171 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:52.706171 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:52.706171 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:52.706171 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:52.706171 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:52.706171 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 09:51:52.706171 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 09:51:52.706171 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 09:51:52.706171 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 09:51:52.707147 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 09:51:52.707147 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 09:51:52.707147 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 09:51:52.707147 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 09:51:52.707147 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:52.707147 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:52.707147 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:52.707147 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:52.707147 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:52.707147 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:52.707147 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:52.707147 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:52.707147 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:52.707147 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:52.707147 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:52.707147 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:52.708182 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:52.708182 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:52.708182 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:52.708182 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:52.708182 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 09:51:52.708182 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 09:51:52.708182 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 09:51:52.708182 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 09:51:52.708182 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 09:51:52.708182 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 09:51:52.708182 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 09:51:52.708182 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:51:52.708182 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 554/1088] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Aug 10 09:51:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:51:52.713408 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e123a76-3506-41c9-a987-a5b0a77e8795 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:52.765304 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 535/1089] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:51:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 09:51:52.788089 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48799a06-1c76-4813-ba6a-efd8c0429aa1 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:52.809235 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e123a76-3506-41c9-a987-a5b0a77e8795 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:52.835253 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:52.842495 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19da86e0-f491-4259-803a-7dd9fdca0336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:52.843097 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19da86e0-f491-4259-803a-7dd9fdca0336 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:52.843376 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19da86e0-f491-4259-803a-7dd9fdca0336 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:52.843642 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19da86e0-f491-4259-803a-7dd9fdca0336 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:52.844296 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19da86e0-f491-4259-803a-7dd9fdca0336 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:52.844578 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19da86e0-f491-4259-803a-7dd9fdca0336 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:52.845957 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19da86e0-f491-4259-803a-7dd9fdca0336 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:52.854650 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 555/1090] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 10 09:51:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:52.860371 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19da86e0-f491-4259-803a-7dd9fdca0336 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:52.874145 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:52.885216 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48799a06-1c76-4813-ba6a-efd8c0429aa1 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:52.919569 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb295ae-5773-4a27-b77c-2b88c1941ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:52.920181 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb295ae-5773-4a27-b77c-2b88c1941ae9 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:52.920456 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb295ae-5773-4a27-b77c-2b88c1941ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:52.920703 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb295ae-5773-4a27-b77c-2b88c1941ae9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:52.930936 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb295ae-5773-4a27-b77c-2b88c1941ae9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 09:51:52.935464 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-efb295ae-5773-4a27-b77c-2b88c1941ae9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 10 09:51:52.935464 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:52.935464 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:52.935464 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:52.935464 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:52.935464 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:52.935464 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:52.935464 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:52.935464 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:52.935464 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:52.935464 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:52.935464 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:52.935464 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 09:51:52.935464 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 09:51:52.935464 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 09:51:52.935464 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 09:51:52.936418 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 09:51:52.936418 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 09:51:52.936418 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 09:51:52.936418 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 09:51:52.936418 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:52.936418 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:52.936418 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:52.936418 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:52.936418 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:52.936418 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:52.936418 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:52.936418 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:52.936418 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:52.936418 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:52.936418 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:52.936418 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:52.937399 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:52.937399 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:52.937399 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:52.937399 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:52.937399 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 09:51:52.937399 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 09:51:52.937399 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 09:51:52.937399 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 09:51:52.937399 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 09:51:52.937399 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 09:51:52.937399 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 10 09:51:52.937399 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:51:52.941341 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 536/1091] 10.222.0.27 () {56 vars in 1120 bytes} [Wed Aug 10 09:51:52 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 09:51:52.942761 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb295ae-5773-4a27-b77c-2b88c1941ae9 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:52.959549 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19da86e0-f491-4259-803a-7dd9fdca0336 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:52.992415 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ce9b70-333d-49e3-aaed-2b1c7f0d35ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:52.992996 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ce9b70-333d-49e3-aaed-2b1c7f0d35ac None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:52.993326 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ce9b70-333d-49e3-aaed-2b1c7f0d35ac None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:52.993596 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ce9b70-333d-49e3-aaed-2b1c7f0d35ac None admin] PATH_INFO: `/v3/users/110851cbe2214cffa24c27ec974336ed` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:52.994716 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ce9b70-333d-49e3-aaed-2b1c7f0d35ac None admin] RBAC: Authorizing `identity:get_user(user_id=110851cbe2214cffa24c27ec974336ed)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:52.996166 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ce9b70-333d-49e3-aaed-2b1c7f0d35ac None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:52.997949 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 556/1092] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 10 09:51:52 2022] GET /identity/v3/users/110851cbe2214cffa24c27ec974336ed => generated 285 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 09:51:53.003489 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ce9b70-333d-49e3-aaed-2b1c7f0d35ac None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:53.040881 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb295ae-5773-4a27-b77c-2b88c1941ae9 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:53.051343 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:53.080742 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4818928d-e251-480e-821d-67908c4283fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:53.081608 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:53.081749 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4818928d-e251-480e-821d-67908c4283fe None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:53.082049 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4818928d-e251-480e-821d-67908c4283fe None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:53.082452 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4818928d-e251-480e-821d-67908c4283fe None admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:53.083458 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4818928d-e251-480e-821d-67908c4283fe None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:53.084088 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4818928d-e251-480e-821d-67908c4283fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:53.086239 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4818928d-e251-480e-821d-67908c4283fe None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:53.096757 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 537/1093] 10.222.0.27 () {56 vars in 1115 bytes} [Wed Aug 10 09:51:52 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:53.101630 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ce9b70-333d-49e3-aaed-2b1c7f0d35ac None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:53.102975 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4818928d-e251-480e-821d-67908c4283fe None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:53.140657 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7cbd94-e9aa-40f1-a062-78ec13f84f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:53.141272 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7cbd94-e9aa-40f1-a062-78ec13f84f89 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:53.141546 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7cbd94-e9aa-40f1-a062-78ec13f84f89 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:53.141807 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7cbd94-e9aa-40f1-a062-78ec13f84f89 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:53.201905 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4818928d-e251-480e-821d-67908c4283fe None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:53.207366 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7cbd94-e9aa-40f1-a062-78ec13f84f89 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:53.208878 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7cbd94-e9aa-40f1-a062-78ec13f84f89 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:53.234816 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d9d9ed-d4c2-4fc3-b83e-b71eb0478b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:53.235456 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d9d9ed-d4c2-4fc3-b83e-b71eb0478b72 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:53.235707 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d9d9ed-d4c2-4fc3-b83e-b71eb0478b72 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:53.236002 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d9d9ed-d4c2-4fc3-b83e-b71eb0478b72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:53.246454 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d9d9ed-d4c2-4fc3-b83e-b71eb0478b72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:53.247865 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d9d9ed-d4c2-4fc3-b83e-b71eb0478b72 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:53.261655 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-67d9d9ed-d4c2-4fc3-b83e-b71eb0478b72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:51:53.261655 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:53.261655 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:53.261655 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:53.261655 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:53.261655 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:53.261655 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:53.261655 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:53.261655 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:53.261655 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:53.261655 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:53.261655 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:53.261655 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 09:51:53.261655 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 09:51:53.261655 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 09:51:53.261655 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 09:51:53.262605 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:53.262605 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:53.262605 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:53.262605 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:53.262605 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:53.262605 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:53.262605 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:53.262605 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:53.262605 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:53.262605 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:53.262605 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:53.262605 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:53.262605 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:53.262605 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:53.262605 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:53.262605 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:53.262605 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 09:51:53.263494 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 09:51:53.263494 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:51:53.263494 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:51:53.263494 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 538/1094] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 10 09:51:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 09:51:53.268493 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d9d9ed-d4c2-4fc3-b83e-b71eb0478b72 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:53.284843 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:53.294914 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:53.305709 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 557/1095] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 10 09:51:53 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 10 09:51:53.311583 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7cbd94-e9aa-40f1-a062-78ec13f84f89 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:53.368421 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d9d9ed-d4c2-4fc3-b83e-b71eb0478b72 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:53.405691 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3885d338-7169-420d-9c52-ac8001ae1efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:53.406306 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3885d338-7169-420d-9c52-ac8001ae1efe None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:53.406411 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7cbd94-e9aa-40f1-a062-78ec13f84f89 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:53.406584 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3885d338-7169-420d-9c52-ac8001ae1efe None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:53.406856 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3885d338-7169-420d-9c52-ac8001ae1efe None admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:53.407504 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3885d338-7169-420d-9c52-ac8001ae1efe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:53.407810 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3885d338-7169-420d-9c52-ac8001ae1efe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:53.409225 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3885d338-7169-420d-9c52-ac8001ae1efe None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:53.420795 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 539/1096] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 10 09:51:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 09:51:53.426683 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3885d338-7169-420d-9c52-ac8001ae1efe None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:53.444618 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89cd39f-7378-4a0a-a684-84f13e733d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:53.445288 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89cd39f-7378-4a0a-a684-84f13e733d20 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:53.445562 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89cd39f-7378-4a0a-a684-84f13e733d20 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:53.445826 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89cd39f-7378-4a0a-a684-84f13e733d20 None admin] PATH_INFO: `/v3/projects/95fd9df34ab14a12b8b04c4fc3ebfb44` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:53.446958 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89cd39f-7378-4a0a-a684-84f13e733d20 None admin] RBAC: Authorizing `identity:get_project(project_id=95fd9df34ab14a12b8b04c4fc3ebfb44)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:53.448386 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89cd39f-7378-4a0a-a684-84f13e733d20 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:53.450056 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 558/1097] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 10 09:51:53 2022] GET /identity/v3/projects/95fd9df34ab14a12b8b04c4fc3ebfb44 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 09:51:53.456090 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89cd39f-7378-4a0a-a684-84f13e733d20 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:53.504150 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:53.511132 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:53.527566 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3885d338-7169-420d-9c52-ac8001ae1efe None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:53.554720 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89cd39f-7378-4a0a-a684-84f13e733d20 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:53.560443 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe461ae-2c00-4769-b8a1-a9cac3a9cdbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:53.561096 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe461ae-2c00-4769-b8a1-a9cac3a9cdbf None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:53.561379 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe461ae-2c00-4769-b8a1-a9cac3a9cdbf None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:53.561651 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe461ae-2c00-4769-b8a1-a9cac3a9cdbf None admin] PATH_INFO: `/v3/users/nova` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:53.569058 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe461ae-2c00-4769-b8a1-a9cac3a9cdbf None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:53.570535 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe461ae-2c00-4769-b8a1-a9cac3a9cdbf None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:53.581840 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-8fe461ae-2c00-4769-b8a1-a9cac3a9cdbf None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 10 09:51:53.581840 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:53.581840 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:53.581840 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:53.581840 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:53.581840 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:53.581840 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:53.581840 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:53.581840 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:53.581840 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:53.581840 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:53.581840 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:53.581840 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 09:51:53.581840 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 09:51:53.581840 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 09:51:53.581840 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 09:51:53.582743 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:53.582743 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:53.582743 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 09:51:53.582743 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 09:51:53.582743 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 09:51:53.582743 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 09:51:53.582743 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:53.582743 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:53.582743 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:53.582743 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:53.582743 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:53.582743 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:53.582743 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:53.582743 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:53.582743 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:53.582743 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:53.582743 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:53.582743 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:53.583707 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:53.583707 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:53.583707 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 09:51:53.583707 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 09:51:53.583707 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 09:51:53.583707 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 09:51:53.583707 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 09:51:53.583707 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 09:51:53.583707 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 10 09:51:53.583707 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:51:53.585229 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 540/1098] 10.222.0.27 () {56 vars in 1093 bytes} [Wed Aug 10 09:51:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 09:51:53.588696 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe461ae-2c00-4769-b8a1-a9cac3a9cdbf None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:53.588846 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e347b9-0454-4300-a1b1-c95cd0a0a3de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:53.589502 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e347b9-0454-4300-a1b1-c95cd0a0a3de None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:53.589775 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e347b9-0454-4300-a1b1-c95cd0a0a3de None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:53.590041 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e347b9-0454-4300-a1b1-c95cd0a0a3de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:53.590760 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e347b9-0454-4300-a1b1-c95cd0a0a3de None admin] RBAC: Adding query filter params (role.id=eb04edc46b3742d7a0f0ead26f68bc22, scope.project.id=95fd9df34ab14a12b8b04c4fc3ebfb44, user.id=110851cbe2214cffa24c27ec974336ed) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:53.591069 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e347b9-0454-4300-a1b1-c95cd0a0a3de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:53.592482 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e347b9-0454-4300-a1b1-c95cd0a0a3de None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:53.609438 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 559/1099] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 10 09:51:53 2022] GET /identity/v3/role_assignments?user.id=110851cbe2214cffa24c27ec974336ed&scope.project.id=95fd9df34ab14a12b8b04c4fc3ebfb44&role.id=eb04edc46b3742d7a0f0ead26f68bc22 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:53.697128 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe461ae-2c00-4769-b8a1-a9cac3a9cdbf None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:53.733779 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf9556c-ac62-4123-afae-92560c96b619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:53.734396 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf9556c-ac62-4123-afae-92560c96b619 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:53.734670 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf9556c-ac62-4123-afae-92560c96b619 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:53.734937 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf9556c-ac62-4123-afae-92560c96b619 None admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:53.735684 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf9556c-ac62-4123-afae-92560c96b619 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:53.735994 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf9556c-ac62-4123-afae-92560c96b619 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:53.737502 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf9556c-ac62-4123-afae-92560c96b619 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:53.758662 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 541/1100] 10.222.0.27 () {56 vars in 1133 bytes} [Wed Aug 10 09:51:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 09:51:53.763692 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e347b9-0454-4300-a1b1-c95cd0a0a3de None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:53.863961 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e347b9-0454-4300-a1b1-c95cd0a0a3de None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:53.876803 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:53.898801 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ee79e2-4a76-4e76-bd87-37e93712d1d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:53.899402 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee79e2-4a76-4e76-bd87-37e93712d1d3 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:53.899681 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee79e2-4a76-4e76-bd87-37e93712d1d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:53.899952 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee79e2-4a76-4e76-bd87-37e93712d1d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:53.967644 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ee79e2-4a76-4e76-bd87-37e93712d1d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:53.969115 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ee79e2-4a76-4e76-bd87-37e93712d1d3 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:54.069713 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 560/1101] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 10 09:51:53 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 09:51:54.075396 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf9556c-ac62-4123-afae-92560c96b619 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:54.078433 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:54.176691 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf9556c-ac62-4123-afae-92560c96b619 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:54.210977 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc9efd5-7283-4ac2-afa3-6820151fd1d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:54.211599 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc9efd5-7283-4ac2-afa3-6820151fd1d5 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:54.211881 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc9efd5-7283-4ac2-afa3-6820151fd1d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:54.212148 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc9efd5-7283-4ac2-afa3-6820151fd1d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:54.222476 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc9efd5-7283-4ac2-afa3-6820151fd1d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:54.223930 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc9efd5-7283-4ac2-afa3-6820151fd1d5 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:54.237956 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-dbc9efd5-7283-4ac2-afa3-6820151fd1d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:51:54.237956 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:54.237956 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:54.237956 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:54.237956 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:54.237956 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:54.237956 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:54.237956 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:54.237956 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:54.237956 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:54.237956 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:54.237956 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:54.237956 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 09:51:54.237956 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 09:51:54.237956 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 09:51:54.237956 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 09:51:54.239009 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:54.239009 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:54.239009 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:54.239009 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:54.239009 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:54.239009 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:54.239009 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:54.239009 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:54.239009 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:54.239009 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:54.239009 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:54.239009 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:54.239009 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:54.239009 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:54.239009 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:54.239009 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:54.239009 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 09:51:54.239908 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 09:51:54.239908 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:51:54.239908 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:51:54.239908 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 542/1102] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 10 09:51:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:51:54.245035 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ee79e2-4a76-4e76-bd87-37e93712d1d3 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:54.259524 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:54.343146 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ee79e2-4a76-4e76-bd87-37e93712d1d3 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:54.375512 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d03822-2b8e-46ea-87a9-dfe160171ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:54.376107 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d03822-2b8e-46ea-87a9-dfe160171ca3 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:54.376382 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d03822-2b8e-46ea-87a9-dfe160171ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:54.376648 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d03822-2b8e-46ea-87a9-dfe160171ca3 None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:54.377310 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d03822-2b8e-46ea-87a9-dfe160171ca3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:54.377594 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d03822-2b8e-46ea-87a9-dfe160171ca3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:54.378961 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d03822-2b8e-46ea-87a9-dfe160171ca3 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:54.390033 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 561/1103] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 10 09:51:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 09:51:54.395964 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc9efd5-7283-4ac2-afa3-6820151fd1d5 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:54.451962 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:54.497404 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc9efd5-7283-4ac2-afa3-6820151fd1d5 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:54.531366 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813aa6ca-08d5-48fd-a41a-d7113428b800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:54.531977 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813aa6ca-08d5-48fd-a41a-d7113428b800 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:54.532243 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813aa6ca-08d5-48fd-a41a-d7113428b800 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:54.532515 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813aa6ca-08d5-48fd-a41a-d7113428b800 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:54.539257 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813aa6ca-08d5-48fd-a41a-d7113428b800 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:54.540704 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813aa6ca-08d5-48fd-a41a-d7113428b800 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:54.551820 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-813aa6ca-08d5-48fd-a41a-d7113428b800 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 09:51:54.551820 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:51:54.551820 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:51:54.551820 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:51:54.551820 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:51:54.551820 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:51:54.551820 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:51:54.551820 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:51:54.551820 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:51:54.551820 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:51:54.551820 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:51:54.551820 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:51:54.551820 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 09:51:54.551820 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 09:51:54.551820 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 09:51:54.552832 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 09:51:54.552832 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:51:54.552832 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:51:54.552832 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:51:54.552832 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:51:54.552832 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:51:54.552832 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:51:54.552832 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:51:54.552832 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:51:54.552832 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:51:54.552832 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:51:54.552832 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:51:54.552832 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:51:54.552832 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:51:54.552832 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:51:54.552832 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:51:54.552832 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:51:54.553768 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 09:51:54.553768 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 09:51:54.553768 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 09:51:54.553768 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 09:51:54.553768 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 09:51:54.553768 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 09:51:54.553768 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 09:51:54.553768 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:51:54.553768 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 543/1104] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 10 09:51:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:51:54.559187 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d03822-2b8e-46ea-87a9-dfe160171ca3 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:54.631479 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:54.663506 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d03822-2b8e-46ea-87a9-dfe160171ca3 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:54.698507 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1e76fb-5c5b-4019-b667-fec82dd7172e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:54.699130 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1e76fb-5c5b-4019-b667-fec82dd7172e None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:54.699408 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1e76fb-5c5b-4019-b667-fec82dd7172e None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:54.699678 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1e76fb-5c5b-4019-b667-fec82dd7172e None admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:54.700385 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1e76fb-5c5b-4019-b667-fec82dd7172e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:54.700690 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1e76fb-5c5b-4019-b667-fec82dd7172e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:54.702190 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1e76fb-5c5b-4019-b667-fec82dd7172e None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:54.715928 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 562/1105] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Aug 10 09:51:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:54.722317 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813aa6ca-08d5-48fd-a41a-d7113428b800 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:54.819983 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813aa6ca-08d5-48fd-a41a-d7113428b800 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:54.833433 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:54.856379 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3116c268-1c1e-431f-bf9e-136485228508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:54.856970 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3116c268-1c1e-431f-bf9e-136485228508 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:54.857275 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3116c268-1c1e-431f-bf9e-136485228508 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:54.857526 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3116c268-1c1e-431f-bf9e-136485228508 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:54.858242 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3116c268-1c1e-431f-bf9e-136485228508 None admin] RBAC: Adding query filter params (role.id=0dd53da12ae74208933c961c29f12ec0, scope.project.id=d47d5b72a00642a1a239b785110643ef, user.id=dd8580888cba41a88566da4540b1130c) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:54.858548 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3116c268-1c1e-431f-bf9e-136485228508 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:54.859982 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3116c268-1c1e-431f-bf9e-136485228508 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:54.865742 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 544/1106] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 10 09:51:54 2022] GET /identity/v3/role_assignments?user.id=dd8580888cba41a88566da4540b1130c&scope.project.id=d47d5b72a00642a1a239b785110643ef&role.id=0dd53da12ae74208933c961c29f12ec0 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:55.584508 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf252fd-ce16-4faa-8f92-f683662b5180 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:55.585192 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf252fd-ce16-4faa-8f92-f683662b5180 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:55.585192 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf252fd-ce16-4faa-8f92-f683662b5180 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:55.586426 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 563/1107] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:51:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:51:55.591837 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c086970-2fce-49cb-84e0-f8b63d41cfd8 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:55.592283 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c086970-2fce-49cb-84e0-f8b63d41cfd8 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:55.592456 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c086970-2fce-49cb-84e0-f8b63d41cfd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:55.611502 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-0c086970-2fce-49cb-84e0-f8b63d41cfd8 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:51:55.612720 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-0c086970-2fce-49cb-84e0-f8b63d41cfd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:51:55.682815 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 545/1108] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:51:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 09:51:55.707125 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf252fd-ce16-4faa-8f92-f683662b5180 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:55.825352 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf252fd-ce16-4faa-8f92-f683662b5180 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:55.855395 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:55.862489 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673d91aa-495b-43d0-9d2b-857a83607ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:55.863118 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673d91aa-495b-43d0-9d2b-857a83607ea0 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:55.863396 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673d91aa-495b-43d0-9d2b-857a83607ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:55.863670 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673d91aa-495b-43d0-9d2b-857a83607ea0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:55.864907 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673d91aa-495b-43d0-9d2b-857a83607ea0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:55.866396 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673d91aa-495b-43d0-9d2b-857a83607ea0 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:55.868000 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 564/1109] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 10 09:51:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:55.874190 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c086970-2fce-49cb-84e0-f8b63d41cfd8 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:55.979394 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c086970-2fce-49cb-84e0-f8b63d41cfd8 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:55.988605 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:56.025792 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a12086-e7a3-49a7-80ff-efa75fd29ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:56.026383 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a12086-e7a3-49a7-80ff-efa75fd29ce3 None admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:56.026657 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a12086-e7a3-49a7-80ff-efa75fd29ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:56.026925 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a12086-e7a3-49a7-80ff-efa75fd29ce3 None admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:56.027572 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a12086-e7a3-49a7-80ff-efa75fd29ce3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:56.028994 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a12086-e7a3-49a7-80ff-efa75fd29ce3 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:56.050602 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 546/1110] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Aug 10 09:51:55 2022] POST /identity/v3/users => generated 286 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 09:51:58.063375 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014b2515-c6ec-4796-8bc8-a25f6efce81d None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:58.064288 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014b2515-c6ec-4796-8bc8-a25f6efce81d None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:58.064288 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014b2515-c6ec-4796-8bc8-a25f6efce81d None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:58.066483 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 565/1111] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:51:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:51:58.072406 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c26baf-f436-4248-8bf7-4dfa1bb4f13e None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:58.072833 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c26baf-f436-4248-8bf7-4dfa1bb4f13e None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:58.072925 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c26baf-f436-4248-8bf7-4dfa1bb4f13e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:58.100261 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-95c26baf-f436-4248-8bf7-4dfa1bb4f13e None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:51:58.102028 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-95c26baf-f436-4248-8bf7-4dfa1bb4f13e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:51:58.172737 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 547/1112] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:51:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 09:51:58.199108 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014b2515-c6ec-4796-8bc8-a25f6efce81d None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:58.339918 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014b2515-c6ec-4796-8bc8-a25f6efce81d None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:58.385923 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82de3bfb-f7a9-4bec-a71b-87188c60bd88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:58.386548 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82de3bfb-f7a9-4bec-a71b-87188c60bd88 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:58.386823 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82de3bfb-f7a9-4bec-a71b-87188c60bd88 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:58.387098 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82de3bfb-f7a9-4bec-a71b-87188c60bd88 None admin] PATH_INFO: `/v3/roles/5d80017a50774daba0c1fee326754295` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:58.388556 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82de3bfb-f7a9-4bec-a71b-87188c60bd88 None admin] RBAC: Authorizing `identity:get_role(role_id=5d80017a50774daba0c1fee326754295)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:58.389957 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82de3bfb-f7a9-4bec-a71b-87188c60bd88 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:58.391292 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 566/1113] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 10 09:51:58 2022] GET /identity/v3/roles/5d80017a50774daba0c1fee326754295 => generated 223 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:58.397762 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c26baf-f436-4248-8bf7-4dfa1bb4f13e None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:58.513230 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:58.520255 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c26baf-f436-4248-8bf7-4dfa1bb4f13e None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:58.561704 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1e7ec3-7637-4ebe-abee-0b4dbefedb07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:58.562580 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1e7ec3-7637-4ebe-abee-0b4dbefedb07 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:58.562983 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1e7ec3-7637-4ebe-abee-0b4dbefedb07 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:58.563379 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1e7ec3-7637-4ebe-abee-0b4dbefedb07 None admin] PATH_INFO: `/v3/users/2bf1577793504ddbaaab4db2249be9e6` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:58.582196 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1e7ec3-7637-4ebe-abee-0b4dbefedb07 None admin] RBAC: Authorizing `identity:get_user(user_id=2bf1577793504ddbaaab4db2249be9e6)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:58.584169 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1e7ec3-7637-4ebe-abee-0b4dbefedb07 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:58.586429 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 548/1114] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 10 09:51:58 2022] GET /identity/v3/users/2bf1577793504ddbaaab4db2249be9e6 => generated 286 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:58.593570 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82de3bfb-f7a9-4bec-a71b-87188c60bd88 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:58.676589 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:58.712688 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82de3bfb-f7a9-4bec-a71b-87188c60bd88 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:58.750599 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b851f4-b193-4e76-b994-318bc2293dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:58.751193 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b851f4-b193-4e76-b994-318bc2293dd8 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:58.751471 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b851f4-b193-4e76-b994-318bc2293dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:58.751799 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b851f4-b193-4e76-b994-318bc2293dd8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:58.820585 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b851f4-b193-4e76-b994-318bc2293dd8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:58.822062 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b851f4-b193-4e76-b994-318bc2293dd8 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:58.886661 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:51:58.920929 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 567/1115] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 10 09:51:58 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 09:51:58.927280 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1e7ec3-7637-4ebe-abee-0b4dbefedb07 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:59.041922 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1e7ec3-7637-4ebe-abee-0b4dbefedb07 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:59.076230 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcd61bc-372b-4396-990f-0d4b665945e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:59.076848 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcd61bc-372b-4396-990f-0d4b665945e2 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:59.077108 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcd61bc-372b-4396-990f-0d4b665945e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:59.077390 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcd61bc-372b-4396-990f-0d4b665945e2 None admin] PATH_INFO: `/v3/projects/95fd9df34ab14a12b8b04c4fc3ebfb44` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:59.078527 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcd61bc-372b-4396-990f-0d4b665945e2 None admin] RBAC: Authorizing `identity:get_project(project_id=95fd9df34ab14a12b8b04c4fc3ebfb44)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:59.079955 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcd61bc-372b-4396-990f-0d4b665945e2 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:59.081562 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 549/1116] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 10 09:51:58 2022] GET /identity/v3/projects/95fd9df34ab14a12b8b04c4fc3ebfb44 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:51:59.089487 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b851f4-b193-4e76-b994-318bc2293dd8 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:51:59.196159 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b851f4-b193-4e76-b994-318bc2293dd8 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:51:59.230745 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391a7c5b-86fd-4a9b-9520-fb33cdee53d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:51:59.231325 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a7c5b-86fd-4a9b-9520-fb33cdee53d0 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:51:59.231596 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a7c5b-86fd-4a9b-9520-fb33cdee53d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:51:59.231889 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a7c5b-86fd-4a9b-9520-fb33cdee53d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:51:59.232604 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391a7c5b-86fd-4a9b-9520-fb33cdee53d0 None admin] RBAC: Adding query filter params (role.id=5d80017a50774daba0c1fee326754295, scope.project.id=95fd9df34ab14a12b8b04c4fc3ebfb44, user.id=2bf1577793504ddbaaab4db2249be9e6) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:51:59.232913 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391a7c5b-86fd-4a9b-9520-fb33cdee53d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:51:59.234348 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391a7c5b-86fd-4a9b-9520-fb33cdee53d0 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:51:59.239768 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 568/1117] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 10 09:51:59 2022] GET /identity/v3/role_assignments?user.id=2bf1577793504ddbaaab4db2249be9e6&scope.project.id=95fd9df34ab14a12b8b04c4fc3ebfb44&role.id=5d80017a50774daba0c1fee326754295 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:52:01.212396 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396ed056-0f95-4593-a29d-117a64ece68b None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:52:01.213350 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396ed056-0f95-4593-a29d-117a64ece68b None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:52:01.213350 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396ed056-0f95-4593-a29d-117a64ece68b None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:52:01.215513 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 550/1118] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:52:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:52:01.221023 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d72f9e3-0397-4a6e-b7ed-68e75b006cd1 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:52:01.221509 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d72f9e3-0397-4a6e-b7ed-68e75b006cd1 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:52:01.221626 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d72f9e3-0397-4a6e-b7ed-68e75b006cd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:52:01.241250 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-2d72f9e3-0397-4a6e-b7ed-68e75b006cd1 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:52:01.242478 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-2d72f9e3-0397-4a6e-b7ed-68e75b006cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:52:01.268170 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:52:01.313223 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 569/1119] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:52:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 09:52:01.336784 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396ed056-0f95-4593-a29d-117a64ece68b None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:52:01.372245 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:52:01.454458 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396ed056-0f95-4593-a29d-117a64ece68b None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:52:01.493335 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0002ce11-d1e1-4235-bff1-f7268328516c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:52:01.493887 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0002ce11-d1e1-4235-bff1-f7268328516c None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:52:01.494163 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0002ce11-d1e1-4235-bff1-f7268328516c None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:52:01.494437 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0002ce11-d1e1-4235-bff1-f7268328516c None admin] PATH_INFO: `/v3/roles/5d80017a50774daba0c1fee326754295` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:52:01.495990 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0002ce11-d1e1-4235-bff1-f7268328516c None admin] RBAC: Authorizing `identity:get_role(role_id=5d80017a50774daba0c1fee326754295)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:52:01.497395 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0002ce11-d1e1-4235-bff1-f7268328516c None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:52:01.498731 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 551/1120] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 10 09:52:01 2022] GET /identity/v3/roles/5d80017a50774daba0c1fee326754295 => generated 223 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:52:01.505338 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d72f9e3-0397-4a6e-b7ed-68e75b006cd1 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:52:01.619148 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d72f9e3-0397-4a6e-b7ed-68e75b006cd1 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:52:01.657020 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30db87b3-0b3e-44e7-b0df-3a51c3384fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:52:01.657680 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30db87b3-0b3e-44e7-b0df-3a51c3384fd1 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:52:01.657957 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30db87b3-0b3e-44e7-b0df-3a51c3384fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:52:01.658227 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30db87b3-0b3e-44e7-b0df-3a51c3384fd1 None admin] PATH_INFO: `/v3/users/2bf1577793504ddbaaab4db2249be9e6` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:52:01.659498 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30db87b3-0b3e-44e7-b0df-3a51c3384fd1 None admin] RBAC: Authorizing `identity:get_user(user_id=2bf1577793504ddbaaab4db2249be9e6)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:52:01.660941 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30db87b3-0b3e-44e7-b0df-3a51c3384fd1 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:52:01.662581 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 570/1121] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 10 09:52:01 2022] GET /identity/v3/users/2bf1577793504ddbaaab4db2249be9e6 => generated 286 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:52:01.674901 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0002ce11-d1e1-4235-bff1-f7268328516c None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:52:01.770688 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:52:01.783576 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0002ce11-d1e1-4235-bff1-f7268328516c None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:52:01.816077 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73af265d-48b9-4b15-a0ec-9928b776dee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:52:01.816698 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73af265d-48b9-4b15-a0ec-9928b776dee5 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:52:01.816980 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73af265d-48b9-4b15-a0ec-9928b776dee5 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:52:01.817620 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73af265d-48b9-4b15-a0ec-9928b776dee5 None admin] PATH_INFO: `/v3/projects/95fd9df34ab14a12b8b04c4fc3ebfb44` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:52:01.818747 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73af265d-48b9-4b15-a0ec-9928b776dee5 None admin] RBAC: Authorizing `identity:get_project(project_id=95fd9df34ab14a12b8b04c4fc3ebfb44)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:52:01.820236 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73af265d-48b9-4b15-a0ec-9928b776dee5 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:52:01.821898 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 552/1122] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 10 09:52:01 2022] GET /identity/v3/projects/95fd9df34ab14a12b8b04c4fc3ebfb44 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 09:52:01.828998 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30db87b3-0b3e-44e7-b0df-3a51c3384fd1 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:52:01.868260 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:52:01.940957 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30db87b3-0b3e-44e7-b0df-3a51c3384fd1 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:52:01.979681 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b039ce02-6bb8-433a-9ec7-1ca2ec901fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:52:01.980345 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b039ce02-6bb8-433a-9ec7-1ca2ec901fb1 None admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:52:01.980625 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b039ce02-6bb8-433a-9ec7-1ca2ec901fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:52:01.980891 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b039ce02-6bb8-433a-9ec7-1ca2ec901fb1 None admin] PATH_INFO: `/v3/projects/95fd9df34ab14a12b8b04c4fc3ebfb44/users/2bf1577793504ddbaaab4db2249be9e6/roles/5d80017a50774daba0c1fee326754295` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:52:01.983436 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b039ce02-6bb8-433a-9ec7-1ca2ec901fb1 None admin] RBAC: Authorizing `identity:create_grant(project_id=95fd9df34ab14a12b8b04c4fc3ebfb44, user_id=2bf1577793504ddbaaab4db2249be9e6, role_id=5d80017a50774daba0c1fee326754295)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:52:01.984885 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b039ce02-6bb8-433a-9ec7-1ca2ec901fb1 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:52:02.001336 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 571/1123] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Aug 10 09:52:01 2022] PUT /identity/v3/projects/95fd9df34ab14a12b8b04c4fc3ebfb44/users/2bf1577793504ddbaaab4db2249be9e6/roles/5d80017a50774daba0c1fee326754295 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 09:52:03.946037 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f4109b-3a55-410d-be91-9e86ddce2a80 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:52:03.946874 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f4109b-3a55-410d-be91-9e86ddce2a80 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:52:03.946874 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f4109b-3a55-410d-be91-9e86ddce2a80 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:52:03.948893 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 553/1124] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:52:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:52:03.956841 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8984c43a-9ae7-4ef4-8939-8a5d5c9f7134 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:52:03.957325 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8984c43a-9ae7-4ef4-8939-8a5d5c9f7134 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:52:03.957420 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8984c43a-9ae7-4ef4-8939-8a5d5c9f7134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:52:03.977111 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-8984c43a-9ae7-4ef4-8939-8a5d5c9f7134 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:52:03.978308 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-8984c43a-9ae7-4ef4-8939-8a5d5c9f7134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:52:04.046226 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 572/1125] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:52:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 09:52:04.079594 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f4109b-3a55-410d-be91-9e86ddce2a80 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:52:04.186798 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f4109b-3a55-410d-be91-9e86ddce2a80 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:52:04.232322 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5e3c2f-0dcb-4542-8cdf-4d4ad73c5e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:52:04.232935 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e3c2f-0dcb-4542-8cdf-4d4ad73c5e16 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:52:04.233235 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e3c2f-0dcb-4542-8cdf-4d4ad73c5e16 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:52:04.233499 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e3c2f-0dcb-4542-8cdf-4d4ad73c5e16 None admin] PATH_INFO: `/v3/roles/5d80017a50774daba0c1fee326754295` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:52:04.234985 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5e3c2f-0dcb-4542-8cdf-4d4ad73c5e16 None admin] RBAC: Authorizing `identity:get_role(role_id=5d80017a50774daba0c1fee326754295)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:52:04.236357 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5e3c2f-0dcb-4542-8cdf-4d4ad73c5e16 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:52:04.237675 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 554/1126] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 10 09:52:04 2022] GET /identity/v3/roles/5d80017a50774daba0c1fee326754295 => generated 223 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:52:04.243698 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8984c43a-9ae7-4ef4-8939-8a5d5c9f7134 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:52:04.267973 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:52:04.350023 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8984c43a-9ae7-4ef4-8939-8a5d5c9f7134 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:52:04.384977 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b4f03d-efe6-4c2b-ad24-3f79eaf2d892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:52:04.385631 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b4f03d-efe6-4c2b-ad24-3f79eaf2d892 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:52:04.385903 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b4f03d-efe6-4c2b-ad24-3f79eaf2d892 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:52:04.386167 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b4f03d-efe6-4c2b-ad24-3f79eaf2d892 None admin] PATH_INFO: `/v3/users/2bf1577793504ddbaaab4db2249be9e6` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:52:04.387402 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b4f03d-efe6-4c2b-ad24-3f79eaf2d892 None admin] RBAC: Authorizing `identity:get_user(user_id=2bf1577793504ddbaaab4db2249be9e6)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:52:04.388834 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b4f03d-efe6-4c2b-ad24-3f79eaf2d892 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:52:04.390456 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 573/1127] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 10 09:52:04 2022] GET /identity/v3/users/2bf1577793504ddbaaab4db2249be9e6 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:52:04.397132 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5e3c2f-0dcb-4542-8cdf-4d4ad73c5e16 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:52:04.424540 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:52:04.507443 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5e3c2f-0dcb-4542-8cdf-4d4ad73c5e16 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:52:04.542764 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c8f883-54bb-4705-81d0-bb8b16021837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:52:04.543356 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c8f883-54bb-4705-81d0-bb8b16021837 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:52:04.543633 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c8f883-54bb-4705-81d0-bb8b16021837 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:52:04.543906 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c8f883-54bb-4705-81d0-bb8b16021837 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:52:04.612924 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c8f883-54bb-4705-81d0-bb8b16021837 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:52:04.614411 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c8f883-54bb-4705-81d0-bb8b16021837 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:52:04.638296 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:52:04.736203 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 555/1128] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 10 09:52:04 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 09:52:04.745986 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b4f03d-efe6-4c2b-ad24-3f79eaf2d892 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:52:04.848636 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:52:04.861294 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b4f03d-efe6-4c2b-ad24-3f79eaf2d892 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:52:04.896112 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5c0b1e-ccfe-4d24-9f74-b0ce442b0846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:52:04.896731 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5c0b1e-ccfe-4d24-9f74-b0ce442b0846 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:52:04.897007 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5c0b1e-ccfe-4d24-9f74-b0ce442b0846 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:52:04.897309 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5c0b1e-ccfe-4d24-9f74-b0ce442b0846 None admin] PATH_INFO: `/v3/projects/95fd9df34ab14a12b8b04c4fc3ebfb44` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:52:04.898539 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5c0b1e-ccfe-4d24-9f74-b0ce442b0846 None admin] RBAC: Authorizing `identity:get_project(project_id=95fd9df34ab14a12b8b04c4fc3ebfb44)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:52:04.899974 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5c0b1e-ccfe-4d24-9f74-b0ce442b0846 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:52:04.901739 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 574/1129] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 10 09:52:04 2022] GET /identity/v3/projects/95fd9df34ab14a12b8b04c4fc3ebfb44 => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:52:04.908751 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c8f883-54bb-4705-81d0-bb8b16021837 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:52:05.027033 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c8f883-54bb-4705-81d0-bb8b16021837 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:52:05.050939 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:52:05.063370 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3502a0-86bd-41f9-ac69-1dc86cc4f0c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:52:05.063973 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3502a0-86bd-41f9-ac69-1dc86cc4f0c4 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:52:05.064248 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3502a0-86bd-41f9-ac69-1dc86cc4f0c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:52:05.064518 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3502a0-86bd-41f9-ac69-1dc86cc4f0c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:52:05.065276 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3502a0-86bd-41f9-ac69-1dc86cc4f0c4 None admin] RBAC: Adding query filter params (role.id=5d80017a50774daba0c1fee326754295, scope.project.id=95fd9df34ab14a12b8b04c4fc3ebfb44, user.id=2bf1577793504ddbaaab4db2249be9e6) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:52:05.065579 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3502a0-86bd-41f9-ac69-1dc86cc4f0c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:52:05.067018 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3502a0-86bd-41f9-ac69-1dc86cc4f0c4 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:52:05.073206 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 556/1130] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 10 09:52:04 2022] GET /identity/v3/role_assignments?user.id=2bf1577793504ddbaaab4db2249be9e6&scope.project.id=95fd9df34ab14a12b8b04c4fc3ebfb44&role.id=5d80017a50774daba0c1fee326754295 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:52:07.061032 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407b032a-c52d-4bdd-ba95-6f107906790e None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:52:07.061667 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407b032a-c52d-4bdd-ba95-6f107906790e None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:52:07.061667 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407b032a-c52d-4bdd-ba95-6f107906790e None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:52:07.062998 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 575/1131] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:52:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:52:07.069748 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526005bb-5f6a-4a0e-acc1-5c8bed028c06 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:52:07.070530 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526005bb-5f6a-4a0e-acc1-5c8bed028c06 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:52:07.070664 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526005bb-5f6a-4a0e-acc1-5c8bed028c06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:52:07.091877 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-526005bb-5f6a-4a0e-acc1-5c8bed028c06 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:52:07.093055 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-526005bb-5f6a-4a0e-acc1-5c8bed028c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:52:07.162607 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 557/1132] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:52:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 09:52:07.185456 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407b032a-c52d-4bdd-ba95-6f107906790e None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:52:07.308554 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407b032a-c52d-4bdd-ba95-6f107906790e None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:52:07.344253 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4845f2b6-2628-4141-875e-8ded1c279be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:52:07.344797 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4845f2b6-2628-4141-875e-8ded1c279be9 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:52:07.345106 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4845f2b6-2628-4141-875e-8ded1c279be9 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:52:07.345371 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4845f2b6-2628-4141-875e-8ded1c279be9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:52:07.346605 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4845f2b6-2628-4141-875e-8ded1c279be9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:52:07.348056 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4845f2b6-2628-4141-875e-8ded1c279be9 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:52:07.349643 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 576/1133] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 10 09:52:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:52:07.358944 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526005bb-5f6a-4a0e-acc1-5c8bed028c06 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:52:07.460370 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526005bb-5f6a-4a0e-acc1-5c8bed028c06 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:52:07.477973 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:52:07.496397 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e097f04-5b1b-4803-b1f0-fc9b627e27ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:52:07.496994 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e097f04-5b1b-4803-b1f0-fc9b627e27ee None admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:52:07.497306 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e097f04-5b1b-4803-b1f0-fc9b627e27ee None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:52:07.497578 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e097f04-5b1b-4803-b1f0-fc9b627e27ee None admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:52:07.498223 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e097f04-5b1b-4803-b1f0-fc9b627e27ee None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:52:07.499662 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e097f04-5b1b-4803-b1f0-fc9b627e27ee None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:52:07.531087 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 558/1134] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Aug 10 09:52:07 2022] POST /identity/v3/projects => generated 311 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 09:52:09.521875 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78a4cac-9032-4183-91c4-1a0532fbbde7 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:52:09.522792 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78a4cac-9032-4183-91c4-1a0532fbbde7 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:52:09.522792 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78a4cac-9032-4183-91c4-1a0532fbbde7 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:52:09.524893 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 577/1135] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:52:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:52:09.530396 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5fe5e9-d347-494a-ab34-4878c321cfa0 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:52:09.530838 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5fe5e9-d347-494a-ab34-4878c321cfa0 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:52:09.530935 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5fe5e9-d347-494a-ab34-4878c321cfa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:52:09.549899 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-fa5fe5e9-d347-494a-ab34-4878c321cfa0 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:52:09.551080 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-fa5fe5e9-d347-494a-ab34-4878c321cfa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:52:09.622114 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 559/1136] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:52:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 09:52:09.646959 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78a4cac-9032-4183-91c4-1a0532fbbde7 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:52:09.679287 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:52:09.759000 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78a4cac-9032-4183-91c4-1a0532fbbde7 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:52:09.794189 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c066e7fe-47ab-45d1-acb5-6a2790038cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:52:09.794736 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c066e7fe-47ab-45d1-acb5-6a2790038cd8 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:52:09.795013 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c066e7fe-47ab-45d1-acb5-6a2790038cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:52:09.795278 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c066e7fe-47ab-45d1-acb5-6a2790038cd8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:52:09.796486 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c066e7fe-47ab-45d1-acb5-6a2790038cd8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:52:09.797948 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c066e7fe-47ab-45d1-acb5-6a2790038cd8 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:52:09.799501 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 578/1137] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 10 09:52:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:52:09.806485 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5fe5e9-d347-494a-ab34-4878c321cfa0 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:52:09.908988 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:52:09.914090 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5fe5e9-d347-494a-ab34-4878c321cfa0 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:52:09.951908 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a6afa8-9c96-43c8-89c9-b29a80c715ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:52:09.952497 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a6afa8-9c96-43c8-89c9-b29a80c715ea None admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:52:09.952782 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a6afa8-9c96-43c8-89c9-b29a80c715ea None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:52:09.953047 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a6afa8-9c96-43c8-89c9-b29a80c715ea None admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:52:09.953723 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a6afa8-9c96-43c8-89c9-b29a80c715ea None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:52:09.955154 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a6afa8-9c96-43c8-89c9-b29a80c715ea None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:52:09.977329 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 560/1138] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Aug 10 09:52:09 2022] POST /identity/v3/users => generated 286 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 09:52:12.034510 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e979deae-2323-4317-bd1a-652d2883e3f4 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:52:12.035091 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e979deae-2323-4317-bd1a-652d2883e3f4 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:52:12.035091 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e979deae-2323-4317-bd1a-652d2883e3f4 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:52:12.037126 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 579/1139] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:52:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:52:12.045002 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08941528-da3e-4a91-aa9b-24a0acc3c718 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:52:12.045442 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08941528-da3e-4a91-aa9b-24a0acc3c718 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:52:12.045653 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08941528-da3e-4a91-aa9b-24a0acc3c718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:52:12.074363 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-08941528-da3e-4a91-aa9b-24a0acc3c718 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:52:12.075559 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-08941528-da3e-4a91-aa9b-24a0acc3c718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:52:12.154065 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 561/1140] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:52:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 09:52:12.176944 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e979deae-2323-4317-bd1a-652d2883e3f4 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:52:12.273977 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:52:12.285305 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e979deae-2323-4317-bd1a-652d2883e3f4 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:52:12.320124 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78613d81-4b67-469b-b79b-f3d29b65be64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:52:12.320735 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78613d81-4b67-469b-b79b-f3d29b65be64 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:52:12.321007 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78613d81-4b67-469b-b79b-f3d29b65be64 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:52:12.321308 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78613d81-4b67-469b-b79b-f3d29b65be64 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:52:12.331637 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78613d81-4b67-469b-b79b-f3d29b65be64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 09:52:12.336250 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-78613d81-4b67-469b-b79b-f3d29b65be64 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 09:52:12.336250 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:52:12.336250 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:52:12.336250 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:52:12.336250 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:52:12.336250 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:52:12.336250 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:52:12.336250 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:52:12.336250 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:52:12.336250 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:52:12.336250 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:52:12.336250 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:52:12.336250 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 09:52:12.336250 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 09:52:12.336250 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 09:52:12.336250 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 09:52:12.337399 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 09:52:12.337399 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 09:52:12.337399 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 09:52:12.337399 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 09:52:12.337399 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:52:12.337399 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:52:12.337399 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:52:12.337399 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:52:12.337399 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:52:12.337399 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:52:12.337399 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:52:12.337399 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:52:12.337399 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:52:12.337399 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:52:12.337399 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:52:12.337399 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:52:12.338393 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:52:12.338393 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:52:12.338393 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:52:12.338393 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:52:12.338393 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 09:52:12.338393 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 09:52:12.338393 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 09:52:12.338393 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 09:52:12.338393 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 09:52:12.338393 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 09:52:12.338393 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 09:52:12.338393 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:52:12.338393 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 580/1141] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Aug 10 09:52:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:52:12.344378 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08941528-da3e-4a91-aa9b-24a0acc3c718 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:52:12.440441 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:52:12.457509 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08941528-da3e-4a91-aa9b-24a0acc3c718 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:52:12.501714 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0651969-5b6d-4520-b63b-e510fbb5152e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:52:12.502334 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0651969-5b6d-4520-b63b-e510fbb5152e None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:52:12.502608 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0651969-5b6d-4520-b63b-e510fbb5152e None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:52:12.502873 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0651969-5b6d-4520-b63b-e510fbb5152e None admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:52:12.503556 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0651969-5b6d-4520-b63b-e510fbb5152e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:52:12.503859 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0651969-5b6d-4520-b63b-e510fbb5152e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:52:12.505284 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0651969-5b6d-4520-b63b-e510fbb5152e None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:52:12.516003 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 562/1142] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 10 09:52:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:52:12.525842 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78613d81-4b67-469b-b79b-f3d29b65be64 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:52:12.629825 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78613d81-4b67-469b-b79b-f3d29b65be64 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:52:12.664313 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9967a4-002a-4792-8488-99ca78522723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:52:12.664925 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9967a4-002a-4792-8488-99ca78522723 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:52:12.665230 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9967a4-002a-4792-8488-99ca78522723 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:52:12.665499 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9967a4-002a-4792-8488-99ca78522723 None admin] PATH_INFO: `/v3/users/e12030bb57dc408d96932e8c5987954a` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:52:12.683008 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9967a4-002a-4792-8488-99ca78522723 None admin] RBAC: Authorizing `identity:get_user(user_id=e12030bb57dc408d96932e8c5987954a)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:52:12.684466 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9967a4-002a-4792-8488-99ca78522723 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:52:12.686189 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 581/1143] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 10 09:52:12 2022] GET /identity/v3/users/e12030bb57dc408d96932e8c5987954a => generated 286 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:52:12.692492 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0651969-5b6d-4520-b63b-e510fbb5152e None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:52:12.794933 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0651969-5b6d-4520-b63b-e510fbb5152e None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:52:12.829394 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702241bb-b929-4823-974c-12f96268c969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:52:12.829974 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702241bb-b929-4823-974c-12f96268c969 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:52:12.830250 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702241bb-b929-4823-974c-12f96268c969 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:52:12.830514 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702241bb-b929-4823-974c-12f96268c969 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:52:12.849523 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:52:12.900247 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702241bb-b929-4823-974c-12f96268c969 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:52:12.901687 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702241bb-b929-4823-974c-12f96268c969 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:52:13.004292 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 563/1144] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 10 09:52:12 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 09:52:13.010664 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9967a4-002a-4792-8488-99ca78522723 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:52:13.023598 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:52:13.113726 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9967a4-002a-4792-8488-99ca78522723 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:52:13.148030 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e132a2aa-b511-4a16-b4f1-d359e7015fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:52:13.148640 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e132a2aa-b511-4a16-b4f1-d359e7015fda None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:52:13.148920 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e132a2aa-b511-4a16-b4f1-d359e7015fda None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:52:13.149224 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e132a2aa-b511-4a16-b4f1-d359e7015fda None admin] PATH_INFO: `/v3/projects/4c64703e78f74fb79c2f845046c61aa6` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:52:13.150506 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e132a2aa-b511-4a16-b4f1-d359e7015fda None admin] RBAC: Authorizing `identity:get_project(project_id=4c64703e78f74fb79c2f845046c61aa6)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:52:13.151880 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e132a2aa-b511-4a16-b4f1-d359e7015fda None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:52:13.153522 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 582/1145] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 10 09:52:13 2022] GET /identity/v3/projects/4c64703e78f74fb79c2f845046c61aa6 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:52:13.163095 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702241bb-b929-4823-974c-12f96268c969 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:52:13.217597 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:52:13.269108 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702241bb-b929-4823-974c-12f96268c969 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:52:13.304448 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457bbcc2-9116-452f-b888-112e31ecd434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:52:13.305027 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457bbcc2-9116-452f-b888-112e31ecd434 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:52:13.305329 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457bbcc2-9116-452f-b888-112e31ecd434 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:52:13.305600 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457bbcc2-9116-452f-b888-112e31ecd434 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:52:13.306314 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457bbcc2-9116-452f-b888-112e31ecd434 None admin] RBAC: Adding query filter params (role.id=eb04edc46b3742d7a0f0ead26f68bc22, scope.project.id=4c64703e78f74fb79c2f845046c61aa6, user.id=e12030bb57dc408d96932e8c5987954a) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:52:13.306744 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457bbcc2-9116-452f-b888-112e31ecd434 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:52:13.308249 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457bbcc2-9116-452f-b888-112e31ecd434 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:52:13.313622 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 564/1146] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 10 09:52:13 2022] GET /identity/v3/role_assignments?user.id=e12030bb57dc408d96932e8c5987954a&scope.project.id=4c64703e78f74fb79c2f845046c61aa6&role.id=eb04edc46b3742d7a0f0ead26f68bc22 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:52:15.286881 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a73b60e-98df-4061-977e-cdb33301f062 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:52:15.287824 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a73b60e-98df-4061-977e-cdb33301f062 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:52:15.287824 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a73b60e-98df-4061-977e-cdb33301f062 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:52:15.290018 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 583/1147] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:52:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:52:15.295518 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e1c833-71d1-46a9-9871-ddcb10b878a5 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:52:15.295972 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e1c833-71d1-46a9-9871-ddcb10b878a5 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:52:15.296074 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e1c833-71d1-46a9-9871-ddcb10b878a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:52:15.314579 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-60e1c833-71d1-46a9-9871-ddcb10b878a5 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:52:15.315742 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-60e1c833-71d1-46a9-9871-ddcb10b878a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:52:15.383722 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 565/1148] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:52:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 09:52:15.405715 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a73b60e-98df-4061-977e-cdb33301f062 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:52:15.494678 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:52:15.526773 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a73b60e-98df-4061-977e-cdb33301f062 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:52:15.563536 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5732172d-c59b-4c53-8716-6686ac9ce489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:52:15.564064 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5732172d-c59b-4c53-8716-6686ac9ce489 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:52:15.564340 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5732172d-c59b-4c53-8716-6686ac9ce489 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:52:15.564603 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5732172d-c59b-4c53-8716-6686ac9ce489 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:52:15.576324 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5732172d-c59b-4c53-8716-6686ac9ce489 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 09:52:15.581014 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-5732172d-c59b-4c53-8716-6686ac9ce489 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 09:52:15.581014 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:52:15.581014 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:52:15.581014 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:52:15.581014 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:52:15.581014 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:52:15.581014 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:52:15.581014 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:52:15.581014 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:52:15.581014 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:52:15.581014 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:52:15.581014 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:52:15.581014 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 09:52:15.581014 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 09:52:15.581014 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 09:52:15.581014 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 09:52:15.582118 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 09:52:15.582118 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 09:52:15.582118 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 09:52:15.582118 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 09:52:15.582118 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:52:15.582118 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:52:15.582118 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:52:15.582118 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:52:15.582118 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:52:15.582118 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:52:15.582118 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:52:15.582118 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:52:15.582118 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:52:15.582118 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:52:15.582118 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:52:15.582118 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:52:15.582995 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:52:15.582995 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:52:15.582995 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:52:15.582995 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:52:15.582995 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 09:52:15.582995 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 09:52:15.582995 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 09:52:15.582995 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 09:52:15.582995 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 09:52:15.582995 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 09:52:15.582995 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 09:52:15.582995 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:52:15.582995 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 584/1149] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Aug 10 09:52:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:52:15.588649 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e1c833-71d1-46a9-9871-ddcb10b878a5 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:52:15.634110 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:52:15.696121 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e1c833-71d1-46a9-9871-ddcb10b878a5 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:52:15.731881 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585bf608-330f-41e5-a8bf-b7b5c9ca8479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:52:15.732479 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585bf608-330f-41e5-a8bf-b7b5c9ca8479 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:52:15.732762 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585bf608-330f-41e5-a8bf-b7b5c9ca8479 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:52:15.733033 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585bf608-330f-41e5-a8bf-b7b5c9ca8479 None admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:52:15.733732 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585bf608-330f-41e5-a8bf-b7b5c9ca8479 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:52:15.734040 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585bf608-330f-41e5-a8bf-b7b5c9ca8479 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:52:15.735420 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585bf608-330f-41e5-a8bf-b7b5c9ca8479 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:52:15.743295 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 566/1150] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 10 09:52:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:52:15.752328 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5732172d-c59b-4c53-8716-6686ac9ce489 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:52:15.853935 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5732172d-c59b-4c53-8716-6686ac9ce489 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:52:15.888358 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32986068-f86e-4f9d-b7cc-43c48540566e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:52:15.888964 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32986068-f86e-4f9d-b7cc-43c48540566e None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:52:15.889269 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32986068-f86e-4f9d-b7cc-43c48540566e None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:52:15.889540 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32986068-f86e-4f9d-b7cc-43c48540566e None admin] PATH_INFO: `/v3/users/e12030bb57dc408d96932e8c5987954a` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:52:15.890665 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32986068-f86e-4f9d-b7cc-43c48540566e None admin] RBAC: Authorizing `identity:get_user(user_id=e12030bb57dc408d96932e8c5987954a)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:52:15.892090 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32986068-f86e-4f9d-b7cc-43c48540566e None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:52:15.893715 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 585/1151] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 10 09:52:15 2022] GET /identity/v3/users/e12030bb57dc408d96932e8c5987954a => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:52:15.902464 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585bf608-330f-41e5-a8bf-b7b5c9ca8479 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:52:16.011647 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585bf608-330f-41e5-a8bf-b7b5c9ca8479 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:52:16.014282 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:52:16.050752 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089fbc28-4286-475d-a22f-71720f4e75e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:52:16.051375 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089fbc28-4286-475d-a22f-71720f4e75e1 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:52:16.051649 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089fbc28-4286-475d-a22f-71720f4e75e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:52:16.051922 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089fbc28-4286-475d-a22f-71720f4e75e1 None admin] PATH_INFO: `/v3/projects/4c64703e78f74fb79c2f845046c61aa6` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:52:16.053189 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089fbc28-4286-475d-a22f-71720f4e75e1 None admin] RBAC: Authorizing `identity:get_project(project_id=4c64703e78f74fb79c2f845046c61aa6)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:52:16.054662 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089fbc28-4286-475d-a22f-71720f4e75e1 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:52:16.056294 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 567/1152] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 10 09:52:15 2022] GET /identity/v3/projects/4c64703e78f74fb79c2f845046c61aa6 => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:52:16.066182 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32986068-f86e-4f9d-b7cc-43c48540566e None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:52:16.077760 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:52:16.173952 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32986068-f86e-4f9d-b7cc-43c48540566e None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:52:16.211395 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cec782-17dd-4de2-9ec1-3b6cb4d1f3dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:52:16.212346 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cec782-17dd-4de2-9ec1-3b6cb4d1f3dd None admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:52:16.212686 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cec782-17dd-4de2-9ec1-3b6cb4d1f3dd None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:52:16.213054 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cec782-17dd-4de2-9ec1-3b6cb4d1f3dd None admin] PATH_INFO: `/v3/projects/4c64703e78f74fb79c2f845046c61aa6/users/e12030bb57dc408d96932e8c5987954a/roles/eb04edc46b3742d7a0f0ead26f68bc22` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:52:16.215269 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cec782-17dd-4de2-9ec1-3b6cb4d1f3dd None admin] RBAC: Authorizing `identity:create_grant(project_id=4c64703e78f74fb79c2f845046c61aa6, user_id=e12030bb57dc408d96932e8c5987954a, role_id=eb04edc46b3742d7a0f0ead26f68bc22)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:52:16.216715 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cec782-17dd-4de2-9ec1-3b6cb4d1f3dd None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:52:16.232316 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 586/1153] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Aug 10 09:52:16 2022] PUT /identity/v3/projects/4c64703e78f74fb79c2f845046c61aa6/users/e12030bb57dc408d96932e8c5987954a/roles/eb04edc46b3742d7a0f0ead26f68bc22 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 09:52:18.167024 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423812c0-1b0c-4d9a-a2b7-c70ade8b2ddb None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:52:18.167900 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423812c0-1b0c-4d9a-a2b7-c70ade8b2ddb None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:52:18.167900 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423812c0-1b0c-4d9a-a2b7-c70ade8b2ddb None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:52:18.170046 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 568/1154] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:52:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:52:18.178005 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3913d1b5-bf6d-4f8e-9c4e-861406f4d2a6 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:52:18.178449 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3913d1b5-bf6d-4f8e-9c4e-861406f4d2a6 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:52:18.178562 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3913d1b5-bf6d-4f8e-9c4e-861406f4d2a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:52:18.199184 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-3913d1b5-bf6d-4f8e-9c4e-861406f4d2a6 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:52:18.200348 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-3913d1b5-bf6d-4f8e-9c4e-861406f4d2a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:52:18.261228 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:52:18.270129 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 587/1155] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:52:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 09:52:18.292902 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423812c0-1b0c-4d9a-a2b7-c70ade8b2ddb None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:52:18.399633 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423812c0-1b0c-4d9a-a2b7-c70ade8b2ddb None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:52:18.434873 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2d68e1-18ea-46e9-b047-2010e4e9cee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:52:18.435412 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2d68e1-18ea-46e9-b047-2010e4e9cee4 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:52:18.435685 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2d68e1-18ea-46e9-b047-2010e4e9cee4 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:52:18.435950 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2d68e1-18ea-46e9-b047-2010e4e9cee4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:52:18.446841 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2d68e1-18ea-46e9-b047-2010e4e9cee4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 09:52:18.451449 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-ea2d68e1-18ea-46e9-b047-2010e4e9cee4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 09:52:18.451449 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:52:18.451449 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:52:18.451449 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:52:18.451449 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:52:18.451449 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:52:18.451449 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:52:18.451449 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:52:18.451449 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:52:18.451449 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:52:18.451449 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:52:18.451449 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:52:18.451449 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 09:52:18.451449 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 09:52:18.451449 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 09:52:18.451449 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 09:52:18.452512 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 09:52:18.452512 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 09:52:18.452512 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 09:52:18.452512 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 09:52:18.452512 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:52:18.452512 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:52:18.452512 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:52:18.452512 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:52:18.452512 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:52:18.452512 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:52:18.452512 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:52:18.452512 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:52:18.452512 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:52:18.452512 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:52:18.452512 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:52:18.452512 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:52:18.453401 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:52:18.453401 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:52:18.453401 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:52:18.453401 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:52:18.453401 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 09:52:18.453401 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 09:52:18.453401 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 09:52:18.453401 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 09:52:18.453401 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 09:52:18.453401 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 09:52:18.453401 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 09:52:18.453401 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:52:18.453401 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 569/1156] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Aug 10 09:52:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:52:18.459021 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3913d1b5-bf6d-4f8e-9c4e-861406f4d2a6 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:52:18.562912 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3913d1b5-bf6d-4f8e-9c4e-861406f4d2a6 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:52:18.598133 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72516cb2-dbe0-47bd-af44-c05d3d6fa00f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:52:18.598726 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72516cb2-dbe0-47bd-af44-c05d3d6fa00f None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:52:18.599000 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72516cb2-dbe0-47bd-af44-c05d3d6fa00f None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:52:18.599267 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72516cb2-dbe0-47bd-af44-c05d3d6fa00f None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:52:18.599929 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72516cb2-dbe0-47bd-af44-c05d3d6fa00f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:52:18.600234 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72516cb2-dbe0-47bd-af44-c05d3d6fa00f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:52:18.601660 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72516cb2-dbe0-47bd-af44-c05d3d6fa00f None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:52:18.609714 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 588/1157] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 10 09:52:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:52:18.615565 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2d68e1-18ea-46e9-b047-2010e4e9cee4 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:52:18.647894 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:52:18.718585 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2d68e1-18ea-46e9-b047-2010e4e9cee4 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:52:18.753601 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddb94d2-c078-48e2-a6c9-a11e27c7debc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:52:18.754229 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb94d2-c078-48e2-a6c9-a11e27c7debc None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:52:18.754515 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb94d2-c078-48e2-a6c9-a11e27c7debc None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:52:18.754788 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb94d2-c078-48e2-a6c9-a11e27c7debc None admin] PATH_INFO: `/v3/users/e12030bb57dc408d96932e8c5987954a` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:52:18.756031 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddb94d2-c078-48e2-a6c9-a11e27c7debc None admin] RBAC: Authorizing `identity:get_user(user_id=e12030bb57dc408d96932e8c5987954a)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:52:18.757520 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddb94d2-c078-48e2-a6c9-a11e27c7debc None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:52:18.759094 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 570/1158] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 10 09:52:18 2022] GET /identity/v3/users/e12030bb57dc408d96932e8c5987954a => generated 286 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:52:18.765548 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72516cb2-dbe0-47bd-af44-c05d3d6fa00f None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:52:18.824602 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:52:18.869627 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72516cb2-dbe0-47bd-af44-c05d3d6fa00f None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:52:18.902250 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde8ab68-92c4-4405-9500-af492a8761b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:52:18.902843 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde8ab68-92c4-4405-9500-af492a8761b1 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:52:18.903125 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde8ab68-92c4-4405-9500-af492a8761b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:52:18.903397 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde8ab68-92c4-4405-9500-af492a8761b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:52:18.973711 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde8ab68-92c4-4405-9500-af492a8761b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:52:18.975078 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde8ab68-92c4-4405-9500-af492a8761b1 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:52:19.033077 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:52:19.076915 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 589/1159] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 10 09:52:18 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 09:52:19.083137 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddb94d2-c078-48e2-a6c9-a11e27c7debc None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:52:19.181797 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:52:19.185044 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddb94d2-c078-48e2-a6c9-a11e27c7debc None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:52:19.220309 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d8e77f-789a-476a-b100-225c3ee61af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:52:19.220923 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d8e77f-789a-476a-b100-225c3ee61af2 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:52:19.221226 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d8e77f-789a-476a-b100-225c3ee61af2 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:52:19.221502 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d8e77f-789a-476a-b100-225c3ee61af2 None admin] PATH_INFO: `/v3/projects/4c64703e78f74fb79c2f845046c61aa6` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:52:19.222676 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d8e77f-789a-476a-b100-225c3ee61af2 None admin] RBAC: Authorizing `identity:get_project(project_id=4c64703e78f74fb79c2f845046c61aa6)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:52:19.224174 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d8e77f-789a-476a-b100-225c3ee61af2 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:52:19.225744 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 571/1160] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 10 09:52:19 2022] GET /identity/v3/projects/4c64703e78f74fb79c2f845046c61aa6 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:52:19.232578 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde8ab68-92c4-4405-9500-af492a8761b1 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:52:19.336291 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde8ab68-92c4-4405-9500-af492a8761b1 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:52:19.381401 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1462ba6-a2c0-42b9-9742-9529f372ef78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:52:19.381990 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1462ba6-a2c0-42b9-9742-9529f372ef78 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:52:19.382260 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1462ba6-a2c0-42b9-9742-9529f372ef78 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:52:19.382527 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1462ba6-a2c0-42b9-9742-9529f372ef78 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:52:19.383254 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1462ba6-a2c0-42b9-9742-9529f372ef78 None admin] RBAC: Adding query filter params (role.id=eb04edc46b3742d7a0f0ead26f68bc22, scope.project.id=4c64703e78f74fb79c2f845046c61aa6, user.id=e12030bb57dc408d96932e8c5987954a) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:52:19.383554 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1462ba6-a2c0-42b9-9742-9529f372ef78 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:52:19.385005 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1462ba6-a2c0-42b9-9742-9529f372ef78 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:52:19.390985 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 590/1161] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 10 09:52:19 2022] GET /identity/v3/role_assignments?user.id=e12030bb57dc408d96932e8c5987954a&scope.project.id=4c64703e78f74fb79c2f845046c61aa6&role.id=eb04edc46b3742d7a0f0ead26f68bc22 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:52:21.388739 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bc239f-7099-4b21-866d-1a9a0a8a9aea None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:52:21.389383 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bc239f-7099-4b21-866d-1a9a0a8a9aea None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:52:21.389383 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bc239f-7099-4b21-866d-1a9a0a8a9aea None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:52:21.390692 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 572/1162] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:52:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:52:21.397024 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbb4ade-d991-441b-b019-94c0810e2898 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:52:21.397829 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbb4ade-d991-441b-b019-94c0810e2898 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:52:21.397954 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbb4ade-d991-441b-b019-94c0810e2898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:52:21.422408 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-5dbb4ade-d991-441b-b019-94c0810e2898 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:52:21.424260 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-5dbb4ade-d991-441b-b019-94c0810e2898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:52:21.444966 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:52:21.497601 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 591/1163] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:52:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 09:52:21.530976 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bc239f-7099-4b21-866d-1a9a0a8a9aea None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:52:21.648553 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bc239f-7099-4b21-866d-1a9a0a8a9aea None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:52:21.684779 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beda566e-90c5-41ff-a6e0-66beef8e1fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:52:21.685426 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda566e-90c5-41ff-a6e0-66beef8e1fe8 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:52:21.685702 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda566e-90c5-41ff-a6e0-66beef8e1fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:52:21.685982 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda566e-90c5-41ff-a6e0-66beef8e1fe8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:52:21.725528 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:52:21.770638 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beda566e-90c5-41ff-a6e0-66beef8e1fe8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:52:21.772099 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beda566e-90c5-41ff-a6e0-66beef8e1fe8 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:52:21.875951 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 573/1164] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 10 09:52:21 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 09:52:21.882893 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbb4ade-d991-441b-b019-94c0810e2898 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:52:21.991252 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbb4ade-d991-441b-b019-94c0810e2898 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:52:22.026376 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6794f443-e181-44cb-91f0-54a6e83f42fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:52:22.026986 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6794f443-e181-44cb-91f0-54a6e83f42fb None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:52:22.027235 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6794f443-e181-44cb-91f0-54a6e83f42fb None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:52:22.027516 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6794f443-e181-44cb-91f0-54a6e83f42fb None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:52:22.034247 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6794f443-e181-44cb-91f0-54a6e83f42fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:52:22.035676 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6794f443-e181-44cb-91f0-54a6e83f42fb None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:52:22.047003 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-6794f443-e181-44cb-91f0-54a6e83f42fb None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 10 09:52:22.047003 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:52:22.047003 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 10 09:52:22.047003 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 10 09:52:22.047003 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 09:52:22.047003 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 09:52:22.047003 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 09:52:22.047003 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 09:52:22.047003 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 10 09:52:22.047003 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:52:22.047003 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 09:52:22.047003 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:52:22.047003 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:52:22.047003 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:52:22.047003 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:52:22.047003 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:52:22.047003 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:52:22.048204 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:52:22.048204 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:52:22.048204 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:52:22.048204 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:52:22.048204 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:52:22.048204 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:52:22.048204 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 09:52:22.048204 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 09:52:22.048204 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 09:52:22.048204 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 09:52:22.048204 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:52:22.048204 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:52:22.048204 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:52:22.048204 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:52:22.048204 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:52:22.048204 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:52:22.049367 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:52:22.049367 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:52:22.049367 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:52:22.049367 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:52:22.049367 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:52:22.049367 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:52:22.049367 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:52:22.049367 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:52:22.049367 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:52:22.049367 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:52:22.049367 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 10 09:52:22.049367 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 09:52:22.049367 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 10 09:52:22.049367 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:52:22.053030 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 592/1165] 10.222.0.27 () {56 vars in 1117 bytes} [Wed Aug 10 09:52:21 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:52:22.054695 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beda566e-90c5-41ff-a6e0-66beef8e1fe8 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:52:22.129992 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:52:22.163547 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beda566e-90c5-41ff-a6e0-66beef8e1fe8 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:52:22.200177 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36a4737-4271-4d01-be6c-9cad6facf5ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:52:22.200763 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36a4737-4271-4d01-be6c-9cad6facf5ca None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:52:22.201033 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36a4737-4271-4d01-be6c-9cad6facf5ca None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:52:22.201328 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36a4737-4271-4d01-be6c-9cad6facf5ca None admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:52:22.201968 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36a4737-4271-4d01-be6c-9cad6facf5ca None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:52:22.202266 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36a4737-4271-4d01-be6c-9cad6facf5ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:52:22.203639 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36a4737-4271-4d01-be6c-9cad6facf5ca None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:52:22.211212 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 574/1166] 10.222.0.27 () {56 vars in 1115 bytes} [Wed Aug 10 09:52:22 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:52:24.165526 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb5871c-f525-441e-9cf3-633284bbc7d7 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:52:24.166544 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb5871c-f525-441e-9cf3-633284bbc7d7 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:52:24.166544 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb5871c-f525-441e-9cf3-633284bbc7d7 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:52:24.168726 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 593/1167] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:52:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:52:24.175116 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65bae72-9c4a-4c6e-ae0e-3ca4797e41dd None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:52:24.175851 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65bae72-9c4a-4c6e-ae0e-3ca4797e41dd None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:52:24.175997 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65bae72-9c4a-4c6e-ae0e-3ca4797e41dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:52:24.202488 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-e65bae72-9c4a-4c6e-ae0e-3ca4797e41dd None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:52:24.203679 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-e65bae72-9c4a-4c6e-ae0e-3ca4797e41dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:52:24.273389 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 575/1168] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:52:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 09:52:24.302816 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb5871c-f525-441e-9cf3-633284bbc7d7 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:52:24.319244 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:52:24.417590 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb5871c-f525-441e-9cf3-633284bbc7d7 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:52:24.453713 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21886221-6ab0-47f1-9bab-628f4f03be7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:52:24.454302 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21886221-6ab0-47f1-9bab-628f4f03be7d None admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:52:24.454577 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21886221-6ab0-47f1-9bab-628f4f03be7d None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:52:24.454843 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21886221-6ab0-47f1-9bab-628f4f03be7d None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:52:24.455498 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21886221-6ab0-47f1-9bab-628f4f03be7d None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:52:24.456862 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21886221-6ab0-47f1-9bab-628f4f03be7d None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:52:24.476541 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 594/1169] 10.222.0.27 () {60 vars in 1138 bytes} [Wed Aug 10 09:52:24 2022] POST /identity/v3/domains => generated 267 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 09:52:26.461468 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5c0752-0624-4d63-ab3f-373b0d2f5844 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:52:26.462397 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5c0752-0624-4d63-ab3f-373b0d2f5844 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:52:26.462397 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5c0752-0624-4d63-ab3f-373b0d2f5844 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:52:26.464460 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 576/1170] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:52:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:52:26.469903 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f30e3-cd2f-4cca-af7f-9aaa5d3328e1 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:52:26.470346 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f30e3-cd2f-4cca-af7f-9aaa5d3328e1 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:52:26.470445 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f30e3-cd2f-4cca-af7f-9aaa5d3328e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:52:26.490230 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-7d7f30e3-cd2f-4cca-af7f-9aaa5d3328e1 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:52:26.491403 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-7d7f30e3-cd2f-4cca-af7f-9aaa5d3328e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:52:26.563791 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 595/1171] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:52:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 09:52:26.588053 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5c0752-0624-4d63-ab3f-373b0d2f5844 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:52:26.673919 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:52:26.718073 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5c0752-0624-4d63-ab3f-373b0d2f5844 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:52:26.760645 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fac4bbc-473c-417e-b733-03d7506b1f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:52:26.761299 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fac4bbc-473c-417e-b733-03d7506b1f3b None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:52:26.761577 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fac4bbc-473c-417e-b733-03d7506b1f3b None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:52:26.761849 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fac4bbc-473c-417e-b733-03d7506b1f3b None admin] PATH_INFO: `/v3/domains/82bdec9284494296a6d4bea356424e72` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:52:26.772740 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fac4bbc-473c-417e-b733-03d7506b1f3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=82bdec9284494296a6d4bea356424e72)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:52:26.774235 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fac4bbc-473c-417e-b733-03d7506b1f3b None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:52:26.775866 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 577/1172] 10.222.0.27 () {56 vars in 1183 bytes} [Wed Aug 10 09:52:26 2022] GET /identity/v3/domains/82bdec9284494296a6d4bea356424e72 => generated 267 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:52:26.781949 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7f30e3-cd2f-4cca-af7f-9aaa5d3328e1 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:52:26.784179 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:52:26.900792 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7f30e3-cd2f-4cca-af7f-9aaa5d3328e1 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:52:26.935447 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c020324-87d9-432b-bdd4-07563852b6ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:52:26.936050 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c020324-87d9-432b-bdd4-07563852b6ae None admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:52:26.936329 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c020324-87d9-432b-bdd4-07563852b6ae None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:52:26.936601 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c020324-87d9-432b-bdd4-07563852b6ae None admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:52:26.937283 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c020324-87d9-432b-bdd4-07563852b6ae None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:52:26.938716 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c020324-87d9-432b-bdd4-07563852b6ae None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:52:26.974728 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 596/1173] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Aug 10 09:52:26 2022] POST /identity/v3/projects => generated 361 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 09:52:28.981296 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b05440-6d05-4ad9-b8f9-64d7ca2ece18 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:52:28.982147 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b05440-6d05-4ad9-b8f9-64d7ca2ece18 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:52:28.982147 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b05440-6d05-4ad9-b8f9-64d7ca2ece18 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:52:28.984309 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 578/1174] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:52:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:52:28.993023 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce472d91-1f4c-4e81-a2fd-1fbbf49b48fa None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:52:28.993491 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce472d91-1f4c-4e81-a2fd-1fbbf49b48fa None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:52:28.993620 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce472d91-1f4c-4e81-a2fd-1fbbf49b48fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:52:29.012675 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-ce472d91-1f4c-4e81-a2fd-1fbbf49b48fa None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:52:29.013915 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-ce472d91-1f4c-4e81-a2fd-1fbbf49b48fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:52:29.065000 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:52:29.084251 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 597/1175] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:52:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 09:52:29.108535 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b05440-6d05-4ad9-b8f9-64d7ca2ece18 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:52:29.210336 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b05440-6d05-4ad9-b8f9-64d7ca2ece18 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:52:29.240600 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:52:29.253989 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f79ef63-cedf-475f-84c5-c480a54882ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:52:29.254607 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f79ef63-cedf-475f-84c5-c480a54882ce None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:52:29.254885 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f79ef63-cedf-475f-84c5-c480a54882ce None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:52:29.255153 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f79ef63-cedf-475f-84c5-c480a54882ce None admin] PATH_INFO: `/v3/domains/82bdec9284494296a6d4bea356424e72` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:52:29.256338 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f79ef63-cedf-475f-84c5-c480a54882ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=82bdec9284494296a6d4bea356424e72)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:52:29.257813 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f79ef63-cedf-475f-84c5-c480a54882ce None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:52:29.259383 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 579/1176] 10.222.0.27 () {56 vars in 1183 bytes} [Wed Aug 10 09:52:29 2022] GET /identity/v3/domains/82bdec9284494296a6d4bea356424e72 => generated 267 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:52:29.266165 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce472d91-1f4c-4e81-a2fd-1fbbf49b48fa None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:52:29.381874 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce472d91-1f4c-4e81-a2fd-1fbbf49b48fa None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:52:29.420034 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafa5c05-b521-44c6-9322-2a520cc977fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:52:29.420622 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafa5c05-b521-44c6-9322-2a520cc977fb None admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:52:29.420898 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafa5c05-b521-44c6-9322-2a520cc977fb None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:52:29.421195 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafa5c05-b521-44c6-9322-2a520cc977fb None admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:52:29.421840 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafa5c05-b521-44c6-9322-2a520cc977fb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:52:29.423270 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafa5c05-b521-44c6-9322-2a520cc977fb None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:52:29.448028 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 598/1177] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Aug 10 09:52:29 2022] POST /identity/v3/users => generated 311 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 09:52:31.467110 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f52506-211a-4e7b-82a0-9ed704653bc2 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:52:31.468043 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f52506-211a-4e7b-82a0-9ed704653bc2 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:52:31.468043 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f52506-211a-4e7b-82a0-9ed704653bc2 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:52:31.470228 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 580/1178] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:52:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:52:31.476379 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8870503-433a-446b-853f-e6766be62e06 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:52:31.477136 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8870503-433a-446b-853f-e6766be62e06 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:52:31.477334 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8870503-433a-446b-853f-e6766be62e06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:52:31.498476 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-a8870503-433a-446b-853f-e6766be62e06 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:52:31.499677 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-a8870503-433a-446b-853f-e6766be62e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:52:31.541091 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:52:31.581499 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 599/1179] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:52:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 09:52:31.605423 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f52506-211a-4e7b-82a0-9ed704653bc2 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:52:31.722551 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f52506-211a-4e7b-82a0-9ed704653bc2 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:52:31.757015 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05baefb-2ac7-4b69-b8ed-b40cb2babaea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:52:31.757651 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05baefb-2ac7-4b69-b8ed-b40cb2babaea None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:52:31.757928 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05baefb-2ac7-4b69-b8ed-b40cb2babaea None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:52:31.758192 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05baefb-2ac7-4b69-b8ed-b40cb2babaea None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:52:31.768723 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05baefb-2ac7-4b69-b8ed-b40cb2babaea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 09:52:31.773355 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-f05baefb-2ac7-4b69-b8ed-b40cb2babaea None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 09:52:31.773355 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:52:31.773355 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:52:31.773355 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:52:31.773355 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:52:31.773355 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:52:31.773355 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:52:31.773355 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:52:31.773355 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:52:31.773355 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:52:31.773355 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:52:31.773355 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:52:31.773355 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 09:52:31.773355 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 09:52:31.773355 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 09:52:31.773355 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 09:52:31.774387 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 09:52:31.774387 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 09:52:31.774387 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 09:52:31.774387 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 09:52:31.774387 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:52:31.774387 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:52:31.774387 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:52:31.774387 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:52:31.774387 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:52:31.774387 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:52:31.774387 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:52:31.774387 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:52:31.774387 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:52:31.774387 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:52:31.774387 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:52:31.774387 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:52:31.775221 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:52:31.775221 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:52:31.775221 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:52:31.775221 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:52:31.775221 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 09:52:31.775221 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 09:52:31.775221 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 09:52:31.775221 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 09:52:31.775221 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 09:52:31.775221 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 09:52:31.775221 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 09:52:31.775221 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:52:31.775221 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 581/1180] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Aug 10 09:52:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:52:31.783206 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8870503-433a-446b-853f-e6766be62e06 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:52:31.890780 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8870503-433a-446b-853f-e6766be62e06 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:52:31.925341 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924dacd6-7d13-47ae-b065-ec83e75d1d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:52:31.925936 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924dacd6-7d13-47ae-b065-ec83e75d1d74 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:52:31.926207 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924dacd6-7d13-47ae-b065-ec83e75d1d74 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:52:31.926468 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924dacd6-7d13-47ae-b065-ec83e75d1d74 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:52:31.927127 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924dacd6-7d13-47ae-b065-ec83e75d1d74 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:52:31.927428 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924dacd6-7d13-47ae-b065-ec83e75d1d74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:52:31.928794 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924dacd6-7d13-47ae-b065-ec83e75d1d74 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:52:31.936841 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 600/1181] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 10 09:52:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:52:31.945617 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05baefb-2ac7-4b69-b8ed-b40cb2babaea None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:52:31.999583 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:52:32.055280 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05baefb-2ac7-4b69-b8ed-b40cb2babaea None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:52:32.092697 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6580a5a5-d17b-42df-a9a5-972ee99b206d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:52:32.093339 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6580a5a5-d17b-42df-a9a5-972ee99b206d None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:52:32.093613 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6580a5a5-d17b-42df-a9a5-972ee99b206d None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:52:32.093886 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6580a5a5-d17b-42df-a9a5-972ee99b206d None admin] PATH_INFO: `/v3/users/02ceb066ee874f21b4e017f3800a33dd` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:52:32.107506 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6580a5a5-d17b-42df-a9a5-972ee99b206d None admin] RBAC: Authorizing `identity:get_user(user_id=02ceb066ee874f21b4e017f3800a33dd)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:52:32.108958 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6580a5a5-d17b-42df-a9a5-972ee99b206d None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:52:32.110580 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 582/1182] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 10 09:52:31 2022] GET /identity/v3/users/02ceb066ee874f21b4e017f3800a33dd => generated 311 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 09:52:32.119472 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924dacd6-7d13-47ae-b065-ec83e75d1d74 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:52:32.151612 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:52:32.221153 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924dacd6-7d13-47ae-b065-ec83e75d1d74 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:52:32.254742 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8fd57f-7ade-4973-a00d-dc828edb87e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:52:32.255264 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8fd57f-7ade-4973-a00d-dc828edb87e9 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:52:32.255537 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8fd57f-7ade-4973-a00d-dc828edb87e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:52:32.255800 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8fd57f-7ade-4973-a00d-dc828edb87e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:52:32.326014 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8fd57f-7ade-4973-a00d-dc828edb87e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:52:32.327471 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8fd57f-7ade-4973-a00d-dc828edb87e9 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:52:32.357449 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:52:32.431173 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 601/1183] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 10 09:52:32 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 09:52:32.440801 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6580a5a5-d17b-42df-a9a5-972ee99b206d None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:52:32.545331 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6580a5a5-d17b-42df-a9a5-972ee99b206d None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:52:32.555850 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:52:32.586231 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc92bd66-75b8-45bb-8a69-6f93c0b50739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:52:32.586848 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc92bd66-75b8-45bb-8a69-6f93c0b50739 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:52:32.587134 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc92bd66-75b8-45bb-8a69-6f93c0b50739 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:52:32.587428 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc92bd66-75b8-45bb-8a69-6f93c0b50739 None admin] PATH_INFO: `/v3/projects/e6c0e0559ff841b6b3606800cd94e0c9` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:52:32.588651 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc92bd66-75b8-45bb-8a69-6f93c0b50739 None admin] RBAC: Authorizing `identity:get_project(project_id=e6c0e0559ff841b6b3606800cd94e0c9)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:52:32.590125 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc92bd66-75b8-45bb-8a69-6f93c0b50739 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:52:32.591787 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 583/1184] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 10 09:52:32 2022] GET /identity/v3/projects/e6c0e0559ff841b6b3606800cd94e0c9 => generated 361 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:52:32.598979 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8fd57f-7ade-4973-a00d-dc828edb87e9 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:52:32.708036 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8fd57f-7ade-4973-a00d-dc828edb87e9 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:52:32.742241 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:52:32.748539 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdd13a7-b1b6-4f1f-aa62-70aa468101fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:52:32.749173 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd13a7-b1b6-4f1f-aa62-70aa468101fb None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:52:32.749457 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd13a7-b1b6-4f1f-aa62-70aa468101fb None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:52:32.749726 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd13a7-b1b6-4f1f-aa62-70aa468101fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:52:32.750444 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdd13a7-b1b6-4f1f-aa62-70aa468101fb None admin] RBAC: Adding query filter params (role.id=eb04edc46b3742d7a0f0ead26f68bc22, scope.project.id=e6c0e0559ff841b6b3606800cd94e0c9, user.id=02ceb066ee874f21b4e017f3800a33dd) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:52:32.750745 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdd13a7-b1b6-4f1f-aa62-70aa468101fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:52:32.752168 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdd13a7-b1b6-4f1f-aa62-70aa468101fb None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:52:32.757803 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 602/1185] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 10 09:52:32 2022] GET /identity/v3/role_assignments?user.id=02ceb066ee874f21b4e017f3800a33dd&scope.project.id=e6c0e0559ff841b6b3606800cd94e0c9&role.id=eb04edc46b3742d7a0f0ead26f68bc22 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:52:34.684589 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb1bd91-5925-453d-a2c4-ecae09219a22 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:52:34.685031 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb1bd91-5925-453d-a2c4-ecae09219a22 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:52:34.685178 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb1bd91-5925-453d-a2c4-ecae09219a22 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:52:34.687211 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 584/1186] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:52:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:52:34.696356 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6726a3-7f9b-474e-965d-a0ef314a999e None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:52:34.696827 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6726a3-7f9b-474e-965d-a0ef314a999e None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:52:34.697037 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6726a3-7f9b-474e-965d-a0ef314a999e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:52:34.717495 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-4b6726a3-7f9b-474e-965d-a0ef314a999e None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:52:34.718713 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-4b6726a3-7f9b-474e-965d-a0ef314a999e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:52:34.788781 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 603/1187] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:52:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 09:52:34.816408 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb1bd91-5925-453d-a2c4-ecae09219a22 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:52:34.922037 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb1bd91-5925-453d-a2c4-ecae09219a22 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:52:34.956967 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e4a3df-8a83-4140-8980-083d4da568ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:52:34.957520 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e4a3df-8a83-4140-8980-083d4da568ef None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:52:34.957798 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e4a3df-8a83-4140-8980-083d4da568ef None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:52:34.958061 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e4a3df-8a83-4140-8980-083d4da568ef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:52:34.968708 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e4a3df-8a83-4140-8980-083d4da568ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 09:52:34.973333 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-a3e4a3df-8a83-4140-8980-083d4da568ef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 09:52:34.973333 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:52:34.973333 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:52:34.973333 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:52:34.973333 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:52:34.973333 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:52:34.973333 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:52:34.973333 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:52:34.973333 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:52:34.973333 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:52:34.973333 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:52:34.973333 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:52:34.973333 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 09:52:34.973333 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 09:52:34.973333 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 09:52:34.973333 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 09:52:34.974367 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 09:52:34.974367 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 09:52:34.974367 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 09:52:34.974367 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 09:52:34.974367 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:52:34.974367 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:52:34.974367 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:52:34.974367 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:52:34.974367 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:52:34.974367 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:52:34.974367 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:52:34.974367 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:52:34.974367 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:52:34.974367 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:52:34.974367 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:52:34.974367 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:52:34.975345 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:52:34.975345 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:52:34.975345 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:52:34.975345 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:52:34.975345 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 09:52:34.975345 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 09:52:34.975345 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 09:52:34.975345 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 09:52:34.975345 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 09:52:34.975345 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 09:52:34.975345 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 09:52:34.975345 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:52:34.975345 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 585/1188] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Aug 10 09:52:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:52:34.980553 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6726a3-7f9b-474e-965d-a0ef314a999e None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:52:35.089378 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6726a3-7f9b-474e-965d-a0ef314a999e None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:52:35.115021 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:52:35.128755 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ca1752-af96-4277-8795-59314a21dfbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:52:35.129663 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca1752-af96-4277-8795-59314a21dfbc None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:52:35.129999 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca1752-af96-4277-8795-59314a21dfbc None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:52:35.130346 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca1752-af96-4277-8795-59314a21dfbc None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:52:35.131364 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ca1752-af96-4277-8795-59314a21dfbc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:52:35.131793 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ca1752-af96-4277-8795-59314a21dfbc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:52:35.133975 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ca1752-af96-4277-8795-59314a21dfbc None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:52:35.147374 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 604/1189] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 10 09:52:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:52:35.154330 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e4a3df-8a83-4140-8980-083d4da568ef None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:52:35.192029 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:52:35.258207 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e4a3df-8a83-4140-8980-083d4da568ef None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:52:35.292301 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f621daac-e996-4c7f-a6b3-8146743d94db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:52:35.292903 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f621daac-e996-4c7f-a6b3-8146743d94db None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:52:35.293213 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f621daac-e996-4c7f-a6b3-8146743d94db None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:52:35.293480 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f621daac-e996-4c7f-a6b3-8146743d94db None admin] PATH_INFO: `/v3/users/02ceb066ee874f21b4e017f3800a33dd` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:52:35.294600 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f621daac-e996-4c7f-a6b3-8146743d94db None admin] RBAC: Authorizing `identity:get_user(user_id=02ceb066ee874f21b4e017f3800a33dd)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:52:35.296034 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f621daac-e996-4c7f-a6b3-8146743d94db None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:52:35.297610 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 586/1190] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 10 09:52:35 2022] GET /identity/v3/users/02ceb066ee874f21b4e017f3800a33dd => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:52:35.303473 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ca1752-af96-4277-8795-59314a21dfbc None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:52:35.405844 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ca1752-af96-4277-8795-59314a21dfbc None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:52:35.446224 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0d1d40-bea3-41d9-94c6-a6858e23124d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:52:35.446890 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0d1d40-bea3-41d9-94c6-a6858e23124d None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:52:35.447167 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0d1d40-bea3-41d9-94c6-a6858e23124d None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:52:35.447440 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0d1d40-bea3-41d9-94c6-a6858e23124d None admin] PATH_INFO: `/v3/projects/e6c0e0559ff841b6b3606800cd94e0c9` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:52:35.448594 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0d1d40-bea3-41d9-94c6-a6858e23124d None admin] RBAC: Authorizing `identity:get_project(project_id=e6c0e0559ff841b6b3606800cd94e0c9)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:52:35.450040 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0d1d40-bea3-41d9-94c6-a6858e23124d None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:52:35.451697 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 605/1191] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 10 09:52:35 2022] GET /identity/v3/projects/e6c0e0559ff841b6b3606800cd94e0c9 => generated 361 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:52:35.457689 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f621daac-e996-4c7f-a6b3-8146743d94db None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:52:35.562531 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f621daac-e996-4c7f-a6b3-8146743d94db None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:52:35.564875 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:52:35.598221 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9f0947-4716-4199-ac3c-06790500fda7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:52:35.598864 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f0947-4716-4199-ac3c-06790500fda7 None admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:52:35.599135 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f0947-4716-4199-ac3c-06790500fda7 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:52:35.599407 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f0947-4716-4199-ac3c-06790500fda7 None admin] PATH_INFO: `/v3/projects/e6c0e0559ff841b6b3606800cd94e0c9/users/02ceb066ee874f21b4e017f3800a33dd/roles/eb04edc46b3742d7a0f0ead26f68bc22` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:52:35.601432 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9f0947-4716-4199-ac3c-06790500fda7 None admin] RBAC: Authorizing `identity:create_grant(project_id=e6c0e0559ff841b6b3606800cd94e0c9, user_id=02ceb066ee874f21b4e017f3800a33dd, role_id=eb04edc46b3742d7a0f0ead26f68bc22)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:52:35.602864 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9f0947-4716-4199-ac3c-06790500fda7 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:52:35.618292 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 587/1192] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Aug 10 09:52:35 2022] PUT /identity/v3/projects/e6c0e0559ff841b6b3606800cd94e0c9/users/02ceb066ee874f21b4e017f3800a33dd/roles/eb04edc46b3742d7a0f0ead26f68bc22 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 09:52:37.575169 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da8e63-73f2-4a56-ba91-7a94b95fc570 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:52:37.576101 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da8e63-73f2-4a56-ba91-7a94b95fc570 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:52:37.576101 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da8e63-73f2-4a56-ba91-7a94b95fc570 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:52:37.578259 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 606/1193] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:52:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:52:37.583677 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904bcae1-dd72-4048-929a-969f8191b243 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:52:37.584118 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904bcae1-dd72-4048-929a-969f8191b243 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:52:37.584216 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904bcae1-dd72-4048-929a-969f8191b243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:52:37.604073 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-904bcae1-dd72-4048-929a-969f8191b243 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:52:37.605303 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-904bcae1-dd72-4048-929a-969f8191b243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:52:37.674764 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 588/1194] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:52:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 09:52:37.698831 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7da8e63-73f2-4a56-ba91-7a94b95fc570 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:52:37.761517 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:52:37.809106 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7da8e63-73f2-4a56-ba91-7a94b95fc570 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:52:37.843763 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e58c9a-b3da-45eb-a1af-6058b1e7ce28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:52:37.844322 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e58c9a-b3da-45eb-a1af-6058b1e7ce28 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:52:37.844595 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e58c9a-b3da-45eb-a1af-6058b1e7ce28 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:52:37.844864 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e58c9a-b3da-45eb-a1af-6058b1e7ce28 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:52:37.856118 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e58c9a-b3da-45eb-a1af-6058b1e7ce28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 09:52:37.860782 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-81e58c9a-b3da-45eb-a1af-6058b1e7ce28 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 09:52:37.860782 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:52:37.860782 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:52:37.860782 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:52:37.860782 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:52:37.860782 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:52:37.860782 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:52:37.860782 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:52:37.860782 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:52:37.860782 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:52:37.860782 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:52:37.860782 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:52:37.860782 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 09:52:37.860782 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 09:52:37.860782 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 09:52:37.860782 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 09:52:37.862032 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 09:52:37.862032 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 09:52:37.862032 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 09:52:37.862032 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 09:52:37.862032 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:52:37.862032 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:52:37.862032 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:52:37.862032 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:52:37.862032 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:52:37.862032 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:52:37.862032 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:52:37.862032 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:52:37.862032 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:52:37.862032 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:52:37.862032 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:52:37.862032 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:52:37.862924 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:52:37.862924 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:52:37.862924 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:52:37.862924 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:52:37.862924 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 09:52:37.862924 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 09:52:37.862924 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 09:52:37.862924 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 09:52:37.862924 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 09:52:37.862924 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 09:52:37.862924 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 09:52:37.862924 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:52:37.862924 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 607/1195] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Aug 10 09:52:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:52:37.869702 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904bcae1-dd72-4048-929a-969f8191b243 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:52:37.963869 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:52:37.973983 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904bcae1-dd72-4048-929a-969f8191b243 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:52:38.019330 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8064d367-dc34-4fdf-af00-91a6fdbace2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:52:38.019918 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8064d367-dc34-4fdf-af00-91a6fdbace2c None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:52:38.020192 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8064d367-dc34-4fdf-af00-91a6fdbace2c None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:52:38.020464 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8064d367-dc34-4fdf-af00-91a6fdbace2c None admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:52:38.021122 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8064d367-dc34-4fdf-af00-91a6fdbace2c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:52:38.021450 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8064d367-dc34-4fdf-af00-91a6fdbace2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:52:38.022824 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8064d367-dc34-4fdf-af00-91a6fdbace2c None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:52:38.030856 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 589/1196] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 10 09:52:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 09:52:38.040185 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e58c9a-b3da-45eb-a1af-6058b1e7ce28 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:52:38.148889 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e58c9a-b3da-45eb-a1af-6058b1e7ce28 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:52:38.164919 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:52:38.188224 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aec2ac3-74ec-42a1-b2dd-e62a61cac376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:52:38.188846 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aec2ac3-74ec-42a1-b2dd-e62a61cac376 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:52:38.189160 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aec2ac3-74ec-42a1-b2dd-e62a61cac376 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:52:38.189433 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aec2ac3-74ec-42a1-b2dd-e62a61cac376 None admin] PATH_INFO: `/v3/users/02ceb066ee874f21b4e017f3800a33dd` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:52:38.190654 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aec2ac3-74ec-42a1-b2dd-e62a61cac376 None admin] RBAC: Authorizing `identity:get_user(user_id=02ceb066ee874f21b4e017f3800a33dd)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:52:38.192456 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aec2ac3-74ec-42a1-b2dd-e62a61cac376 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:52:38.194069 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 608/1197] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Aug 10 09:52:38 2022] GET /identity/v3/users/02ceb066ee874f21b4e017f3800a33dd => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:52:38.200644 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8064d367-dc34-4fdf-af00-91a6fdbace2c None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:52:38.311790 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8064d367-dc34-4fdf-af00-91a6fdbace2c None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:52:38.346727 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40308d10-6af2-4ffa-9479-47f3eba880a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:52:38.347317 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40308d10-6af2-4ffa-9479-47f3eba880a6 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:52:38.347588 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40308d10-6af2-4ffa-9479-47f3eba880a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:52:38.347859 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40308d10-6af2-4ffa-9479-47f3eba880a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:52:38.372842 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:52:38.423278 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40308d10-6af2-4ffa-9479-47f3eba880a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:52:38.424645 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40308d10-6af2-4ffa-9479-47f3eba880a6 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:52:38.525125 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 590/1198] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 10 09:52:38 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 09:52:38.532011 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aec2ac3-74ec-42a1-b2dd-e62a61cac376 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:52:38.649546 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aec2ac3-74ec-42a1-b2dd-e62a61cac376 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:52:38.692034 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b22edd-a119-464f-8b74-f0361a904a03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:52:38.692662 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b22edd-a119-464f-8b74-f0361a904a03 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:52:38.692935 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b22edd-a119-464f-8b74-f0361a904a03 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:52:38.693238 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b22edd-a119-464f-8b74-f0361a904a03 None admin] PATH_INFO: `/v3/projects/e6c0e0559ff841b6b3606800cd94e0c9` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:52:38.694400 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b22edd-a119-464f-8b74-f0361a904a03 None admin] RBAC: Authorizing `identity:get_project(project_id=e6c0e0559ff841b6b3606800cd94e0c9)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:52:38.695831 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b22edd-a119-464f-8b74-f0361a904a03 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:52:38.697503 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 609/1199] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Aug 10 09:52:38 2022] GET /identity/v3/projects/e6c0e0559ff841b6b3606800cd94e0c9 => generated 361 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:52:38.704510 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40308d10-6af2-4ffa-9479-47f3eba880a6 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:52:38.761358 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:52:38.813035 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40308d10-6af2-4ffa-9479-47f3eba880a6 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:52:38.848837 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cba621-ac6e-45ca-a218-11c66b1d24b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:52:38.849459 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cba621-ac6e-45ca-a218-11c66b1d24b2 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:52:38.849741 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cba621-ac6e-45ca-a218-11c66b1d24b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:52:38.850008 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cba621-ac6e-45ca-a218-11c66b1d24b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:52:38.850734 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cba621-ac6e-45ca-a218-11c66b1d24b2 None admin] RBAC: Adding query filter params (role.id=eb04edc46b3742d7a0f0ead26f68bc22, scope.project.id=e6c0e0559ff841b6b3606800cd94e0c9, user.id=02ceb066ee874f21b4e017f3800a33dd) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:52:38.851043 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cba621-ac6e-45ca-a218-11c66b1d24b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:52:38.852469 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cba621-ac6e-45ca-a218-11c66b1d24b2 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:52:38.858402 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 591/1200] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 10 09:52:38 2022] GET /identity/v3/role_assignments?user.id=02ceb066ee874f21b4e017f3800a33dd&scope.project.id=e6c0e0559ff841b6b3606800cd94e0c9&role.id=eb04edc46b3742d7a0f0ead26f68bc22 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:52:48.686691 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=74 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:52:48.855709 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=40 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:53:33.473039 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b248e36-4c15-4e13-88ee-3e2efa2b2c01 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:53:33.473709 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b248e36-4c15-4e13-88ee-3e2efa2b2c01 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:53:33.473709 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b248e36-4c15-4e13-88ee-3e2efa2b2c01 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:53:33.475446 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 610/1201] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:53:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:53:33.483402 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8e994a-78cf-4c15-a22b-987691821ec5 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:53:33.483884 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8e994a-78cf-4c15-a22b-987691821ec5 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:53:33.484031 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8e994a-78cf-4c15-a22b-987691821ec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:53:33.502608 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-7b8e994a-78cf-4c15-a22b-987691821ec5 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:53:33.503822 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-7b8e994a-78cf-4c15-a22b-987691821ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:53:33.590010 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 592/1202] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:53:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 09:53:33.621612 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b248e36-4c15-4e13-88ee-3e2efa2b2c01 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:53:33.747832 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b248e36-4c15-4e13-88ee-3e2efa2b2c01 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:53:33.789983 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621e1272-52dc-4b6b-a471-44e40b3eb35f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:53:33.790630 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621e1272-52dc-4b6b-a471-44e40b3eb35f None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:53:33.790952 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621e1272-52dc-4b6b-a471-44e40b3eb35f None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:53:33.791204 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621e1272-52dc-4b6b-a471-44e40b3eb35f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:53:33.803678 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621e1272-52dc-4b6b-a471-44e40b3eb35f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:53:33.805253 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621e1272-52dc-4b6b-a471-44e40b3eb35f None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:53:33.823784 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-621e1272-52dc-4b6b-a471-44e40b3eb35f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:53:33.823784 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:53:33.823784 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:53:33.823784 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:53:33.823784 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:53:33.823784 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:53:33.823784 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:53:33.823784 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:53:33.823784 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:53:33.823784 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:53:33.823784 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:53:33.823784 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:53:33.823784 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 09:53:33.823784 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 09:53:33.823784 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 09:53:33.823784 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 09:53:33.830320 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:53:33.830320 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:53:33.830320 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:53:33.830320 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:53:33.830320 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:53:33.830320 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:53:33.830320 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:53:33.830320 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:53:33.830320 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:53:33.830320 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:53:33.830320 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:53:33.830320 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:53:33.830320 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:53:33.830320 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:53:33.830320 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:53:33.830320 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:53:33.830320 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 09:53:33.831865 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 09:53:33.831865 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:53:33.831865 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:53:33.831865 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 611/1203] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 10 09:53:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:53:33.834076 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8e994a-78cf-4c15-a22b-987691821ec5 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:53:33.965222 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8e994a-78cf-4c15-a22b-987691821ec5 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:53:34.000363 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:53:34.008146 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc6396a-f377-451e-8037-aea634a03b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:53:34.009008 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc6396a-f377-451e-8037-aea634a03b7e None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:53:34.009300 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc6396a-f377-451e-8037-aea634a03b7e None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:53:34.009574 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc6396a-f377-451e-8037-aea634a03b7e None admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:53:34.010230 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc6396a-f377-451e-8037-aea634a03b7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:53:34.010587 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc6396a-f377-451e-8037-aea634a03b7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:53:34.011974 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc6396a-f377-451e-8037-aea634a03b7e None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:53:34.024877 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 593/1204] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 10 09:53:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 09:53:34.031012 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621e1272-52dc-4b6b-a471-44e40b3eb35f None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:53:34.096018 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:53:34.157659 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621e1272-52dc-4b6b-a471-44e40b3eb35f None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:53:34.197838 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c95822-93d5-49dd-b347-8cfb3e8cd3c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:53:34.198613 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c95822-93d5-49dd-b347-8cfb3e8cd3c6 None admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:53:34.198765 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c95822-93d5-49dd-b347-8cfb3e8cd3c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:53:34.199037 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c95822-93d5-49dd-b347-8cfb3e8cd3c6 None admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:53:34.199716 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c95822-93d5-49dd-b347-8cfb3e8cd3c6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:53:34.201154 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c95822-93d5-49dd-b347-8cfb3e8cd3c6 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:53:34.233113 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 612/1205] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Aug 10 09:53:34 2022] POST /identity/v3/users => generated 251 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 09:53:36.346150 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5384bd8a-5504-49e6-84d2-5ea13e624857 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:53:36.346769 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5384bd8a-5504-49e6-84d2-5ea13e624857 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:53:36.346769 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5384bd8a-5504-49e6-84d2-5ea13e624857 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:53:36.348055 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 594/1206] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:53:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:53:36.353756 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68773edd-8480-4e88-a59d-1365efd30937 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:53:36.354232 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68773edd-8480-4e88-a59d-1365efd30937 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:53:36.354341 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68773edd-8480-4e88-a59d-1365efd30937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:53:36.374020 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-68773edd-8480-4e88-a59d-1365efd30937 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:53:36.375230 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-68773edd-8480-4e88-a59d-1365efd30937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:53:36.447554 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 613/1207] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:53:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 09:53:36.470509 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5384bd8a-5504-49e6-84d2-5ea13e624857 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:53:36.585859 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5384bd8a-5504-49e6-84d2-5ea13e624857 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:53:36.629874 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3baed1a-b1a2-432d-8fd9-424503098a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:53:36.630510 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3baed1a-b1a2-432d-8fd9-424503098a41 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:53:36.630851 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3baed1a-b1a2-432d-8fd9-424503098a41 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:53:36.631195 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3baed1a-b1a2-432d-8fd9-424503098a41 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:53:36.643641 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3baed1a-b1a2-432d-8fd9-424503098a41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 09:53:36.648902 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-b3baed1a-b1a2-432d-8fd9-424503098a41 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 09:53:36.648902 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:53:36.648902 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:53:36.648902 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:53:36.648902 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:53:36.648902 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:53:36.648902 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:53:36.648902 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:53:36.648902 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:53:36.648902 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:53:36.648902 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:53:36.648902 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:53:36.648902 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 09:53:36.648902 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 09:53:36.648902 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 09:53:36.648902 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 09:53:36.650086 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 09:53:36.650086 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 09:53:36.650086 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 09:53:36.650086 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 09:53:36.650086 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:53:36.650086 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:53:36.650086 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:53:36.650086 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:53:36.650086 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:53:36.650086 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:53:36.650086 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:53:36.650086 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:53:36.650086 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:53:36.650086 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:53:36.650086 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:53:36.650086 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:53:36.651005 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:53:36.651005 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:53:36.651005 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:53:36.651005 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:53:36.651005 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 09:53:36.651005 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 09:53:36.651005 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 09:53:36.651005 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 09:53:36.651005 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 09:53:36.651005 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 09:53:36.651005 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 09:53:36.651005 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:53:36.651005 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 595/1208] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Aug 10 09:53:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:53:36.658660 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68773edd-8480-4e88-a59d-1365efd30937 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:53:36.702295 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:53:36.763266 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68773edd-8480-4e88-a59d-1365efd30937 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:53:36.804146 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0be98e0-023b-4722-957b-494bfce520bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:53:36.804953 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0be98e0-023b-4722-957b-494bfce520bc None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:53:36.805255 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0be98e0-023b-4722-957b-494bfce520bc None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:53:36.805580 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0be98e0-023b-4722-957b-494bfce520bc None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:53:36.806290 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0be98e0-023b-4722-957b-494bfce520bc None admin] RBAC: Adding query filter params (name=service) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:53:36.806612 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0be98e0-023b-4722-957b-494bfce520bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:53:36.808210 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0be98e0-023b-4722-957b-494bfce520bc None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:53:36.819813 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 614/1209] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Aug 10 09:53:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:53:36.825905 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3baed1a-b1a2-432d-8fd9-424503098a41 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:53:36.881882 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:53:36.939222 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3baed1a-b1a2-432d-8fd9-424503098a41 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:53:36.979994 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e790f224-8e8d-4e4e-b423-d20019b684ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:53:36.980670 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e790f224-8e8d-4e4e-b423-d20019b684ec None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:53:36.980945 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e790f224-8e8d-4e4e-b423-d20019b684ec None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:53:36.981257 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e790f224-8e8d-4e4e-b423-d20019b684ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:53:36.996470 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e790f224-8e8d-4e4e-b423-d20019b684ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:53:36.998565 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e790f224-8e8d-4e4e-b423-d20019b684ec None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:53:37.015898 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-e790f224-8e8d-4e4e-b423-d20019b684ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:53:37.015898 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:53:37.015898 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:53:37.015898 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:53:37.015898 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:53:37.015898 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:53:37.015898 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:53:37.015898 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:53:37.015898 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:53:37.015898 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:53:37.015898 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:53:37.015898 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:53:37.015898 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 09:53:37.015898 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 09:53:37.015898 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 09:53:37.015898 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 09:53:37.017246 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:53:37.017246 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:53:37.017246 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:53:37.017246 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:53:37.017246 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:53:37.017246 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:53:37.017246 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:53:37.017246 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:53:37.017246 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:53:37.017246 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:53:37.017246 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:53:37.017246 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:53:37.017246 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:53:37.017246 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:53:37.017246 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:53:37.017246 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:53:37.017246 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 09:53:37.018446 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 09:53:37.018446 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:53:37.018446 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:53:37.021235 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 596/1210] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 10 09:53:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 09:53:37.024699 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0be98e0-023b-4722-957b-494bfce520bc None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:53:37.134476 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:53:37.137688 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0be98e0-023b-4722-957b-494bfce520bc None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:53:37.177053 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f15c2fd-cf79-4907-976b-f3c708622ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:53:37.177787 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f15c2fd-cf79-4907-976b-f3c708622ed9 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:53:37.178142 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f15c2fd-cf79-4907-976b-f3c708622ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:53:37.178482 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f15c2fd-cf79-4907-976b-f3c708622ed9 None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:53:37.179210 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f15c2fd-cf79-4907-976b-f3c708622ed9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:53:37.179590 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f15c2fd-cf79-4907-976b-f3c708622ed9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:53:37.181036 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f15c2fd-cf79-4907-976b-f3c708622ed9 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:53:37.196159 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 615/1211] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 10 09:53:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:53:37.199527 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e790f224-8e8d-4e4e-b423-d20019b684ec None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:53:37.315747 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e790f224-8e8d-4e4e-b423-d20019b684ec None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:53:37.317585 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:53:37.354643 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f7e6b2-e04d-41b9-8132-289600d66e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:53:37.356259 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f7e6b2-e04d-41b9-8132-289600d66e92 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:53:37.356259 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f7e6b2-e04d-41b9-8132-289600d66e92 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:53:37.356259 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f7e6b2-e04d-41b9-8132-289600d66e92 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:53:37.367169 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f7e6b2-e04d-41b9-8132-289600d66e92 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:53:37.368726 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f7e6b2-e04d-41b9-8132-289600d66e92 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:53:37.380975 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-b3f7e6b2-e04d-41b9-8132-289600d66e92 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 10 09:53:37.380975 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:53:37.380975 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:53:37.380975 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:53:37.380975 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:53:37.380975 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:53:37.380975 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:53:37.380975 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:53:37.380975 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:53:37.380975 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:53:37.380975 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:53:37.380975 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:53:37.380975 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 09:53:37.380975 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 09:53:37.380975 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 09:53:37.380975 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 09:53:37.382365 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:53:37.382365 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:53:37.382365 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 09:53:37.382365 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 09:53:37.382365 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 09:53:37.382365 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 09:53:37.382365 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:53:37.382365 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:53:37.382365 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:53:37.382365 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:53:37.382365 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:53:37.382365 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:53:37.382365 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:53:37.382365 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:53:37.382365 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:53:37.382365 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:53:37.382365 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:53:37.382365 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:53:37.383399 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:53:37.383399 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:53:37.383399 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 09:53:37.383399 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 09:53:37.383399 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 09:53:37.383399 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 09:53:37.383399 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 09:53:37.383399 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 09:53:37.383399 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 10 09:53:37.383399 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:53:37.383399 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 597/1212] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 10 09:53:37 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 09:53:37.388415 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f15c2fd-cf79-4907-976b-f3c708622ed9 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:53:37.493578 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f15c2fd-cf79-4907-976b-f3c708622ed9 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:53:37.535880 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f965dae2-e6ff-4b28-944b-7e321cbbf1d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:53:37.536532 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f965dae2-e6ff-4b28-944b-7e321cbbf1d6 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:53:37.536812 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f965dae2-e6ff-4b28-944b-7e321cbbf1d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:53:37.537107 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f965dae2-e6ff-4b28-944b-7e321cbbf1d6 None admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:53:37.538018 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f965dae2-e6ff-4b28-944b-7e321cbbf1d6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:53:37.538329 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f965dae2-e6ff-4b28-944b-7e321cbbf1d6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:53:37.539890 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f965dae2-e6ff-4b28-944b-7e321cbbf1d6 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:53:37.558154 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 616/1213] 10.222.0.27 () {56 vars in 1143 bytes} [Wed Aug 10 09:53:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:53:37.563948 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f7e6b2-e04d-41b9-8132-289600d66e92 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:53:37.683062 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f7e6b2-e04d-41b9-8132-289600d66e92 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:53:37.727383 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4d4632-de91-4992-817c-27183b09f5cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:53:37.727993 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4d4632-de91-4992-817c-27183b09f5cb None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:53:37.728271 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4d4632-de91-4992-817c-27183b09f5cb None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:53:37.728542 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4d4632-de91-4992-817c-27183b09f5cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:53:37.763540 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:53:37.807688 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4d4632-de91-4992-817c-27183b09f5cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:53:37.809258 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4d4632-de91-4992-817c-27183b09f5cb None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:53:37.923171 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 598/1214] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 10 09:53:37 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 09:53:37.929045 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f965dae2-e6ff-4b28-944b-7e321cbbf1d6 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:53:37.951678 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:53:38.034668 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f965dae2-e6ff-4b28-944b-7e321cbbf1d6 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:53:38.073206 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83133f78-0d67-4e6e-81d4-c7570e48a442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:53:38.073870 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83133f78-0d67-4e6e-81d4-c7570e48a442 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:53:38.074149 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83133f78-0d67-4e6e-81d4-c7570e48a442 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:53:38.074417 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83133f78-0d67-4e6e-81d4-c7570e48a442 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:53:38.087870 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83133f78-0d67-4e6e-81d4-c7570e48a442 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:53:38.089428 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83133f78-0d67-4e6e-81d4-c7570e48a442 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:53:38.104169 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-83133f78-0d67-4e6e-81d4-c7570e48a442 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:53:38.104169 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:53:38.104169 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:53:38.104169 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:53:38.104169 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:53:38.104169 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:53:38.104169 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:53:38.104169 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:53:38.104169 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:53:38.104169 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:53:38.104169 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:53:38.104169 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:53:38.104169 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 09:53:38.104169 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 09:53:38.104169 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 09:53:38.104169 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 09:53:38.105284 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:53:38.105284 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:53:38.105284 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:53:38.105284 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:53:38.105284 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:53:38.105284 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:53:38.105284 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:53:38.105284 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:53:38.105284 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:53:38.105284 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:53:38.105284 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:53:38.105284 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:53:38.105284 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:53:38.105284 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:53:38.105284 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:53:38.105284 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:53:38.105284 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 09:53:38.106195 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 09:53:38.106195 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:53:38.106195 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:53:38.106195 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 617/1215] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 10 09:53:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:53:38.111148 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4d4632-de91-4992-817c-27183b09f5cb None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:53:38.183622 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:53:38.228200 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4d4632-de91-4992-817c-27183b09f5cb None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:53:38.267097 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f54ebca-6412-41e6-9e51-4923209bd754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:53:38.267707 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f54ebca-6412-41e6-9e51-4923209bd754 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:53:38.267988 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f54ebca-6412-41e6-9e51-4923209bd754 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:53:38.268260 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f54ebca-6412-41e6-9e51-4923209bd754 None admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:53:38.268909 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f54ebca-6412-41e6-9e51-4923209bd754 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:53:38.269937 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f54ebca-6412-41e6-9e51-4923209bd754 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:53:38.270622 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f54ebca-6412-41e6-9e51-4923209bd754 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:53:38.288418 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 599/1216] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 10 09:53:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:53:38.289799 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83133f78-0d67-4e6e-81d4-c7570e48a442 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:53:38.369792 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:53:38.402701 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83133f78-0d67-4e6e-81d4-c7570e48a442 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:53:38.443929 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe695d4-e310-4b0e-b113-9af2abeb1bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:53:38.444123 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe695d4-e310-4b0e-b113-9af2abeb1bdc None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:53:38.444338 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe695d4-e310-4b0e-b113-9af2abeb1bdc None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:53:38.444576 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe695d4-e310-4b0e-b113-9af2abeb1bdc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:53:38.452000 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe695d4-e310-4b0e-b113-9af2abeb1bdc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:53:38.453697 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe695d4-e310-4b0e-b113-9af2abeb1bdc None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:53:38.466027 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-8fe695d4-e310-4b0e-b113-9af2abeb1bdc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 09:53:38.466027 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:53:38.466027 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:53:38.466027 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:53:38.466027 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:53:38.466027 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:53:38.466027 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:53:38.466027 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:53:38.466027 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:53:38.466027 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:53:38.466027 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:53:38.466027 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:53:38.466027 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 09:53:38.466027 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 09:53:38.466027 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 09:53:38.468552 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 09:53:38.468552 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:53:38.468552 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:53:38.468552 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:53:38.468552 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:53:38.468552 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:53:38.468552 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:53:38.468552 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:53:38.468552 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:53:38.468552 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:53:38.468552 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:53:38.468552 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:53:38.468552 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:53:38.468552 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:53:38.468552 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:53:38.468552 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:53:38.468552 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:53:38.469680 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 09:53:38.469680 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 09:53:38.469680 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 09:53:38.469680 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 09:53:38.469680 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 09:53:38.469680 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 09:53:38.469680 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 09:53:38.469680 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:53:38.469680 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 618/1217] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 10 09:53:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:53:38.473590 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f54ebca-6412-41e6-9e51-4923209bd754 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:53:38.586157 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f54ebca-6412-41e6-9e51-4923209bd754 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:53:38.614004 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:53:38.632582 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347f23a1-7c0b-45ee-84ad-fbe0568af2aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:53:38.633369 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347f23a1-7c0b-45ee-84ad-fbe0568af2aa None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:53:38.633712 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347f23a1-7c0b-45ee-84ad-fbe0568af2aa None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:53:38.634061 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347f23a1-7c0b-45ee-84ad-fbe0568af2aa None admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:53:38.634881 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347f23a1-7c0b-45ee-84ad-fbe0568af2aa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:53:38.635177 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347f23a1-7c0b-45ee-84ad-fbe0568af2aa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:53:38.636760 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347f23a1-7c0b-45ee-84ad-fbe0568af2aa None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:53:38.649890 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 600/1218] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Aug 10 09:53:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 09:53:38.657717 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe695d4-e310-4b0e-b113-9af2abeb1bdc None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:53:38.776386 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe695d4-e310-4b0e-b113-9af2abeb1bdc None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:53:38.805804 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:53:38.813268 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7203dc2-c559-4b6e-9929-584c863d3a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:53:38.813882 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7203dc2-c559-4b6e-9929-584c863d3a20 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:53:38.814159 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7203dc2-c559-4b6e-9929-584c863d3a20 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:53:38.814434 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7203dc2-c559-4b6e-9929-584c863d3a20 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:53:38.815498 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7203dc2-c559-4b6e-9929-584c863d3a20 None admin] RBAC: Adding query filter params (role.id=c0cf832e3b184857b8eaed2f68da1532, scope.project.id=d47d5b72a00642a1a239b785110643ef, user.id=a6b658f1e27b4dfb96de71dc6a7e9496) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:53:38.815807 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7203dc2-c559-4b6e-9929-584c863d3a20 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:53:38.817256 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7203dc2-c559-4b6e-9929-584c863d3a20 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:53:38.823171 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 619/1219] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 10 09:53:38 2022] GET /identity/v3/role_assignments?user.id=a6b658f1e27b4dfb96de71dc6a7e9496&scope.project.id=d47d5b72a00642a1a239b785110643ef&role.id=c0cf832e3b184857b8eaed2f68da1532 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:53:40.858935 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e024d-4bc5-4595-b2b9-9222fa84bff1 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:53:40.859526 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e024d-4bc5-4595-b2b9-9222fa84bff1 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:53:40.859526 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e024d-4bc5-4595-b2b9-9222fa84bff1 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:53:40.860839 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 601/1220] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:53:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:53:40.866398 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e56963-e680-4039-a1cb-afc89a09f78c None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:53:40.866858 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e56963-e680-4039-a1cb-afc89a09f78c None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:53:40.866959 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e56963-e680-4039-a1cb-afc89a09f78c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:53:40.885908 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-94e56963-e680-4039-a1cb-afc89a09f78c None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:53:40.887196 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-94e56963-e680-4039-a1cb-afc89a09f78c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:53:40.956091 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 620/1221] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:53:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 09:53:40.979569 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3e024d-4bc5-4595-b2b9-9222fa84bff1 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:53:41.094411 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3e024d-4bc5-4595-b2b9-9222fa84bff1 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:53:41.133569 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28548fc1-db45-4211-bf96-c9dbbd591312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:53:41.134298 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28548fc1-db45-4211-bf96-c9dbbd591312 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:53:41.134591 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28548fc1-db45-4211-bf96-c9dbbd591312 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:53:41.134886 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28548fc1-db45-4211-bf96-c9dbbd591312 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:53:41.145575 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28548fc1-db45-4211-bf96-c9dbbd591312 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 09:53:41.150775 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-28548fc1-db45-4211-bf96-c9dbbd591312 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 09:53:41.150775 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:53:41.150775 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:53:41.150775 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:53:41.150775 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:53:41.150775 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:53:41.150775 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:53:41.150775 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:53:41.150775 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:53:41.150775 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:53:41.150775 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:53:41.150775 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:53:41.150775 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 09:53:41.150775 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 09:53:41.150775 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 09:53:41.150775 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 09:53:41.151955 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 09:53:41.151955 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 09:53:41.151955 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 09:53:41.151955 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 09:53:41.151955 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:53:41.151955 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:53:41.151955 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:53:41.151955 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:53:41.151955 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:53:41.151955 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:53:41.151955 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:53:41.151955 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:53:41.151955 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:53:41.151955 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:53:41.151955 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:53:41.151955 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:53:41.153025 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:53:41.153025 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:53:41.153025 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:53:41.153025 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:53:41.153025 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 09:53:41.153025 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 09:53:41.153025 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 09:53:41.153025 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 09:53:41.153025 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 09:53:41.153025 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 09:53:41.153025 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 09:53:41.153025 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:53:41.153025 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 602/1222] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Aug 10 09:53:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:53:41.158443 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e56963-e680-4039-a1cb-afc89a09f78c None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:53:41.263584 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e56963-e680-4039-a1cb-afc89a09f78c None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:53:41.287946 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:53:41.300410 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daebbcc-bd58-4555-b6ea-c24111fdbc48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:53:41.301032 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daebbcc-bd58-4555-b6ea-c24111fdbc48 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:53:41.301380 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daebbcc-bd58-4555-b6ea-c24111fdbc48 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:53:41.301657 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daebbcc-bd58-4555-b6ea-c24111fdbc48 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:53:41.302455 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daebbcc-bd58-4555-b6ea-c24111fdbc48 None admin] RBAC: Adding query filter params (name=service) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:53:41.302911 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daebbcc-bd58-4555-b6ea-c24111fdbc48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:53:41.304149 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daebbcc-bd58-4555-b6ea-c24111fdbc48 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:53:41.314124 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 621/1223] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Aug 10 09:53:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:53:41.322919 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28548fc1-db45-4211-bf96-c9dbbd591312 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:53:41.377117 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:53:41.440646 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28548fc1-db45-4211-bf96-c9dbbd591312 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:53:41.480237 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e112f72-d850-41f6-8852-78bb5b8af0e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:53:41.481395 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e112f72-d850-41f6-8852-78bb5b8af0e1 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:53:41.481725 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e112f72-d850-41f6-8852-78bb5b8af0e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:53:41.482018 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e112f72-d850-41f6-8852-78bb5b8af0e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:53:41.493280 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e112f72-d850-41f6-8852-78bb5b8af0e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:53:41.494760 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e112f72-d850-41f6-8852-78bb5b8af0e1 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:53:41.509175 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-4e112f72-d850-41f6-8852-78bb5b8af0e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:53:41.509175 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:53:41.509175 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:53:41.509175 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:53:41.509175 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:53:41.509175 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:53:41.509175 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:53:41.509175 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:53:41.509175 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:53:41.509175 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:53:41.509175 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:53:41.509175 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:53:41.509175 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 09:53:41.509175 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 09:53:41.509175 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 09:53:41.509175 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 09:53:41.510262 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:53:41.510262 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:53:41.510262 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:53:41.510262 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:53:41.510262 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:53:41.510262 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:53:41.510262 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:53:41.510262 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:53:41.510262 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:53:41.510262 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:53:41.510262 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:53:41.510262 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:53:41.510262 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:53:41.510262 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:53:41.510262 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:53:41.510262 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:53:41.510262 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 09:53:41.511290 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 09:53:41.511290 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:53:41.511290 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:53:41.511290 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 603/1224] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 10 09:53:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:53:41.516262 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daebbcc-bd58-4555-b6ea-c24111fdbc48 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:53:41.618303 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daebbcc-bd58-4555-b6ea-c24111fdbc48 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:53:41.657592 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f84714-1782-4bb8-8c11-cfe509a01db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:53:41.658206 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f84714-1782-4bb8-8c11-cfe509a01db9 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:53:41.658486 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f84714-1782-4bb8-8c11-cfe509a01db9 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:53:41.658756 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f84714-1782-4bb8-8c11-cfe509a01db9 None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:53:41.659439 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f84714-1782-4bb8-8c11-cfe509a01db9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:53:41.659745 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f84714-1782-4bb8-8c11-cfe509a01db9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:53:41.661129 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f84714-1782-4bb8-8c11-cfe509a01db9 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:53:41.679018 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 622/1225] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 10 09:53:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:53:41.680264 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e112f72-d850-41f6-8852-78bb5b8af0e1 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:53:41.779232 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:53:41.786104 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e112f72-d850-41f6-8852-78bb5b8af0e1 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:53:41.820898 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89b4b0d-a690-4542-8899-37f6a5313026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:53:41.821596 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89b4b0d-a690-4542-8899-37f6a5313026 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:53:41.821858 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89b4b0d-a690-4542-8899-37f6a5313026 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:53:41.822132 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89b4b0d-a690-4542-8899-37f6a5313026 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:53:41.830148 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89b4b0d-a690-4542-8899-37f6a5313026 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:53:41.831847 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89b4b0d-a690-4542-8899-37f6a5313026 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:53:41.843394 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-c89b4b0d-a690-4542-8899-37f6a5313026 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 10 09:53:41.843394 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:53:41.843394 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:53:41.843394 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:53:41.843394 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:53:41.843394 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:53:41.843394 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:53:41.843394 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:53:41.843394 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:53:41.843394 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:53:41.843394 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:53:41.843394 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:53:41.843394 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 09:53:41.843394 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 09:53:41.843394 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 09:53:41.843394 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 09:53:41.844701 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:53:41.844701 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:53:41.844701 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 09:53:41.844701 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 09:53:41.844701 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 09:53:41.844701 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 09:53:41.844701 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:53:41.844701 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:53:41.844701 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:53:41.844701 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:53:41.844701 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:53:41.844701 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:53:41.844701 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:53:41.844701 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:53:41.844701 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:53:41.844701 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:53:41.844701 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:53:41.844701 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:53:41.846094 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:53:41.846094 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:53:41.846094 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 09:53:41.846094 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 09:53:41.846094 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 09:53:41.846094 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 09:53:41.846094 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 09:53:41.846094 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 09:53:41.846094 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 10 09:53:41.846094 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:53:41.846094 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 604/1226] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 10 09:53:41 2022] GET /identity/v3/users/placement => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 09:53:41.850555 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f84714-1782-4bb8-8c11-cfe509a01db9 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:53:41.898766 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:53:41.954673 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f84714-1782-4bb8-8c11-cfe509a01db9 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:53:41.988820 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9886021f-a6e2-4abb-9194-5577ec3588e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:53:41.989606 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9886021f-a6e2-4abb-9194-5577ec3588e0 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:53:41.989883 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9886021f-a6e2-4abb-9194-5577ec3588e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:53:41.990153 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9886021f-a6e2-4abb-9194-5577ec3588e0 None admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:53:41.990882 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9886021f-a6e2-4abb-9194-5577ec3588e0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:53:41.991186 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9886021f-a6e2-4abb-9194-5577ec3588e0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:53:41.992627 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9886021f-a6e2-4abb-9194-5577ec3588e0 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:53:42.009970 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 623/1227] 10.222.0.27 () {56 vars in 1143 bytes} [Wed Aug 10 09:53:41 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 09:53:42.016192 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89b4b0d-a690-4542-8899-37f6a5313026 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:53:42.125416 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89b4b0d-a690-4542-8899-37f6a5313026 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:53:42.159723 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e6585c-f7c2-4173-84ba-66cc43daae33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:53:42.160352 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e6585c-f7c2-4173-84ba-66cc43daae33 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:53:42.160637 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e6585c-f7c2-4173-84ba-66cc43daae33 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:53:42.160902 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e6585c-f7c2-4173-84ba-66cc43daae33 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:53:42.171984 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e6585c-f7c2-4173-84ba-66cc43daae33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:53:42.173520 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e6585c-f7c2-4173-84ba-66cc43daae33 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:53:42.188037 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-e3e6585c-f7c2-4173-84ba-66cc43daae33 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:53:42.188037 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:53:42.188037 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:53:42.188037 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:53:42.188037 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:53:42.188037 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:53:42.188037 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:53:42.188037 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:53:42.188037 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:53:42.188037 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:53:42.188037 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:53:42.188037 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:53:42.188037 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 09:53:42.188037 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 09:53:42.188037 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 09:53:42.188037 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 09:53:42.189202 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:53:42.189202 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:53:42.189202 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:53:42.189202 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:53:42.189202 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:53:42.189202 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:53:42.189202 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:53:42.189202 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:53:42.189202 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:53:42.189202 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:53:42.189202 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:53:42.189202 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:53:42.189202 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:53:42.189202 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:53:42.189202 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:53:42.189202 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:53:42.189202 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 09:53:42.190839 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 09:53:42.190839 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:53:42.190839 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:53:42.190839 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 605/1228] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 10 09:53:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 09:53:42.195901 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9886021f-a6e2-4abb-9194-5577ec3588e0 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:53:42.302448 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9886021f-a6e2-4abb-9194-5577ec3588e0 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:53:42.305207 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:53:42.343257 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0d22cb-8a33-466d-9745-8469a9745ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:53:42.343865 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0d22cb-8a33-466d-9745-8469a9745ea8 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:53:42.344138 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0d22cb-8a33-466d-9745-8469a9745ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:53:42.344402 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0d22cb-8a33-466d-9745-8469a9745ea8 None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:53:42.345039 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0d22cb-8a33-466d-9745-8469a9745ea8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:53:42.345362 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0d22cb-8a33-466d-9745-8469a9745ea8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:53:42.346737 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0d22cb-8a33-466d-9745-8469a9745ea8 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:53:42.358067 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 624/1229] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 10 09:53:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:53:42.363657 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e6585c-f7c2-4173-84ba-66cc43daae33 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:53:42.373668 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:53:42.469099 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e6585c-f7c2-4173-84ba-66cc43daae33 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:53:42.506044 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69f3e9e-de23-4a0c-a700-1f559a1f6787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:53:42.506769 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69f3e9e-de23-4a0c-a700-1f559a1f6787 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:53:42.507084 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69f3e9e-de23-4a0c-a700-1f559a1f6787 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:53:42.507390 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69f3e9e-de23-4a0c-a700-1f559a1f6787 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:53:42.514815 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69f3e9e-de23-4a0c-a700-1f559a1f6787 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:53:42.516401 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69f3e9e-de23-4a0c-a700-1f559a1f6787 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:53:42.528391 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-a69f3e9e-de23-4a0c-a700-1f559a1f6787 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 09:53:42.528391 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:53:42.528391 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:53:42.528391 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:53:42.528391 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:53:42.528391 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:53:42.528391 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:53:42.528391 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:53:42.528391 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:53:42.528391 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:53:42.528391 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:53:42.528391 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:53:42.528391 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 09:53:42.528391 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 09:53:42.528391 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 09:53:42.529558 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 09:53:42.529558 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:53:42.529558 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:53:42.529558 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:53:42.529558 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:53:42.529558 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:53:42.529558 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:53:42.529558 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:53:42.529558 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:53:42.529558 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:53:42.529558 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:53:42.529558 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:53:42.529558 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:53:42.529558 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:53:42.529558 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:53:42.529558 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:53:42.529558 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:53:42.533573 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 09:53:42.533573 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 09:53:42.533573 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 09:53:42.533573 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 09:53:42.533573 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 09:53:42.533573 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 09:53:42.533573 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 09:53:42.533573 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:53:42.533573 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 606/1230] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 10 09:53:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:53:42.536478 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0d22cb-8a33-466d-9745-8469a9745ea8 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:53:42.642395 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0d22cb-8a33-466d-9745-8469a9745ea8 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:53:42.677348 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ea1a56-9306-4d1e-9b70-a6d91b2c4f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:53:42.678111 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea1a56-9306-4d1e-9b70-a6d91b2c4f41 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:53:42.678241 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea1a56-9306-4d1e-9b70-a6d91b2c4f41 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:53:42.678570 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea1a56-9306-4d1e-9b70-a6d91b2c4f41 None admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:53:42.679439 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ea1a56-9306-4d1e-9b70-a6d91b2c4f41 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:53:42.679746 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ea1a56-9306-4d1e-9b70-a6d91b2c4f41 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:53:42.681440 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ea1a56-9306-4d1e-9b70-a6d91b2c4f41 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:53:42.695981 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 625/1231] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Aug 10 09:53:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 09:53:42.702732 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69f3e9e-de23-4a0c-a700-1f559a1f6787 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:53:42.781304 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:53:42.820570 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69f3e9e-de23-4a0c-a700-1f559a1f6787 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:53:42.854645 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c6f8f9-18f5-47c1-bea9-2f6aebf4120f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:53:42.855300 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c6f8f9-18f5-47c1-bea9-2f6aebf4120f None admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:53:42.855575 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c6f8f9-18f5-47c1-bea9-2f6aebf4120f None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:53:42.855842 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c6f8f9-18f5-47c1-bea9-2f6aebf4120f None admin] PATH_INFO: `/v3/projects/d47d5b72a00642a1a239b785110643ef/users/a6b658f1e27b4dfb96de71dc6a7e9496/roles/c0cf832e3b184857b8eaed2f68da1532` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:53:42.870284 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c6f8f9-18f5-47c1-bea9-2f6aebf4120f None admin] RBAC: Authorizing `identity:create_grant(project_id=d47d5b72a00642a1a239b785110643ef, user_id=a6b658f1e27b4dfb96de71dc6a7e9496, role_id=c0cf832e3b184857b8eaed2f68da1532)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:53:42.871785 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c6f8f9-18f5-47c1-bea9-2f6aebf4120f None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:53:42.884441 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 607/1232] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Aug 10 09:53:42 2022] PUT /identity/v3/projects/d47d5b72a00642a1a239b785110643ef/users/a6b658f1e27b4dfb96de71dc6a7e9496/roles/c0cf832e3b184857b8eaed2f68da1532 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 09:53:44.976692 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ee687-1df0-40e3-8f9b-84535bd7b3b0 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:53:44.977266 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ee687-1df0-40e3-8f9b-84535bd7b3b0 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:53:44.977266 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ee687-1df0-40e3-8f9b-84535bd7b3b0 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:53:44.978783 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 626/1233] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:53:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:53:44.984707 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f0da16-e1ac-4c98-917e-eeef2833d1d4 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:53:44.985220 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f0da16-e1ac-4c98-917e-eeef2833d1d4 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:53:44.985421 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f0da16-e1ac-4c98-917e-eeef2833d1d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:53:45.003875 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-09f0da16-e1ac-4c98-917e-eeef2833d1d4 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:53:45.005306 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-09f0da16-e1ac-4c98-917e-eeef2833d1d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:53:45.082222 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 608/1234] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:53:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 10 09:53:45.108884 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39ee687-1df0-40e3-8f9b-84535bd7b3b0 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:53:45.138135 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:53:45.226998 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39ee687-1df0-40e3-8f9b-84535bd7b3b0 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:53:45.268370 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a15d1d-3cc0-466f-a7e9-71db0f69daa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:53:45.269054 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a15d1d-3cc0-466f-a7e9-71db0f69daa0 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:53:45.269309 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a15d1d-3cc0-466f-a7e9-71db0f69daa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:53:45.269583 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a15d1d-3cc0-466f-a7e9-71db0f69daa0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:53:45.279966 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a15d1d-3cc0-466f-a7e9-71db0f69daa0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 09:53:45.284727 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-67a15d1d-3cc0-466f-a7e9-71db0f69daa0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 09:53:45.284727 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:53:45.284727 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:53:45.284727 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:53:45.284727 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:53:45.284727 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:53:45.284727 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:53:45.284727 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:53:45.284727 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:53:45.284727 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:53:45.284727 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:53:45.284727 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:53:45.284727 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 09:53:45.284727 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 09:53:45.284727 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 09:53:45.284727 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 09:53:45.286073 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 09:53:45.286073 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 09:53:45.286073 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 09:53:45.286073 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 09:53:45.286073 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:53:45.286073 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:53:45.286073 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:53:45.286073 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:53:45.286073 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:53:45.286073 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:53:45.286073 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:53:45.286073 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:53:45.286073 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:53:45.286073 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:53:45.286073 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:53:45.286073 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:53:45.286912 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:53:45.286912 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:53:45.286912 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:53:45.286912 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:53:45.286912 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 09:53:45.286912 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 09:53:45.286912 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 09:53:45.286912 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 09:53:45.286912 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 09:53:45.286912 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 09:53:45.286912 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 10 09:53:45.286912 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:53:45.286912 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 627/1235] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Aug 10 09:53:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:53:45.292340 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f0da16-e1ac-4c98-917e-eeef2833d1d4 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:53:45.346603 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:53:45.405193 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f0da16-e1ac-4c98-917e-eeef2833d1d4 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:53:45.442082 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220dea67-31d6-43d7-8ac9-527ea99f186c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:53:45.442728 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220dea67-31d6-43d7-8ac9-527ea99f186c None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:53:45.443015 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220dea67-31d6-43d7-8ac9-527ea99f186c None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:53:45.443363 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220dea67-31d6-43d7-8ac9-527ea99f186c None admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:53:45.444096 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220dea67-31d6-43d7-8ac9-527ea99f186c None admin] RBAC: Adding query filter params (name=service) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:53:45.444407 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220dea67-31d6-43d7-8ac9-527ea99f186c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:53:45.445823 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220dea67-31d6-43d7-8ac9-527ea99f186c None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:53:45.454563 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 609/1236] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Aug 10 09:53:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:53:45.460278 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a15d1d-3cc0-466f-a7e9-71db0f69daa0 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:53:45.571149 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:53:45.590501 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a15d1d-3cc0-466f-a7e9-71db0f69daa0 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:53:45.624343 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80482b95-d3ab-4883-9aad-a183cde986df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:53:45.624971 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80482b95-d3ab-4883-9aad-a183cde986df None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:53:45.625277 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80482b95-d3ab-4883-9aad-a183cde986df None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:53:45.625544 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80482b95-d3ab-4883-9aad-a183cde986df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:53:45.638080 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80482b95-d3ab-4883-9aad-a183cde986df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:53:45.639628 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80482b95-d3ab-4883-9aad-a183cde986df None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:53:45.654722 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-80482b95-d3ab-4883-9aad-a183cde986df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:53:45.654722 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:53:45.654722 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:53:45.654722 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:53:45.654722 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:53:45.654722 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:53:45.654722 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:53:45.654722 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:53:45.654722 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:53:45.654722 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:53:45.654722 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:53:45.654722 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:53:45.654722 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 09:53:45.654722 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 09:53:45.654722 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 09:53:45.654722 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 09:53:45.655808 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:53:45.655808 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:53:45.655808 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:53:45.655808 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:53:45.655808 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:53:45.655808 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:53:45.655808 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:53:45.655808 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:53:45.655808 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:53:45.655808 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:53:45.655808 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:53:45.655808 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:53:45.655808 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:53:45.655808 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:53:45.655808 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:53:45.655808 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:53:45.655808 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 09:53:45.656677 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 09:53:45.656677 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:53:45.656677 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:53:45.656677 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 628/1237] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 10 09:53:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 09:53:45.661826 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220dea67-31d6-43d7-8ac9-527ea99f186c None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:53:45.769822 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220dea67-31d6-43d7-8ac9-527ea99f186c None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:53:45.779180 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:53:45.804580 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1849442e-e2f1-4671-9487-1c1bd788dac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:53:45.805313 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1849442e-e2f1-4671-9487-1c1bd788dac2 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:53:45.805542 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1849442e-e2f1-4671-9487-1c1bd788dac2 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:53:45.805847 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1849442e-e2f1-4671-9487-1c1bd788dac2 None admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:53:45.806497 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1849442e-e2f1-4671-9487-1c1bd788dac2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:53:45.806794 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1849442e-e2f1-4671-9487-1c1bd788dac2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:53:45.808229 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1849442e-e2f1-4671-9487-1c1bd788dac2 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:53:45.825748 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 610/1238] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 10 09:53:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:53:45.826968 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80482b95-d3ab-4883-9aad-a183cde986df None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:53:45.930566 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80482b95-d3ab-4883-9aad-a183cde986df None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:53:45.968346 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190f694d-86a7-46b2-a588-e83c574977a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:53:45.969057 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f694d-86a7-46b2-a588-e83c574977a6 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:53:45.969383 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f694d-86a7-46b2-a588-e83c574977a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:53:45.969639 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f694d-86a7-46b2-a588-e83c574977a6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:53:45.972481 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:53:45.978746 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190f694d-86a7-46b2-a588-e83c574977a6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:53:45.980344 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190f694d-86a7-46b2-a588-e83c574977a6 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:53:45.991974 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-190f694d-86a7-46b2-a588-e83c574977a6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 10 09:53:45.991974 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:53:45.991974 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:53:45.991974 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:53:45.991974 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:53:45.991974 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:53:45.991974 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:53:45.991974 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:53:45.991974 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:53:45.991974 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:53:45.991974 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:53:45.991974 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:53:45.991974 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 09:53:45.991974 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 09:53:45.991974 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 09:53:45.991974 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 09:53:45.993153 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:53:45.993153 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:53:45.993153 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 09:53:45.993153 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 09:53:45.993153 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 09:53:45.993153 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 09:53:45.993153 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:53:45.993153 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:53:45.993153 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:53:45.993153 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:53:45.993153 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:53:45.993153 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:53:45.993153 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:53:45.993153 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:53:45.993153 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:53:45.993153 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:53:45.993153 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:53:45.993153 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:53:45.994473 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:53:45.994473 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:53:45.994473 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 09:53:45.994473 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 09:53:45.994473 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 09:53:45.994473 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 09:53:45.994473 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 09:53:45.994473 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 09:53:45.994473 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 10 09:53:45.994473 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:53:45.994473 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 629/1239] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 10 09:53:45 2022] GET /identity/v3/users/placement => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:53:45.999516 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1849442e-e2f1-4671-9487-1c1bd788dac2 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:53:46.104951 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1849442e-e2f1-4671-9487-1c1bd788dac2 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:53:46.144652 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45acb29-fdca-425b-a4de-baa5a1dae59e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:53:46.145293 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45acb29-fdca-425b-a4de-baa5a1dae59e None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:53:46.145576 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45acb29-fdca-425b-a4de-baa5a1dae59e None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:53:46.145847 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45acb29-fdca-425b-a4de-baa5a1dae59e None admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:53:46.146572 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45acb29-fdca-425b-a4de-baa5a1dae59e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:53:46.146881 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45acb29-fdca-425b-a4de-baa5a1dae59e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:53:46.148321 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45acb29-fdca-425b-a4de-baa5a1dae59e None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:53:46.166614 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 611/1240] 10.222.0.27 () {56 vars in 1143 bytes} [Wed Aug 10 09:53:45 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:53:46.172752 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190f694d-86a7-46b2-a588-e83c574977a6 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:53:46.278770 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190f694d-86a7-46b2-a588-e83c574977a6 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:53:46.314449 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820564c2-c5c5-4925-a7e7-7d4f81338608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:53:46.315412 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820564c2-c5c5-4925-a7e7-7d4f81338608 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:53:46.315714 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820564c2-c5c5-4925-a7e7-7d4f81338608 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:53:46.315985 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820564c2-c5c5-4925-a7e7-7d4f81338608 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:53:46.378577 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:53:46.385812 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820564c2-c5c5-4925-a7e7-7d4f81338608 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:53:46.387347 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820564c2-c5c5-4925-a7e7-7d4f81338608 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:53:46.487727 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 630/1241] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 10 09:53:46 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 10 09:53:46.493851 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45acb29-fdca-425b-a4de-baa5a1dae59e None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:53:46.522811 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:53:46.597102 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45acb29-fdca-425b-a4de-baa5a1dae59e None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:53:46.636623 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b3067d-9a69-4826-9996-dd3b09fefa92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:53:46.637437 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b3067d-9a69-4826-9996-dd3b09fefa92 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:53:46.637837 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b3067d-9a69-4826-9996-dd3b09fefa92 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:53:46.638169 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b3067d-9a69-4826-9996-dd3b09fefa92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:53:46.650471 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b3067d-9a69-4826-9996-dd3b09fefa92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:53:46.651980 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b3067d-9a69-4826-9996-dd3b09fefa92 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:53:46.666618 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-f4b3067d-9a69-4826-9996-dd3b09fefa92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:53:46.666618 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:53:46.666618 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:53:46.666618 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:53:46.666618 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:53:46.666618 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:53:46.666618 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:53:46.666618 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:53:46.666618 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:53:46.666618 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:53:46.666618 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:53:46.666618 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:53:46.666618 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 09:53:46.666618 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 09:53:46.666618 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 09:53:46.666618 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 09:53:46.667724 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:53:46.667724 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:53:46.667724 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:53:46.667724 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:53:46.667724 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:53:46.667724 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:53:46.667724 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:53:46.667724 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:53:46.667724 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:53:46.667724 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:53:46.667724 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:53:46.667724 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:53:46.667724 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:53:46.667724 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:53:46.667724 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:53:46.667724 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:53:46.667724 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 09:53:46.668641 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 09:53:46.668641 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:53:46.668641 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:53:46.668641 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 612/1242] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 10 09:53:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:53:46.674088 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820564c2-c5c5-4925-a7e7-7d4f81338608 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:53:46.776345 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:53:46.782209 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820564c2-c5c5-4925-a7e7-7d4f81338608 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:53:46.819690 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a9bf5c-a448-4360-970b-b02888cdc04e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:53:46.820293 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a9bf5c-a448-4360-970b-b02888cdc04e None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:53:46.820569 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a9bf5c-a448-4360-970b-b02888cdc04e None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:53:46.820835 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a9bf5c-a448-4360-970b-b02888cdc04e None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:53:46.821522 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a9bf5c-a448-4360-970b-b02888cdc04e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:53:46.821838 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a9bf5c-a448-4360-970b-b02888cdc04e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:53:46.823265 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a9bf5c-a448-4360-970b-b02888cdc04e None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:53:46.834891 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 631/1243] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 10 09:53:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:53:46.840977 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b3067d-9a69-4826-9996-dd3b09fefa92 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:53:46.919964 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:53:46.942249 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b3067d-9a69-4826-9996-dd3b09fefa92 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:53:46.976861 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93dde7b-4236-49d7-a5cc-7873418a0fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:53:46.977515 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93dde7b-4236-49d7-a5cc-7873418a0fff None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:53:46.977792 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93dde7b-4236-49d7-a5cc-7873418a0fff None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:53:46.978058 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93dde7b-4236-49d7-a5cc-7873418a0fff None admin] PATH_INFO: `/v3/projects/service` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:53:46.985749 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93dde7b-4236-49d7-a5cc-7873418a0fff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:53:46.987312 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93dde7b-4236-49d7-a5cc-7873418a0fff None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:53:46.998742 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-a93dde7b-4236-49d7-a5cc-7873418a0fff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 09:53:46.998742 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:53:46.998742 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:53:46.998742 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:53:46.998742 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:53:46.998742 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:53:46.998742 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:53:46.998742 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:53:46.998742 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:53:46.998742 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:53:46.998742 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:53:46.998742 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:53:46.998742 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 09:53:46.998742 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 09:53:46.998742 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 09:53:47.004553 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 09:53:47.004553 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:53:47.004553 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:53:47.004553 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:53:47.004553 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:53:47.004553 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:53:47.004553 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:53:47.004553 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:53:47.004553 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:53:47.004553 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:53:47.004553 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:53:47.004553 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:53:47.004553 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:53:47.004553 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:53:47.004553 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:53:47.004553 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:53:47.004553 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:53:47.005699 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 09:53:47.005699 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 09:53:47.005699 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 09:53:47.005699 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 09:53:47.005699 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 09:53:47.005699 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 09:53:47.005699 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 09:53:47.005699 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:53:47.005699 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 613/1244] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 10 09:53:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:53:47.006273 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a9bf5c-a448-4360-970b-b02888cdc04e None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:53:47.118594 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a9bf5c-a448-4360-970b-b02888cdc04e None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:53:47.153849 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb843e6-6d5b-40a3-876b-9bd8cd68a0f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:53:47.154466 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb843e6-6d5b-40a3-876b-9bd8cd68a0f1 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:53:47.154734 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb843e6-6d5b-40a3-876b-9bd8cd68a0f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:53:47.155008 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb843e6-6d5b-40a3-876b-9bd8cd68a0f1 None admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:53:47.155710 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb843e6-6d5b-40a3-876b-9bd8cd68a0f1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:53:47.156018 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb843e6-6d5b-40a3-876b-9bd8cd68a0f1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:53:47.157485 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb843e6-6d5b-40a3-876b-9bd8cd68a0f1 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:53:47.174199 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 632/1245] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Aug 10 09:53:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:53:47.185209 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93dde7b-4236-49d7-a5cc-7873418a0fff None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:53:47.308378 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93dde7b-4236-49d7-a5cc-7873418a0fff None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:53:47.353423 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715979ff-7d08-4d31-8ae9-b66d0d844f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:53:47.354165 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715979ff-7d08-4d31-8ae9-b66d0d844f5a None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:53:47.354566 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715979ff-7d08-4d31-8ae9-b66d0d844f5a None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:53:47.355155 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715979ff-7d08-4d31-8ae9-b66d0d844f5a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:53:47.355981 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715979ff-7d08-4d31-8ae9-b66d0d844f5a None admin] RBAC: Adding query filter params (role.id=c0cf832e3b184857b8eaed2f68da1532, scope.project.id=d47d5b72a00642a1a239b785110643ef, user.id=a6b658f1e27b4dfb96de71dc6a7e9496) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:53:47.356347 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715979ff-7d08-4d31-8ae9-b66d0d844f5a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:53:47.358168 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715979ff-7d08-4d31-8ae9-b66d0d844f5a None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:53:47.363999 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 614/1246] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 10 09:53:47 2022] GET /identity/v3/role_assignments?user.id=a6b658f1e27b4dfb96de71dc6a7e9496&scope.project.id=d47d5b72a00642a1a239b785110643ef&role.id=c0cf832e3b184857b8eaed2f68da1532 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:53:49.593576 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a9499-ff65-4aff-ac4d-986ccd822cfe None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:53:49.594187 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a9499-ff65-4aff-ac4d-986ccd822cfe None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:53:49.594295 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a9499-ff65-4aff-ac4d-986ccd822cfe None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:53:49.595729 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 633/1247] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:53:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:53:49.601854 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba87e17-a90c-4013-b54d-e86ef3151aac None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:53:49.602345 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba87e17-a90c-4013-b54d-e86ef3151aac None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:53:49.602345 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba87e17-a90c-4013-b54d-e86ef3151aac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:53:49.611787 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:53:49.625366 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-6ba87e17-a90c-4013-b54d-e86ef3151aac None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:53:49.626814 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-6ba87e17-a90c-4013-b54d-e86ef3151aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:53:49.710753 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 615/1248] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:53:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 09:53:49.734007 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543a9499-ff65-4aff-ac4d-986ccd822cfe None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:53:49.755297 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:53:49.851635 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543a9499-ff65-4aff-ac4d-986ccd822cfe None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:53:49.892996 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254960e2-1750-4cac-86de-9bed2797f90c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:53:49.893673 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254960e2-1750-4cac-86de-9bed2797f90c None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:53:49.893949 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254960e2-1750-4cac-86de-9bed2797f90c None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:53:49.894220 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254960e2-1750-4cac-86de-9bed2797f90c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:53:49.905233 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254960e2-1750-4cac-86de-9bed2797f90c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 09:53:49.909906 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-254960e2-1750-4cac-86de-9bed2797f90c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 09:53:49.909906 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:53:49.909906 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:53:49.909906 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:53:49.909906 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:53:49.909906 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:53:49.909906 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:53:49.909906 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:53:49.909906 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:53:49.909906 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:53:49.909906 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:53:49.909906 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:53:49.909906 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 09:53:49.909906 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 09:53:49.909906 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 09:53:49.909906 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 09:53:49.911056 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 09:53:49.911056 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 09:53:49.911056 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 09:53:49.911056 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 09:53:49.911056 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:53:49.911056 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:53:49.911056 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:53:49.911056 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:53:49.911056 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:53:49.911056 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:53:49.911056 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:53:49.911056 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:53:49.911056 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:53:49.911056 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:53:49.911056 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:53:49.911056 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:53:49.911995 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:53:49.911995 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:53:49.911995 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:53:49.911995 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:53:49.911995 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 09:53:49.911995 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 09:53:49.911995 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 09:53:49.911995 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 09:53:49.911995 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 09:53:49.911995 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 09:53:49.911995 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 09:53:49.911995 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:53:49.911995 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 634/1249] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Aug 10 09:53:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 09:53:49.917207 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba87e17-a90c-4013-b54d-e86ef3151aac None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:53:50.020655 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba87e17-a90c-4013-b54d-e86ef3151aac None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:53:50.051349 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:53:50.056638 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b9eedd-6887-42f2-ade9-262e11958c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:53:50.058159 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b9eedd-6887-42f2-ade9-262e11958c88 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:53:50.058639 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b9eedd-6887-42f2-ade9-262e11958c88 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:53:50.059061 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b9eedd-6887-42f2-ade9-262e11958c88 None admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:53:50.059785 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b9eedd-6887-42f2-ade9-262e11958c88 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:53:50.060087 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b9eedd-6887-42f2-ade9-262e11958c88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:53:50.061509 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b9eedd-6887-42f2-ade9-262e11958c88 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:53:50.070996 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 616/1250] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 10 09:53:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:53:50.080352 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254960e2-1750-4cac-86de-9bed2797f90c None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:53:50.161994 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:53:50.188525 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254960e2-1750-4cac-86de-9bed2797f90c None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:53:50.224135 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e340e4b-f2a6-44f6-b2e7-5e9ca94fe46d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:53:50.224771 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e340e4b-f2a6-44f6-b2e7-5e9ca94fe46d None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:53:50.225052 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e340e4b-f2a6-44f6-b2e7-5e9ca94fe46d None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:53:50.225355 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e340e4b-f2a6-44f6-b2e7-5e9ca94fe46d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:53:50.237539 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e340e4b-f2a6-44f6-b2e7-5e9ca94fe46d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:53:50.239076 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e340e4b-f2a6-44f6-b2e7-5e9ca94fe46d None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:53:50.253662 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-7e340e4b-f2a6-44f6-b2e7-5e9ca94fe46d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:53:50.253662 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:53:50.253662 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:53:50.253662 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:53:50.253662 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:53:50.253662 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:53:50.253662 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:53:50.253662 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:53:50.253662 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:53:50.253662 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:53:50.253662 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:53:50.253662 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:53:50.253662 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 09:53:50.253662 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 09:53:50.253662 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 09:53:50.253662 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 09:53:50.254971 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:53:50.254971 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:53:50.254971 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:53:50.254971 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:53:50.254971 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:53:50.254971 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:53:50.254971 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:53:50.254971 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:53:50.254971 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:53:50.254971 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:53:50.254971 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:53:50.254971 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:53:50.254971 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:53:50.254971 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:53:50.254971 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:53:50.254971 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:53:50.254971 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 09:53:50.256180 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 09:53:50.256180 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:53:50.256180 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:53:50.256180 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 635/1251] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 10 09:53:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:53:50.261173 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b9eedd-6887-42f2-ade9-262e11958c88 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:53:50.374653 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b9eedd-6887-42f2-ade9-262e11958c88 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:53:50.410447 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3706b06c-77c6-423a-b1ac-7862e0eeb4b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:53:50.411096 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3706b06c-77c6-423a-b1ac-7862e0eeb4b7 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:53:50.411376 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3706b06c-77c6-423a-b1ac-7862e0eeb4b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:53:50.411643 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3706b06c-77c6-423a-b1ac-7862e0eeb4b7 None admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:53:50.412345 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3706b06c-77c6-423a-b1ac-7862e0eeb4b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:53:50.412589 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3706b06c-77c6-423a-b1ac-7862e0eeb4b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:53:50.414015 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3706b06c-77c6-423a-b1ac-7862e0eeb4b7 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:53:50.426616 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 617/1252] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 10 09:53:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:53:50.432230 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e340e4b-f2a6-44f6-b2e7-5e9ca94fe46d None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:53:50.537849 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e340e4b-f2a6-44f6-b2e7-5e9ca94fe46d None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:53:50.567684 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:53:50.577419 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c760a00-06f1-426e-b753-8c9c92ddb8c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:53:50.578141 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c760a00-06f1-426e-b753-8c9c92ddb8c6 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:53:50.578551 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c760a00-06f1-426e-b753-8c9c92ddb8c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:53:50.578932 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c760a00-06f1-426e-b753-8c9c92ddb8c6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:53:50.588867 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c760a00-06f1-426e-b753-8c9c92ddb8c6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:53:50.591073 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c760a00-06f1-426e-b753-8c9c92ddb8c6 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:53:50.604917 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-0c760a00-06f1-426e-b753-8c9c92ddb8c6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 10 09:53:50.604917 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:53:50.604917 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:53:50.604917 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:53:50.604917 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:53:50.604917 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:53:50.604917 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:53:50.604917 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:53:50.604917 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:53:50.604917 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:53:50.604917 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:53:50.604917 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:53:50.604917 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 09:53:50.604917 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 09:53:50.604917 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 09:53:50.604917 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 09:53:50.606818 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:53:50.606818 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:53:50.606818 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 09:53:50.606818 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 09:53:50.606818 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 09:53:50.606818 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 09:53:50.606818 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:53:50.606818 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:53:50.606818 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:53:50.606818 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:53:50.606818 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:53:50.606818 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:53:50.606818 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:53:50.606818 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:53:50.606818 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:53:50.606818 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:53:50.606818 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:53:50.606818 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:53:50.608149 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:53:50.608149 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:53:50.608149 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 09:53:50.608149 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 09:53:50.608149 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 09:53:50.608149 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 09:53:50.608149 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 09:53:50.608149 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 09:53:50.608149 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 10 09:53:50.608149 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:53:50.608149 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 636/1253] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 10 09:53:50 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:53:50.612280 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3706b06c-77c6-423a-b1ac-7862e0eeb4b7 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:53:50.676318 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:53:50.723799 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3706b06c-77c6-423a-b1ac-7862e0eeb4b7 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:53:50.763104 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276408ee-28a5-4019-a0e4-0f094336e74e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:53:50.763789 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276408ee-28a5-4019-a0e4-0f094336e74e None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:53:50.764137 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276408ee-28a5-4019-a0e4-0f094336e74e None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:53:50.764558 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276408ee-28a5-4019-a0e4-0f094336e74e None admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:53:50.765327 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276408ee-28a5-4019-a0e4-0f094336e74e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:53:50.765632 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276408ee-28a5-4019-a0e4-0f094336e74e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:53:50.767050 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276408ee-28a5-4019-a0e4-0f094336e74e None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:53:50.785900 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 618/1254] 10.222.0.27 () {56 vars in 1143 bytes} [Wed Aug 10 09:53:50 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:53:50.791981 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c760a00-06f1-426e-b753-8c9c92ddb8c6 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:53:50.904017 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c760a00-06f1-426e-b753-8c9c92ddb8c6 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:53:50.942524 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a19f52-c3f3-4554-92fa-bee8551992de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:53:50.943017 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a19f52-c3f3-4554-92fa-bee8551992de None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:53:50.943291 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a19f52-c3f3-4554-92fa-bee8551992de None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:53:50.943586 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a19f52-c3f3-4554-92fa-bee8551992de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:53:51.004522 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:53:51.020481 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a19f52-c3f3-4554-92fa-bee8551992de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:53:51.022272 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a19f52-c3f3-4554-92fa-bee8551992de None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:53:51.133746 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 637/1255] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 10 09:53:50 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 10 09:53:51.135117 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276408ee-28a5-4019-a0e4-0f094336e74e None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:53:51.241485 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276408ee-28a5-4019-a0e4-0f094336e74e None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:53:51.257032 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:53:51.284298 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fa2c93-3e23-4861-8334-05a5c4359a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:53:51.285030 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fa2c93-3e23-4861-8334-05a5c4359a27 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:53:51.285350 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fa2c93-3e23-4861-8334-05a5c4359a27 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:53:51.285637 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fa2c93-3e23-4861-8334-05a5c4359a27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:53:51.300701 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fa2c93-3e23-4861-8334-05a5c4359a27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:53:51.303637 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fa2c93-3e23-4861-8334-05a5c4359a27 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:53:51.323956 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-90fa2c93-3e23-4861-8334-05a5c4359a27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:53:51.323956 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:53:51.323956 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:53:51.323956 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:53:51.323956 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:53:51.323956 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:53:51.323956 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:53:51.323956 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:53:51.323956 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:53:51.323956 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:53:51.323956 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:53:51.323956 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:53:51.323956 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 09:53:51.323956 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 09:53:51.323956 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 09:53:51.323956 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 09:53:51.325198 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:53:51.325198 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:53:51.325198 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:53:51.325198 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:53:51.325198 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:53:51.325198 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:53:51.325198 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:53:51.325198 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:53:51.325198 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:53:51.325198 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:53:51.325198 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:53:51.325198 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:53:51.325198 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:53:51.325198 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:53:51.325198 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:53:51.325198 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:53:51.325198 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 09:53:51.326222 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 09:53:51.326222 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:53:51.326222 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:53:51.326222 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 619/1256] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 10 09:53:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:53:51.333434 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a19f52-c3f3-4554-92fa-bee8551992de None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:53:51.427335 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:53:51.441823 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a19f52-c3f3-4554-92fa-bee8551992de None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:53:51.478712 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2c93f1-a1ba-4c3a-be0f-5f39cb3a8a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:53:51.479351 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2c93f1-a1ba-4c3a-be0f-5f39cb3a8a11 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:53:51.479627 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2c93f1-a1ba-4c3a-be0f-5f39cb3a8a11 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:53:51.479894 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2c93f1-a1ba-4c3a-be0f-5f39cb3a8a11 None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:53:51.480566 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2c93f1-a1ba-4c3a-be0f-5f39cb3a8a11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:53:51.480838 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2c93f1-a1ba-4c3a-be0f-5f39cb3a8a11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:53:51.482243 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2c93f1-a1ba-4c3a-be0f-5f39cb3a8a11 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:53:51.493827 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 638/1257] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 10 09:53:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 09:53:51.499620 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fa2c93-3e23-4861-8334-05a5c4359a27 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:53:51.608991 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fa2c93-3e23-4861-8334-05a5c4359a27 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:53:51.647307 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f407c5-b580-4f70-81cf-07dda4fed148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:53:51.648319 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f407c5-b580-4f70-81cf-07dda4fed148 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:53:51.648319 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f407c5-b580-4f70-81cf-07dda4fed148 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:53:51.648613 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f407c5-b580-4f70-81cf-07dda4fed148 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:53:51.655369 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f407c5-b580-4f70-81cf-07dda4fed148 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:53:51.656849 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f407c5-b580-4f70-81cf-07dda4fed148 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:53:51.668917 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-78f407c5-b580-4f70-81cf-07dda4fed148 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 09:53:51.668917 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:53:51.668917 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:53:51.668917 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:53:51.668917 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:53:51.668917 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:53:51.668917 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:53:51.668917 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:53:51.668917 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:53:51.668917 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:53:51.668917 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:53:51.668917 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:53:51.668917 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 09:53:51.668917 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 09:53:51.668917 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 09:53:51.671508 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 09:53:51.671508 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:53:51.671508 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:53:51.671508 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:53:51.671508 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:53:51.671508 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:53:51.671508 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:53:51.671508 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:53:51.671508 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:53:51.671508 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:53:51.671508 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:53:51.671508 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:53:51.671508 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:53:51.671508 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:53:51.671508 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:53:51.671508 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:53:51.671508 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:53:51.672584 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 09:53:51.672584 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 09:53:51.672584 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 09:53:51.672584 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 09:53:51.672584 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 09:53:51.672584 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 09:53:51.672584 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 09:53:51.672584 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:53:51.672584 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 620/1258] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 10 09:53:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:53:51.676210 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2c93f1-a1ba-4c3a-be0f-5f39cb3a8a11 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:53:51.794195 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2c93f1-a1ba-4c3a-be0f-5f39cb3a8a11 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:53:51.831595 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e546063e-bcb3-43d6-851f-d612e461697a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:53:51.832250 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e546063e-bcb3-43d6-851f-d612e461697a None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:53:51.832623 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e546063e-bcb3-43d6-851f-d612e461697a None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:53:51.832895 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e546063e-bcb3-43d6-851f-d612e461697a None admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:53:51.833658 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e546063e-bcb3-43d6-851f-d612e461697a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:53:51.833976 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e546063e-bcb3-43d6-851f-d612e461697a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:53:51.835606 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e546063e-bcb3-43d6-851f-d612e461697a None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:53:51.849215 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 639/1259] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Aug 10 09:53:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:53:51.855858 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f407c5-b580-4f70-81cf-07dda4fed148 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:53:51.885998 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:53:51.971260 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f407c5-b580-4f70-81cf-07dda4fed148 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:53:52.013680 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5519bca3-564b-4ea4-acfb-8ffbfa468429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:53:52.015408 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5519bca3-564b-4ea4-acfb-8ffbfa468429 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:53:52.015802 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5519bca3-564b-4ea4-acfb-8ffbfa468429 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:53:52.016077 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5519bca3-564b-4ea4-acfb-8ffbfa468429 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:53:52.017016 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5519bca3-564b-4ea4-acfb-8ffbfa468429 None admin] RBAC: Adding query filter params (role.id=eb04edc46b3742d7a0f0ead26f68bc22, scope.project.id=d47d5b72a00642a1a239b785110643ef, user.id=a6b658f1e27b4dfb96de71dc6a7e9496) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:53:52.017384 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5519bca3-564b-4ea4-acfb-8ffbfa468429 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:53:52.019012 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5519bca3-564b-4ea4-acfb-8ffbfa468429 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:53:52.026025 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 621/1260] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 10 09:53:51 2022] GET /identity/v3/role_assignments?user.id=a6b658f1e27b4dfb96de71dc6a7e9496&scope.project.id=d47d5b72a00642a1a239b785110643ef&role.id=eb04edc46b3742d7a0f0ead26f68bc22 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 09:53:53.998820 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879dc236-9451-4809-ac2c-ac909b36a810 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:53:53.999404 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879dc236-9451-4809-ac2c-ac909b36a810 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:53:53.999404 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879dc236-9451-4809-ac2c-ac909b36a810 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:53:54.000725 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 640/1261] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:53:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:53:54.006757 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f6767-1b95-4f11-b661-6aa50b958317 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:53:54.007338 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f6767-1b95-4f11-b661-6aa50b958317 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:53:54.007338 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f6767-1b95-4f11-b661-6aa50b958317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:53:54.026722 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-4e7f6767-1b95-4f11-b661-6aa50b958317 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:53:54.027983 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-4e7f6767-1b95-4f11-b661-6aa50b958317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:53:54.105653 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 622/1262] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:53:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 09:53:54.128038 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879dc236-9451-4809-ac2c-ac909b36a810 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:53:54.141156 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:53:54.232167 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879dc236-9451-4809-ac2c-ac909b36a810 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:53:54.265733 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602e3820-d402-4e57-acc0-bf755c768aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:53:54.266294 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602e3820-d402-4e57-acc0-bf755c768aa5 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:53:54.266568 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602e3820-d402-4e57-acc0-bf755c768aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:53:54.266837 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602e3820-d402-4e57-acc0-bf755c768aa5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:53:54.277206 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602e3820-d402-4e57-acc0-bf755c768aa5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 09:53:54.281875 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-602e3820-d402-4e57-acc0-bf755c768aa5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 09:53:54.281875 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:53:54.281875 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:53:54.281875 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:53:54.281875 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:53:54.281875 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:53:54.281875 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:53:54.281875 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:53:54.281875 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:53:54.281875 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:53:54.281875 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:53:54.281875 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:53:54.281875 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 09:53:54.281875 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 09:53:54.281875 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 09:53:54.281875 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 09:53:54.282851 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 09:53:54.282851 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 09:53:54.282851 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 09:53:54.282851 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 09:53:54.282851 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:53:54.282851 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:53:54.282851 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:53:54.282851 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:53:54.282851 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:53:54.282851 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:53:54.282851 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:53:54.282851 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:53:54.282851 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:53:54.282851 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:53:54.282851 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:53:54.282851 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:53:54.284129 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:53:54.284129 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:53:54.284129 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:53:54.284129 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:53:54.284129 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 09:53:54.284129 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 09:53:54.284129 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 09:53:54.284129 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 09:53:54.284129 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 09:53:54.284129 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 09:53:54.284129 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 09:53:54.284129 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:53:54.284129 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 641/1263] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Aug 10 09:53:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:53:54.289411 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7f6767-1b95-4f11-b661-6aa50b958317 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:53:54.311350 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:53:54.402254 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7f6767-1b95-4f11-b661-6aa50b958317 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:53:54.434470 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb72ded-c09f-4729-8520-67b150a3d961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:53:54.435054 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb72ded-c09f-4729-8520-67b150a3d961 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:53:54.435328 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb72ded-c09f-4729-8520-67b150a3d961 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:53:54.435594 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb72ded-c09f-4729-8520-67b150a3d961 None admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:53:54.436250 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb72ded-c09f-4729-8520-67b150a3d961 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:53:54.436545 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb72ded-c09f-4729-8520-67b150a3d961 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:53:54.438016 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb72ded-c09f-4729-8520-67b150a3d961 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:53:54.446302 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 623/1264] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 10 09:53:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:53:54.455870 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602e3820-d402-4e57-acc0-bf755c768aa5 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:53:54.528670 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:53:54.561111 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602e3820-d402-4e57-acc0-bf755c768aa5 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:53:54.598199 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5dbb41-fc61-493e-84cf-2977b28a869b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:53:54.599095 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5dbb41-fc61-493e-84cf-2977b28a869b None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:53:54.599435 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5dbb41-fc61-493e-84cf-2977b28a869b None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:53:54.599733 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5dbb41-fc61-493e-84cf-2977b28a869b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:53:54.616567 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5dbb41-fc61-493e-84cf-2977b28a869b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:53:54.618889 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5dbb41-fc61-493e-84cf-2977b28a869b None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:53:54.633819 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-ff5dbb41-fc61-493e-84cf-2977b28a869b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:53:54.633819 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:53:54.633819 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:53:54.633819 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:53:54.633819 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:53:54.633819 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:53:54.633819 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:53:54.633819 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:53:54.633819 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:53:54.633819 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:53:54.633819 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:53:54.633819 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:53:54.633819 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 09:53:54.633819 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 09:53:54.633819 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 09:53:54.633819 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 09:53:54.634888 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:53:54.634888 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:53:54.634888 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:53:54.634888 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:53:54.634888 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:53:54.634888 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:53:54.634888 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:53:54.634888 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:53:54.634888 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:53:54.634888 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:53:54.634888 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:53:54.634888 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:53:54.634888 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:53:54.634888 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:53:54.634888 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:53:54.634888 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:53:54.634888 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 09:53:54.636211 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 09:53:54.636211 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:53:54.636211 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:53:54.636211 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 642/1265] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 10 09:53:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:53:54.642905 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb72ded-c09f-4729-8520-67b150a3d961 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:53:54.728437 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:53:54.750956 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb72ded-c09f-4729-8520-67b150a3d961 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:53:54.786090 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c676b1-e110-4e40-b9ab-d197161c877d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:53:54.786621 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c676b1-e110-4e40-b9ab-d197161c877d None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:53:54.786895 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c676b1-e110-4e40-b9ab-d197161c877d None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:53:54.787168 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c676b1-e110-4e40-b9ab-d197161c877d None admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:53:54.787810 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c676b1-e110-4e40-b9ab-d197161c877d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:53:54.788113 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c676b1-e110-4e40-b9ab-d197161c877d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:53:54.789517 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c676b1-e110-4e40-b9ab-d197161c877d None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:53:54.801173 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 624/1266] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 10 09:53:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:53:54.807458 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5dbb41-fc61-493e-84cf-2977b28a869b None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:53:54.908602 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5dbb41-fc61-493e-84cf-2977b28a869b None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:53:54.928643 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:53:54.945007 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d6b909-ef7e-4cab-956d-70b768ea4b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:53:54.945645 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d6b909-ef7e-4cab-956d-70b768ea4b04 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:53:54.945915 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d6b909-ef7e-4cab-956d-70b768ea4b04 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:53:54.946178 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d6b909-ef7e-4cab-956d-70b768ea4b04 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:53:54.953909 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d6b909-ef7e-4cab-956d-70b768ea4b04 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:53:54.955354 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d6b909-ef7e-4cab-956d-70b768ea4b04 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:53:54.966315 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-73d6b909-ef7e-4cab-956d-70b768ea4b04 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 10 09:53:54.966315 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:53:54.966315 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:53:54.966315 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:53:54.966315 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:53:54.966315 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:53:54.966315 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:53:54.966315 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:53:54.966315 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:53:54.966315 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:53:54.966315 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:53:54.966315 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:53:54.966315 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 09:53:54.966315 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 09:53:54.966315 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 09:53:54.966315 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 09:53:54.967344 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:53:54.967344 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:53:54.967344 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 09:53:54.967344 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 09:53:54.967344 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 09:53:54.967344 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 09:53:54.967344 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:53:54.967344 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:53:54.967344 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:53:54.967344 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:53:54.967344 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:53:54.967344 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:53:54.967344 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:53:54.967344 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:53:54.967344 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:53:54.967344 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:53:54.967344 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:53:54.967344 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:53:54.968509 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:53:54.968509 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:53:54.968509 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 09:53:54.968509 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 09:53:54.968509 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 09:53:54.968509 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 09:53:54.968509 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 09:53:54.968509 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 09:53:54.968509 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 10 09:53:54.968509 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:53:54.968509 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 643/1267] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 10 09:53:54 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:53:54.973388 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c676b1-e110-4e40-b9ab-d197161c877d None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:53:55.076933 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c676b1-e110-4e40-b9ab-d197161c877d None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:53:55.111772 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b538d6-17d2-4083-8b2a-7cf9ebcae068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:53:55.112356 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b538d6-17d2-4083-8b2a-7cf9ebcae068 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:53:55.112632 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b538d6-17d2-4083-8b2a-7cf9ebcae068 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:53:55.112900 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b538d6-17d2-4083-8b2a-7cf9ebcae068 None admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:53:55.113661 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b538d6-17d2-4083-8b2a-7cf9ebcae068 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:53:55.113964 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b538d6-17d2-4083-8b2a-7cf9ebcae068 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:53:55.115402 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b538d6-17d2-4083-8b2a-7cf9ebcae068 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:53:55.124101 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:53:55.133650 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 625/1268] 10.222.0.27 () {56 vars in 1143 bytes} [Wed Aug 10 09:53:54 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:53:55.140310 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d6b909-ef7e-4cab-956d-70b768ea4b04 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:53:55.250795 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d6b909-ef7e-4cab-956d-70b768ea4b04 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:53:55.285242 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e5db1b-0c47-4572-ba0a-7a340d8b78de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:53:55.285892 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e5db1b-0c47-4572-ba0a-7a340d8b78de None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:53:55.286164 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e5db1b-0c47-4572-ba0a-7a340d8b78de None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:53:55.286476 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e5db1b-0c47-4572-ba0a-7a340d8b78de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:53:55.298418 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e5db1b-0c47-4572-ba0a-7a340d8b78de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:53:55.300052 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e5db1b-0c47-4572-ba0a-7a340d8b78de None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:53:55.315620 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-63e5db1b-0c47-4572-ba0a-7a340d8b78de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:53:55.315620 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:53:55.315620 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:53:55.315620 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:53:55.315620 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:53:55.315620 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:53:55.315620 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:53:55.315620 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:53:55.315620 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:53:55.315620 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:53:55.315620 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:53:55.315620 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:53:55.315620 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 09:53:55.315620 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 09:53:55.315620 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 09:53:55.315620 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 09:53:55.316679 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:53:55.316679 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:53:55.316679 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:53:55.316679 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:53:55.316679 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:53:55.316679 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:53:55.316679 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:53:55.316679 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:53:55.316679 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:53:55.316679 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:53:55.316679 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:53:55.316679 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:53:55.316679 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:53:55.316679 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:53:55.316679 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:53:55.316679 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:53:55.316679 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 09:53:55.317595 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 09:53:55.317595 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:53:55.317595 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:53:55.317595 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 644/1269] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 10 09:53:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:53:55.323075 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b538d6-17d2-4083-8b2a-7cf9ebcae068 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:53:55.424812 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b538d6-17d2-4083-8b2a-7cf9ebcae068 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:53:55.459745 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49693673-2e15-4206-8bda-7ce9c02d1d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:53:55.460335 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49693673-2e15-4206-8bda-7ce9c02d1d3a None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:53:55.460613 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49693673-2e15-4206-8bda-7ce9c02d1d3a None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:53:55.460874 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49693673-2e15-4206-8bda-7ce9c02d1d3a None admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:53:55.461546 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49693673-2e15-4206-8bda-7ce9c02d1d3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:53:55.461843 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49693673-2e15-4206-8bda-7ce9c02d1d3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:53:55.463205 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49693673-2e15-4206-8bda-7ce9c02d1d3a None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:53:55.474608 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 626/1270] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 10 09:53:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:53:55.481243 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e5db1b-0c47-4572-ba0a-7a340d8b78de None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:53:55.524242 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:53:55.596858 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e5db1b-0c47-4572-ba0a-7a340d8b78de None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:53:55.631481 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518cc7f1-9d74-48e2-97e2-c3c2ab309c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:53:55.632090 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518cc7f1-9d74-48e2-97e2-c3c2ab309c92 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:53:55.632364 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518cc7f1-9d74-48e2-97e2-c3c2ab309c92 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:53:55.632630 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518cc7f1-9d74-48e2-97e2-c3c2ab309c92 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:53:55.639413 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518cc7f1-9d74-48e2-97e2-c3c2ab309c92 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:53:55.640851 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518cc7f1-9d74-48e2-97e2-c3c2ab309c92 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:53:55.651964 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-518cc7f1-9d74-48e2-97e2-c3c2ab309c92 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 09:53:55.651964 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:53:55.651964 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:53:55.651964 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:53:55.651964 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:53:55.651964 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:53:55.651964 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:53:55.651964 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:53:55.651964 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:53:55.651964 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:53:55.651964 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:53:55.651964 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:53:55.651964 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 09:53:55.651964 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 09:53:55.651964 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 09:53:55.652959 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 09:53:55.652959 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:53:55.652959 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:53:55.652959 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:53:55.652959 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:53:55.652959 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:53:55.652959 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:53:55.652959 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:53:55.652959 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:53:55.652959 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:53:55.652959 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:53:55.652959 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:53:55.652959 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:53:55.652959 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:53:55.652959 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:53:55.652959 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:53:55.652959 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:53:55.654381 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 09:53:55.654381 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 09:53:55.654381 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 09:53:55.654381 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 09:53:55.654381 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 09:53:55.654381 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 09:53:55.654381 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 09:53:55.654381 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:53:55.654381 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 645/1271] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 10 09:53:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:53:55.659854 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49693673-2e15-4206-8bda-7ce9c02d1d3a None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:53:55.731444 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:53:55.779380 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49693673-2e15-4206-8bda-7ce9c02d1d3a None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:53:55.813608 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2c3cc1-ac0e-4036-9c20-797fc57cc441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:53:55.814208 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2c3cc1-ac0e-4036-9c20-797fc57cc441 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:53:55.814484 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2c3cc1-ac0e-4036-9c20-797fc57cc441 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:53:55.814752 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2c3cc1-ac0e-4036-9c20-797fc57cc441 None admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:53:55.815789 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2c3cc1-ac0e-4036-9c20-797fc57cc441 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:53:55.816093 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2c3cc1-ac0e-4036-9c20-797fc57cc441 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:53:55.817566 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2c3cc1-ac0e-4036-9c20-797fc57cc441 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:53:55.829406 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 627/1272] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Aug 10 09:53:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:53:55.835797 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518cc7f1-9d74-48e2-97e2-c3c2ab309c92 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:53:55.933598 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:53:55.949565 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518cc7f1-9d74-48e2-97e2-c3c2ab309c92 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:53:55.995173 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d25890b-f896-4e4c-b0cb-2f0c1a169f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:53:55.995811 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d25890b-f896-4e4c-b0cb-2f0c1a169f59 None admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:53:55.996088 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d25890b-f896-4e4c-b0cb-2f0c1a169f59 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:53:55.996354 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d25890b-f896-4e4c-b0cb-2f0c1a169f59 None admin] PATH_INFO: `/v3/projects/d47d5b72a00642a1a239b785110643ef/users/a6b658f1e27b4dfb96de71dc6a7e9496/roles/eb04edc46b3742d7a0f0ead26f68bc22` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:53:55.998215 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d25890b-f896-4e4c-b0cb-2f0c1a169f59 None admin] RBAC: Authorizing `identity:create_grant(project_id=d47d5b72a00642a1a239b785110643ef, user_id=a6b658f1e27b4dfb96de71dc6a7e9496, role_id=eb04edc46b3742d7a0f0ead26f68bc22)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:53:55.999635 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d25890b-f896-4e4c-b0cb-2f0c1a169f59 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:53:56.018869 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 646/1273] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Aug 10 09:53:55 2022] PUT /identity/v3/projects/d47d5b72a00642a1a239b785110643ef/users/a6b658f1e27b4dfb96de71dc6a7e9496/roles/eb04edc46b3742d7a0f0ead26f68bc22 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 09:53:58.003895 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b362446-fe45-4ab4-8531-c61e44f58630 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:53:58.004462 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b362446-fe45-4ab4-8531-c61e44f58630 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:53:58.004462 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b362446-fe45-4ab4-8531-c61e44f58630 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:53:58.006603 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 628/1274] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:53:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:53:58.015164 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f3901d-1ade-4342-bf19-12d94088bfc1 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:53:58.015565 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f3901d-1ade-4342-bf19-12d94088bfc1 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:53:58.015775 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f3901d-1ade-4342-bf19-12d94088bfc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:53:58.042818 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-24f3901d-1ade-4342-bf19-12d94088bfc1 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:53:58.044625 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-24f3901d-1ade-4342-bf19-12d94088bfc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:53:58.123868 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 647/1275] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:53:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 09:53:58.158179 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b362446-fe45-4ab4-8531-c61e44f58630 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:53:58.280053 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b362446-fe45-4ab4-8531-c61e44f58630 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:53:58.298986 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:53:58.317733 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e434491-9baa-4890-b753-9d46db0c39e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:53:58.318361 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e434491-9baa-4890-b753-9d46db0c39e3 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:53:58.318639 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e434491-9baa-4890-b753-9d46db0c39e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:53:58.318912 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e434491-9baa-4890-b753-9d46db0c39e3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:53:58.329162 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e434491-9baa-4890-b753-9d46db0c39e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 09:53:58.333805 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-9e434491-9baa-4890-b753-9d46db0c39e3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 09:53:58.333805 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:53:58.333805 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:53:58.333805 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:53:58.333805 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:53:58.333805 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:53:58.333805 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:53:58.333805 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:53:58.333805 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:53:58.333805 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:53:58.333805 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:53:58.333805 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:53:58.333805 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 10 09:53:58.333805 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 10 09:53:58.333805 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 10 09:53:58.333805 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 10 09:53:58.334898 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 10 09:53:58.334898 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 10 09:53:58.334898 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 10 09:53:58.334898 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 10 09:53:58.334898 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:53:58.334898 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:53:58.334898 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:53:58.334898 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:53:58.334898 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:53:58.334898 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:53:58.334898 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:53:58.334898 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:53:58.334898 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:53:58.334898 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:53:58.334898 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:53:58.334898 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:53:58.335772 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:53:58.335772 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:53:58.335772 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:53:58.335772 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:53:58.335772 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 10 09:53:58.335772 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 10 09:53:58.335772 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 10 09:53:58.335772 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 10 09:53:58.335772 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 10 09:53:58.335772 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 10 09:53:58.335772 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 09:53:58.335772 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:53:58.335772 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 629/1276] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Aug 10 09:53:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:53:58.341284 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f3901d-1ade-4342-bf19-12d94088bfc1 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:53:58.424465 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:53:58.448350 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f3901d-1ade-4342-bf19-12d94088bfc1 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:53:58.482549 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc069198-7724-4000-ba16-2cc102a86824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:53:58.483404 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc069198-7724-4000-ba16-2cc102a86824 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:53:58.483900 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc069198-7724-4000-ba16-2cc102a86824 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:53:58.484390 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc069198-7724-4000-ba16-2cc102a86824 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:53:58.485558 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc069198-7724-4000-ba16-2cc102a86824 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:53:58.485880 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc069198-7724-4000-ba16-2cc102a86824 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:53:58.487253 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc069198-7724-4000-ba16-2cc102a86824 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:53:58.495672 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 648/1277] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Aug 10 09:53:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 09:53:58.504277 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e434491-9baa-4890-b753-9d46db0c39e3 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:53:58.608034 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e434491-9baa-4890-b753-9d46db0c39e3 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:53:58.642949 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2006bc6-f864-4253-aefe-c3d9522d253c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:53:58.643552 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2006bc6-f864-4253-aefe-c3d9522d253c None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:53:58.643829 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2006bc6-f864-4253-aefe-c3d9522d253c None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:53:58.644094 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2006bc6-f864-4253-aefe-c3d9522d253c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:53:58.654080 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2006bc6-f864-4253-aefe-c3d9522d253c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:53:58.655529 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2006bc6-f864-4253-aefe-c3d9522d253c None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:53:58.670095 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-b2006bc6-f864-4253-aefe-c3d9522d253c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:53:58.670095 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:53:58.670095 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:53:58.670095 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:53:58.670095 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:53:58.670095 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:53:58.670095 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:53:58.670095 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:53:58.670095 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:53:58.670095 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:53:58.670095 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:53:58.670095 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:53:58.670095 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 09:53:58.670095 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 09:53:58.670095 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 09:53:58.670095 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 09:53:58.671078 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:53:58.671078 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:53:58.671078 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:53:58.671078 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:53:58.671078 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:53:58.671078 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:53:58.671078 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:53:58.671078 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:53:58.671078 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:53:58.671078 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:53:58.671078 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:53:58.671078 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:53:58.671078 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:53:58.671078 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:53:58.671078 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:53:58.671078 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:53:58.671078 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 09:53:58.672046 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 09:53:58.672046 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:53:58.672046 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:53:58.672046 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 630/1278] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 10 09:53:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:53:58.677180 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc069198-7724-4000-ba16-2cc102a86824 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:53:58.786763 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc069198-7724-4000-ba16-2cc102a86824 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:53:58.820935 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d8e2ab-eb60-4bce-ab16-87ca94f3f0c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:53:58.821557 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d8e2ab-eb60-4bce-ab16-87ca94f3f0c1 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:53:58.821835 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d8e2ab-eb60-4bce-ab16-87ca94f3f0c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:53:58.822102 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d8e2ab-eb60-4bce-ab16-87ca94f3f0c1 None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:53:58.822733 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d8e2ab-eb60-4bce-ab16-87ca94f3f0c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:53:58.823060 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d8e2ab-eb60-4bce-ab16-87ca94f3f0c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:53:58.824433 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d8e2ab-eb60-4bce-ab16-87ca94f3f0c1 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:53:58.835999 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 649/1279] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 10 09:53:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:53:58.845042 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2006bc6-f864-4253-aefe-c3d9522d253c None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:53:58.885814 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:53:58.958855 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2006bc6-f864-4253-aefe-c3d9522d253c None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:53:58.993350 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8c9926-a29f-40a4-9bb6-c355813724b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:53:58.993957 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8c9926-a29f-40a4-9bb6-c355813724b8 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:53:58.994240 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8c9926-a29f-40a4-9bb6-c355813724b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:53:58.994512 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8c9926-a29f-40a4-9bb6-c355813724b8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:53:59.001956 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8c9926-a29f-40a4-9bb6-c355813724b8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:53:59.003423 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8c9926-a29f-40a4-9bb6-c355813724b8 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:53:59.014370 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-cc8c9926-a29f-40a4-9bb6-c355813724b8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 10 09:53:59.014370 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:53:59.014370 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:53:59.014370 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:53:59.014370 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:53:59.014370 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:53:59.014370 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:53:59.014370 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:53:59.014370 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:53:59.014370 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:53:59.014370 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:53:59.014370 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:53:59.014370 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 10 09:53:59.014370 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 10 09:53:59.014370 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 10 09:53:59.014370 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 10 09:53:59.015783 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:53:59.015783 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:53:59.015783 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 10 09:53:59.015783 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 09:53:59.015783 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 10 09:53:59.015783 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 10 09:53:59.015783 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:53:59.015783 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:53:59.015783 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:53:59.015783 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:53:59.015783 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:53:59.015783 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:53:59.015783 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:53:59.015783 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:53:59.015783 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:53:59.015783 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:53:59.015783 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:53:59.015783 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:53:59.016784 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:53:59.016784 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:53:59.016784 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 10 09:53:59.016784 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 10 09:53:59.016784 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 10 09:53:59.016784 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 10 09:53:59.016784 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 10 09:53:59.016784 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 10 09:53:59.016784 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 10 09:53:59.016784 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:53:59.016784 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 631/1280] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 10 09:53:58 2022] GET /identity/v3/users/placement => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:53:59.022653 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d8e2ab-eb60-4bce-ab16-87ca94f3f0c1 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:53:59.026668 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:53:59.128186 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d8e2ab-eb60-4bce-ab16-87ca94f3f0c1 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:53:59.162369 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48b3203-1c3c-4506-99c0-0374b79b9ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:53:59.162899 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48b3203-1c3c-4506-99c0-0374b79b9ad0 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:53:59.163174 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48b3203-1c3c-4506-99c0-0374b79b9ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:53:59.163405 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48b3203-1c3c-4506-99c0-0374b79b9ad0 None admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:53:59.164146 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48b3203-1c3c-4506-99c0-0374b79b9ad0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:53:59.164445 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48b3203-1c3c-4506-99c0-0374b79b9ad0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:53:59.165890 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48b3203-1c3c-4506-99c0-0374b79b9ad0 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:53:59.182686 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 650/1281] 10.222.0.27 () {56 vars in 1143 bytes} [Wed Aug 10 09:53:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 09:53:59.188662 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8c9926-a29f-40a4-9bb6-c355813724b8 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:53:59.287582 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:53:59.299048 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8c9926-a29f-40a4-9bb6-c355813724b8 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:53:59.336612 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f8a509-b7ef-41aa-825c-9e7c3e829ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:53:59.337227 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f8a509-b7ef-41aa-825c-9e7c3e829ac8 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:53:59.337496 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f8a509-b7ef-41aa-825c-9e7c3e829ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:53:59.337767 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f8a509-b7ef-41aa-825c-9e7c3e829ac8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:53:59.406598 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f8a509-b7ef-41aa-825c-9e7c3e829ac8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:53:59.408050 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f8a509-b7ef-41aa-825c-9e7c3e829ac8 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:53:59.499989 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:53:59.512101 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 632/1282] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Aug 10 09:53:59 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 10 09:53:59.521716 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48b3203-1c3c-4506-99c0-0374b79b9ad0 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:53:59.587391 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:53:59.626455 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48b3203-1c3c-4506-99c0-0374b79b9ad0 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:53:59.661403 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6347cbc2-5481-4367-94c5-6fe095ac1928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:53:59.662011 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6347cbc2-5481-4367-94c5-6fe095ac1928 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:53:59.662288 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6347cbc2-5481-4367-94c5-6fe095ac1928 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:53:59.662566 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6347cbc2-5481-4367-94c5-6fe095ac1928 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:53:59.672904 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6347cbc2-5481-4367-94c5-6fe095ac1928 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:53:59.674389 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6347cbc2-5481-4367-94c5-6fe095ac1928 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:53:59.692310 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-6347cbc2-5481-4367-94c5-6fe095ac1928 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:53:59.692310 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:53:59.692310 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:53:59.692310 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:53:59.692310 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:53:59.692310 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:53:59.692310 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:53:59.692310 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:53:59.692310 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:53:59.692310 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:53:59.692310 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:53:59.692310 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:53:59.692310 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 10 09:53:59.692310 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 10 09:53:59.692310 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 10 09:53:59.692310 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 10 09:53:59.693401 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:53:59.693401 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:53:59.693401 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:53:59.693401 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:53:59.693401 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:53:59.693401 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:53:59.693401 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:53:59.693401 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:53:59.693401 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:53:59.693401 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:53:59.693401 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:53:59.693401 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:53:59.693401 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:53:59.693401 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:53:59.693401 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:53:59.693401 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:53:59.693401 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 10 09:53:59.694393 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 10 09:53:59.694393 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 09:53:59.694393 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:53:59.694393 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 651/1283] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 10 09:53:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:53:59.699378 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f8a509-b7ef-41aa-825c-9e7c3e829ac8 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:53:59.808092 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f8a509-b7ef-41aa-825c-9e7c3e829ac8 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:53:59.846021 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c0e65f-e9d6-4482-94d3-5f8a6e5c8d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:53:59.846612 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c0e65f-e9d6-4482-94d3-5f8a6e5c8d3a None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:53:59.846885 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c0e65f-e9d6-4482-94d3-5f8a6e5c8d3a None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:53:59.847150 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c0e65f-e9d6-4482-94d3-5f8a6e5c8d3a None admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:53:59.847782 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c0e65f-e9d6-4482-94d3-5f8a6e5c8d3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:53:59.848055 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c0e65f-e9d6-4482-94d3-5f8a6e5c8d3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:53:59.849451 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c0e65f-e9d6-4482-94d3-5f8a6e5c8d3a None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:53:59.860815 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 633/1284] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Aug 10 09:53:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:53:59.866912 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6347cbc2-5481-4367-94c5-6fe095ac1928 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:53:59.973345 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6347cbc2-5481-4367-94c5-6fe095ac1928 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:53:59.987038 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:54:00.009348 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ff7e41-39a6-43c9-9eb5-bf3a22911375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:54:00.009966 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ff7e41-39a6-43c9-9eb5-bf3a22911375 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:54:00.010245 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ff7e41-39a6-43c9-9eb5-bf3a22911375 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:54:00.010564 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ff7e41-39a6-43c9-9eb5-bf3a22911375 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:54:00.017599 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ff7e41-39a6-43c9-9eb5-bf3a22911375 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:54:00.019054 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ff7e41-39a6-43c9-9eb5-bf3a22911375 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:54:00.030474 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-14ff7e41-39a6-43c9-9eb5-bf3a22911375 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 09:54:00.030474 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:54:00.030474 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:54:00.030474 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:54:00.030474 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:54:00.030474 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:54:00.030474 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:54:00.030474 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:54:00.030474 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:54:00.030474 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:54:00.030474 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:54:00.030474 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:54:00.030474 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 10 09:54:00.030474 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 10 09:54:00.030474 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 10 09:54:00.031945 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 10 09:54:00.031945 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:54:00.031945 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:54:00.031945 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:54:00.031945 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:54:00.031945 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:54:00.031945 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:54:00.031945 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:54:00.031945 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( Aug 10 09:54:00.031945 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:54:00.031945 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:54:00.031945 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:54:00.031945 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:54:00.031945 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:54:00.031945 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:54:00.031945 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:54:00.031945 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:54:00.032932 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 10 09:54:00.032932 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 10 09:54:00.032932 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 10 09:54:00.032932 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 10 09:54:00.032932 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 10 09:54:00.032932 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 10 09:54:00.032932 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 09:54:00.032932 dv-cinder-850836-5-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Aug 10 09:54:00.032932 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 652/1285] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Aug 10 09:53:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:54:00.037664 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c0e65f-e9d6-4482-94d3-5f8a6e5c8d3a None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:54:00.089119 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:54:00.140796 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c0e65f-e9d6-4482-94d3-5f8a6e5c8d3a None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:54:00.181426 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434966e4-e623-4cb7-bdbd-197c06ea2ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:54:00.182035 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434966e4-e623-4cb7-bdbd-197c06ea2ad5 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:54:00.182336 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434966e4-e623-4cb7-bdbd-197c06ea2ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:54:00.182613 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434966e4-e623-4cb7-bdbd-197c06ea2ad5 None admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:54:00.183311 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434966e4-e623-4cb7-bdbd-197c06ea2ad5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:54:00.183618 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434966e4-e623-4cb7-bdbd-197c06ea2ad5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:54:00.185111 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434966e4-e623-4cb7-bdbd-197c06ea2ad5 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:54:00.198403 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 634/1286] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Aug 10 09:54:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:54:00.207960 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ff7e41-39a6-43c9-9eb5-bf3a22911375 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:54:00.320087 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ff7e41-39a6-43c9-9eb5-bf3a22911375 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:54:00.356148 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0643433b-011b-4bbf-8084-d1245615e9ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:54:00.356666 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0643433b-011b-4bbf-8084-d1245615e9ca None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:54:00.356944 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0643433b-011b-4bbf-8084-d1245615e9ca None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:54:00.357240 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0643433b-011b-4bbf-8084-d1245615e9ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:54:00.357961 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0643433b-011b-4bbf-8084-d1245615e9ca None admin] RBAC: Adding query filter params (role.id=eb04edc46b3742d7a0f0ead26f68bc22, scope.project.id=d47d5b72a00642a1a239b785110643ef, user.id=a6b658f1e27b4dfb96de71dc6a7e9496) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:54:00.358270 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0643433b-011b-4bbf-8084-d1245615e9ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:54:00.359692 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0643433b-011b-4bbf-8084-d1245615e9ca None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:54:00.365528 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 653/1287] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Aug 10 09:54:00 2022] GET /identity/v3/role_assignments?user.id=a6b658f1e27b4dfb96de71dc6a7e9496&scope.project.id=d47d5b72a00642a1a239b785110643ef&role.id=eb04edc46b3742d7a0f0ead26f68bc22 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 09:54:02.351660 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed83f500-f660-436b-833d-1a43316d39f5 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:54:02.352230 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed83f500-f660-436b-833d-1a43316d39f5 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:54:02.352230 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed83f500-f660-436b-833d-1a43316d39f5 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:54:02.353595 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 635/1288] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:54:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:54:02.362133 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff01140-03b3-4232-92d1-fd16753cf289 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:54:02.362600 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff01140-03b3-4232-92d1-fd16753cf289 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:54:02.362706 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff01140-03b3-4232-92d1-fd16753cf289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:54:02.389919 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-fff01140-03b3-4232-92d1-fd16753cf289 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:54:02.391125 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-fff01140-03b3-4232-92d1-fd16753cf289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:54:02.423300 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:54:02.464914 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 654/1289] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:54:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 09:54:02.487031 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed83f500-f660-436b-833d-1a43316d39f5 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:54:02.591783 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed83f500-f660-436b-833d-1a43316d39f5 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:54:02.602775 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:54:02.628287 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aaf32a-e047-4a3a-a167-eddf8964efb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:54:02.628912 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aaf32a-e047-4a3a-a167-eddf8964efb1 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:54:02.629220 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aaf32a-e047-4a3a-a167-eddf8964efb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:54:02.629490 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aaf32a-e047-4a3a-a167-eddf8964efb1 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:54:02.630067 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75aaf32a-e047-4a3a-a167-eddf8964efb1 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:54:02.631472 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75aaf32a-e047-4a3a-a167-eddf8964efb1 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:54:02.640458 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-75aaf32a-e047-4a3a-a167-eddf8964efb1 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 10 09:54:02.640458 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:54:02.640458 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 09:54:02.640458 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 09:54:02.640458 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 09:54:02.640458 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 09:54:02.640458 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 09:54:02.640458 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 09:54:02.640458 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 10 09:54:02.640458 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:54:02.640458 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 09:54:02.640458 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:54:02.640458 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:54:02.640458 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:54:02.640458 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:54:02.640458 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:54:02.640458 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:54:02.641693 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:54:02.641693 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:54:02.641693 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:54:02.641693 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:54:02.641693 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:54:02.641693 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:54:02.641693 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 09:54:02.641693 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 09:54:02.641693 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 09:54:02.641693 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 09:54:02.641693 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:54:02.641693 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:54:02.641693 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:54:02.641693 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:54:02.641693 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:54:02.641693 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:54:02.642752 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:54:02.642752 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:54:02.642752 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:54:02.642752 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:54:02.642752 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:54:02.642752 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:54:02.642752 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:54:02.642752 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:54:02.642752 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:54:02.642752 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:54:02.642752 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 09:54:02.642752 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 09:54:02.642752 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 10 09:54:02.642752 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:54:02.642752 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 636/1290] 10.222.0.27 () {56 vars in 1117 bytes} [Wed Aug 10 09:54:02 2022] GET /identity/v3/services/placement => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:54:02.647930 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff01140-03b3-4232-92d1-fd16753cf289 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:54:02.749992 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff01140-03b3-4232-92d1-fd16753cf289 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:54:02.783629 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b596a12-d9f7-4f4f-ba96-62789f479b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:54:02.784222 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b596a12-d9f7-4f4f-ba96-62789f479b22 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:54:02.784501 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b596a12-d9f7-4f4f-ba96-62789f479b22 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:54:02.784769 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b596a12-d9f7-4f4f-ba96-62789f479b22 None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:54:02.785441 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b596a12-d9f7-4f4f-ba96-62789f479b22 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:54:02.785751 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b596a12-d9f7-4f4f-ba96-62789f479b22 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:54:02.787124 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b596a12-d9f7-4f4f-ba96-62789f479b22 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:54:02.791801 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 655/1291] 10.222.0.27 () {56 vars in 1116 bytes} [Wed Aug 10 09:54:02 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:54:02.798080 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aaf32a-e047-4a3a-a167-eddf8964efb1 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:54:02.910602 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aaf32a-e047-4a3a-a167-eddf8964efb1 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:54:02.945503 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12069488-f4bd-4703-b9dd-85e1a168758f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:54:02.946098 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12069488-f4bd-4703-b9dd-85e1a168758f None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:54:02.946374 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12069488-f4bd-4703-b9dd-85e1a168758f None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:54:02.946644 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12069488-f4bd-4703-b9dd-85e1a168758f None admin] PATH_INFO: `/v3/services` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:54:02.947276 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12069488-f4bd-4703-b9dd-85e1a168758f None admin] RBAC: Adding query filter params (type=placement) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:54:02.947576 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12069488-f4bd-4703-b9dd-85e1a168758f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:54:02.949017 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12069488-f4bd-4703-b9dd-85e1a168758f None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:54:02.953713 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 637/1292] 10.222.0.27 () {56 vars in 1116 bytes} [Wed Aug 10 09:54:02 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 09:54:04.957265 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2218084a-96b8-4266-af59-c7e2af1f4462 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:54:04.957841 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2218084a-96b8-4266-af59-c7e2af1f4462 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:54:04.957841 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2218084a-96b8-4266-af59-c7e2af1f4462 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:54:04.959166 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 656/1293] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:54:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:54:04.964507 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317dc87a-95af-4d0a-ada0-345330ebac8d None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:54:04.964938 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317dc87a-95af-4d0a-ada0-345330ebac8d None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:54:04.965046 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317dc87a-95af-4d0a-ada0-345330ebac8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:54:04.991093 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-317dc87a-95af-4d0a-ada0-345330ebac8d None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:54:04.993009 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-317dc87a-95af-4d0a-ada0-345330ebac8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:54:05.024673 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:54:05.068604 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 638/1294] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:54:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 09:54:05.091578 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2218084a-96b8-4266-af59-c7e2af1f4462 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:54:05.135049 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:54:05.212429 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2218084a-96b8-4266-af59-c7e2af1f4462 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:54:05.248697 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352faf44-afbf-4a43-8df7-87f4e4e590bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:54:05.249319 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352faf44-afbf-4a43-8df7-87f4e4e590bb None admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:54:05.249595 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352faf44-afbf-4a43-8df7-87f4e4e590bb None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:54:05.249867 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352faf44-afbf-4a43-8df7-87f4e4e590bb None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:54:05.250484 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352faf44-afbf-4a43-8df7-87f4e4e590bb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:54:05.251847 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352faf44-afbf-4a43-8df7-87f4e4e590bb None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:54:05.280578 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 657/1295] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Aug 10 09:54:05 2022] POST /identity/v3/services => generated 246 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 09:54:07.262236 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67786707-dc9e-401e-94fa-eae13161d7b2 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:54:07.263107 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67786707-dc9e-401e-94fa-eae13161d7b2 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:54:07.263107 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67786707-dc9e-401e-94fa-eae13161d7b2 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:54:07.265195 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 639/1296] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:54:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:54:07.273668 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9727a39c-7dad-4f3b-955f-7ee4f52bed47 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:54:07.274092 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9727a39c-7dad-4f3b-955f-7ee4f52bed47 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:54:07.274223 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9727a39c-7dad-4f3b-955f-7ee4f52bed47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:54:07.294525 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-9727a39c-7dad-4f3b-955f-7ee4f52bed47 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:54:07.295737 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-9727a39c-7dad-4f3b-955f-7ee4f52bed47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:54:07.379298 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 658/1297] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:54:07 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 09:54:07.402167 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67786707-dc9e-401e-94fa-eae13161d7b2 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:54:07.508210 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67786707-dc9e-401e-94fa-eae13161d7b2 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:54:07.544059 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4123d09e-9131-47de-b6fa-be7ad3a167d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:54:07.544610 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4123d09e-9131-47de-b6fa-be7ad3a167d9 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:54:07.544887 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4123d09e-9131-47de-b6fa-be7ad3a167d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:54:07.545184 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4123d09e-9131-47de-b6fa-be7ad3a167d9 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:54:07.545766 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4123d09e-9131-47de-b6fa-be7ad3a167d9 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:54:07.547143 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4123d09e-9131-47de-b6fa-be7ad3a167d9 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:54:07.556040 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-4123d09e-9131-47de-b6fa-be7ad3a167d9 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 10 09:54:07.556040 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:54:07.556040 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 09:54:07.556040 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 09:54:07.556040 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 09:54:07.556040 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 09:54:07.556040 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 09:54:07.556040 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 09:54:07.556040 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 10 09:54:07.556040 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:54:07.556040 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 09:54:07.556040 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:54:07.556040 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:54:07.556040 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:54:07.556040 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:54:07.556040 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:54:07.556040 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:54:07.557248 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:54:07.557248 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:54:07.557248 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:54:07.557248 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:54:07.557248 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:54:07.557248 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:54:07.557248 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 09:54:07.557248 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 09:54:07.557248 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 09:54:07.557248 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 09:54:07.557248 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:54:07.557248 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:54:07.557248 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:54:07.557248 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:54:07.557248 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:54:07.557248 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:54:07.558493 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:54:07.558493 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:54:07.558493 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:54:07.558493 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:54:07.558493 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:54:07.558493 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:54:07.558493 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:54:07.558493 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:54:07.558493 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:54:07.558493 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:54:07.558493 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 09:54:07.558493 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 09:54:07.558493 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 10 09:54:07.558493 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:54:07.558493 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 640/1298] 10.222.0.27 () {56 vars in 1117 bytes} [Wed Aug 10 09:54:07 2022] GET /identity/v3/services/placement => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:54:07.563142 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9727a39c-7dad-4f3b-955f-7ee4f52bed47 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:54:07.583047 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:54:07.668650 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9727a39c-7dad-4f3b-955f-7ee4f52bed47 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:54:07.714830 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2416b093-bce1-4b41-ad9c-67bd21331d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:54:07.715439 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2416b093-bce1-4b41-ad9c-67bd21331d53 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:54:07.715715 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2416b093-bce1-4b41-ad9c-67bd21331d53 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:54:07.715982 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2416b093-bce1-4b41-ad9c-67bd21331d53 None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:54:07.716614 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2416b093-bce1-4b41-ad9c-67bd21331d53 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:54:07.716907 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2416b093-bce1-4b41-ad9c-67bd21331d53 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:54:07.718315 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2416b093-bce1-4b41-ad9c-67bd21331d53 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:54:07.726932 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 659/1299] 10.222.0.27 () {56 vars in 1116 bytes} [Wed Aug 10 09:54:07 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:54:07.733225 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4123d09e-9131-47de-b6fa-be7ad3a167d9 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:54:07.768062 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:54:07.842443 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4123d09e-9131-47de-b6fa-be7ad3a167d9 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:54:07.882752 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115a82e0-e676-4827-92cd-f5f978e84dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:54:07.883620 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115a82e0-e676-4827-92cd-f5f978e84dc7 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:54:07.883980 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115a82e0-e676-4827-92cd-f5f978e84dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:54:07.884309 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115a82e0-e676-4827-92cd-f5f978e84dc7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:54:07.885527 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115a82e0-e676-4827-92cd-f5f978e84dc7 None admin] RBAC: Adding query filter params (interface=public, service_id=5ecc358c6afc4875b9fbd26aabeb8c54, region_id=RegionOne) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:54:07.885942 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115a82e0-e676-4827-92cd-f5f978e84dc7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:54:07.888153 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115a82e0-e676-4827-92cd-f5f978e84dc7 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:54:07.898285 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 641/1300] 10.222.0.27 () {56 vars in 1251 bytes} [Wed Aug 10 09:54:07 2022] GET /identity/v3/endpoints?service_id=5ecc358c6afc4875b9fbd26aabeb8c54&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:54:07.905676 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2416b093-bce1-4b41-ad9c-67bd21331d53 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:54:07.996521 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:54:08.017036 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2416b093-bce1-4b41-ad9c-67bd21331d53 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:54:08.053340 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffc7220-273a-471a-a77d-94f07517de9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:54:08.053938 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffc7220-273a-471a-a77d-94f07517de9e None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:54:08.054214 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffc7220-273a-471a-a77d-94f07517de9e None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:54:08.054487 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffc7220-273a-471a-a77d-94f07517de9e None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:54:08.055088 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffc7220-273a-471a-a77d-94f07517de9e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:54:08.056460 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffc7220-273a-471a-a77d-94f07517de9e None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:54:08.063449 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 660/1301] 10.222.0.27 () {56 vars in 1087 bytes} [Wed Aug 10 09:54:07 2022] GET /identity/v3/services => generated 2191 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 09:54:10.034289 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a5395-28bd-4855-9eff-0da8f16b2af2 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:54:10.034880 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a5395-28bd-4855-9eff-0da8f16b2af2 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:54:10.034880 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a5395-28bd-4855-9eff-0da8f16b2af2 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:54:10.036165 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 642/1302] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:54:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:54:10.042388 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c1cae5-561c-4acb-b016-7dad8866b541 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:54:10.043164 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c1cae5-561c-4acb-b016-7dad8866b541 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:54:10.043308 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c1cae5-561c-4acb-b016-7dad8866b541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:54:10.067473 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-e9c1cae5-561c-4acb-b016-7dad8866b541 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:54:10.068664 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-e9c1cae5-561c-4acb-b016-7dad8866b541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:54:10.138774 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 661/1303] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:54:10 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 10 09:54:10.166435 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42a5395-28bd-4855-9eff-0da8f16b2af2 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:54:10.267608 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:54:10.274970 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42a5395-28bd-4855-9eff-0da8f16b2af2 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:54:10.309113 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0a08ea-0b24-4662-92e6-efa38c2e8fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:54:10.309653 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0a08ea-0b24-4662-92e6-efa38c2e8fd9 None admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:54:10.309974 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0a08ea-0b24-4662-92e6-efa38c2e8fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:54:10.310294 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0a08ea-0b24-4662-92e6-efa38c2e8fd9 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:54:10.310887 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0a08ea-0b24-4662-92e6-efa38c2e8fd9 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:54:10.312257 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0a08ea-0b24-4662-92e6-efa38c2e8fd9 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:54:10.321880 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application [None req-dd0a08ea-0b24-4662-92e6-efa38c2e8fd9 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 10 09:54:10.321880 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:54:10.321880 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 10 09:54:10.321880 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 10 09:54:10.321880 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 10 09:54:10.321880 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 10 09:54:10.321880 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 10 09:54:10.321880 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 09:54:10.321880 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 10 09:54:10.321880 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:54:10.321880 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 10 09:54:10.321880 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:54:10.321880 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 10 09:54:10.321880 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 10 09:54:10.321880 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 10 09:54:10.321880 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 10 09:54:10.321880 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 10 09:54:10.323398 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 10 09:54:10.323398 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 10 09:54:10.323398 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 10 09:54:10.323398 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 10 09:54:10.323398 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 10 09:54:10.323398 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 10 09:54:10.323398 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 10 09:54:10.323398 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 10 09:54:10.323398 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 10 09:54:10.323398 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 10 09:54:10.323398 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 10 09:54:10.323398 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 10 09:54:10.323398 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 10 09:54:10.323398 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 10 09:54:10.323398 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 10 09:54:10.323398 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.get_or_create( Aug 10 09:54:10.324383 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 10 09:54:10.324383 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application with Lock( Aug 10 09:54:10.324383 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 10 09:54:10.324383 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self._enter() Aug 10 09:54:10.324383 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 10 09:54:10.324383 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 10 09:54:10.324383 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 10 09:54:10.324383 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application return self.creator() Aug 10 09:54:10.324383 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 10 09:54:10.324383 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application created_value = creator( Aug 10 09:54:10.324383 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 10 09:54:10.324383 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 10 09:54:10.324383 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 10 09:54:10.324383 dv-cinder-850836-5-smb devstack@keystone.service[80232]: ERROR keystone.server.flask.application Aug 10 09:54:10.324383 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 643/1304] 10.222.0.27 () {56 vars in 1117 bytes} [Wed Aug 10 09:54:10 2022] GET /identity/v3/services/placement => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 09:54:10.329464 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c1cae5-561c-4acb-b016-7dad8866b541 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:54:10.413328 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:54:10.437534 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c1cae5-561c-4acb-b016-7dad8866b541 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:54:10.470652 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0256da8c-d26a-4162-8519-889450cedcc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:54:10.471241 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0256da8c-d26a-4162-8519-889450cedcc2 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:54:10.471516 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0256da8c-d26a-4162-8519-889450cedcc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:54:10.471782 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0256da8c-d26a-4162-8519-889450cedcc2 None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:54:10.472401 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0256da8c-d26a-4162-8519-889450cedcc2 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:54:10.472698 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0256da8c-d26a-4162-8519-889450cedcc2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:54:10.474088 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0256da8c-d26a-4162-8519-889450cedcc2 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:54:10.479120 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 662/1305] 10.222.0.27 () {56 vars in 1116 bytes} [Wed Aug 10 09:54:10 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 09:54:10.485989 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0a08ea-0b24-4662-92e6-efa38c2e8fd9 None admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:54:10.597286 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0a08ea-0b24-4662-92e6-efa38c2e8fd9 None admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:54:10.631947 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d2df63-98e4-4f32-9127-9866843222c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:54:10.632523 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d2df63-98e4-4f32-9127-9866843222c0 None admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:54:10.632795 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d2df63-98e4-4f32-9127-9866843222c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:54:10.633059 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d2df63-98e4-4f32-9127-9866843222c0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:54:10.633728 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d2df63-98e4-4f32-9127-9866843222c0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:54:10.635161 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d2df63-98e4-4f32-9127-9866843222c0 None admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:54:10.657272 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 644/1306] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 10 09:54:10 2022] POST /identity/v3/endpoints => generated 331 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 09:54:20.476107 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=30 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:54:20.653199 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:55:13.199625 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd1baf-1a06-4ba6-afdd-8365484134f1 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:55:13.200542 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd1baf-1a06-4ba6-afdd-8365484134f1 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:55:13.200985 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd1baf-1a06-4ba6-afdd-8365484134f1 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:55:13.202549 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 663/1307] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:55:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:55:13.208101 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83dc354-8083-435f-a31a-37f2710f71fe None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:55:13.208593 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83dc354-8083-435f-a31a-37f2710f71fe None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:55:13.208690 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83dc354-8083-435f-a31a-37f2710f71fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:55:13.361563 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-a83dc354-8083-435f-a31a-37f2710f71fe None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:55:13.362893 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-a83dc354-8083-435f-a31a-37f2710f71fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:55:13.566902 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 645/1308] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:55:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 09:55:13.616216 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58636d90-6090-48a2-b488-926f3db03718 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:55:13.616574 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58636d90-6090-48a2-b488-926f3db03718 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:55:13.616724 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58636d90-6090-48a2-b488-926f3db03718 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:55:13.619391 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 664/1309] 10.222.0.27 () {54 vars in 965 bytes} [Wed Aug 10 09:55:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:55:13.630548 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1797d4-8432-41c6-aaae-26fb7e59bdd1 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:55:13.631530 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1797d4-8432-41c6-aaae-26fb7e59bdd1 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:55:13.632413 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1797d4-8432-41c6-aaae-26fb7e59bdd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:55:13.759949 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-cd1797d4-8432-41c6-aaae-26fb7e59bdd1 None None] MFA Rules not processed for user `4294c170df354fe892831281acd4ea7d`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:55:13.761234 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-cd1797d4-8432-41c6-aaae-26fb7e59bdd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:55:13.788595 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:55:13.859945 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 646/1310] 10.222.0.27 () {58 vars in 1062 bytes} [Wed Aug 10 09:55:13 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 09:55:13.861266 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58636d90-6090-48a2-b488-926f3db03718 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:55:13.863387 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-58636d90-6090-48a2-b488-926f3db03718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:55:13.994287 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58636d90-6090-48a2-b488-926f3db03718 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:55:14.083190 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b85600-ba6d-44e0-a0b7-de5354092d1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4294c170df354fe892831281acd4ea7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:55:14.083845 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b85600-ba6d-44e0-a0b7-de5354092d1e service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:55:14.084126 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b85600-ba6d-44e0-a0b7-de5354092d1e service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:55:14.084395 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b85600-ba6d-44e0-a0b7-de5354092d1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:55:14.086182 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-01b85600-ba6d-44e0-a0b7-de5354092d1e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:55:14.155287 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:55:14.221376 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b85600-ba6d-44e0-a0b7-de5354092d1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:55:14.222829 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b85600-ba6d-44e0-a0b7-de5354092d1e service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:55:14.244604 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 665/1311] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 09:55:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 09:55:16.601455 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f26613-05a7-4bb0-9b4c-c619e913919b None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:55:16.602082 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f26613-05a7-4bb0-9b4c-c619e913919b None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:55:16.602082 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f26613-05a7-4bb0-9b4c-c619e913919b None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:55:16.603441 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 647/1312] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:55:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:55:16.609779 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b678341-eb84-47f9-8327-b874b4153e05 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:55:16.610253 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b678341-eb84-47f9-8327-b874b4153e05 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:55:16.610569 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b678341-eb84-47f9-8327-b874b4153e05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:55:16.712436 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-6b678341-eb84-47f9-8327-b874b4153e05 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:55:16.713710 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-6b678341-eb84-47f9-8327-b874b4153e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:55:16.817764 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 666/1313] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:55:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 09:55:16.855640 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f26613-05a7-4bb0-9b4c-c619e913919b None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:55:16.857231 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-24f26613-05a7-4bb0-9b4c-c619e913919b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:55:16.966559 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f26613-05a7-4bb0-9b4c-c619e913919b None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:55:17.040192 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:55:17.042867 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ee4503-cbe8-47ff-bcfa-6e813547a0eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4294c170df354fe892831281acd4ea7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:55:17.043526 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ee4503-cbe8-47ff-bcfa-6e813547a0eb service neutron] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:55:17.043958 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ee4503-cbe8-47ff-bcfa-6e813547a0eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:55:17.044273 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ee4503-cbe8-47ff-bcfa-6e813547a0eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:55:17.046551 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-19ee4503-cbe8-47ff-bcfa-6e813547a0eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:55:17.159331 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ee4503-cbe8-47ff-bcfa-6e813547a0eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:55:17.160796 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ee4503-cbe8-47ff-bcfa-6e813547a0eb service neutron] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:55:17.179836 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 648/1314] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 09:55:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 09:55:19.469949 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de515eb9-6e81-4e7f-b07f-86798156bfe7 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:55:19.470861 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de515eb9-6e81-4e7f-b07f-86798156bfe7 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:55:19.470861 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de515eb9-6e81-4e7f-b07f-86798156bfe7 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:55:19.472956 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 667/1315] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:55:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:55:19.478369 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb96ce5e-9401-43bf-9f37-5f035dea1a44 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:55:19.478801 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb96ce5e-9401-43bf-9f37-5f035dea1a44 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:55:19.478919 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb96ce5e-9401-43bf-9f37-5f035dea1a44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:55:19.547230 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-eb96ce5e-9401-43bf-9f37-5f035dea1a44 None None] MFA Rules not processed for user `09ce8c0b6d584400af33d8c86a3b8bba`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:55:19.548419 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-eb96ce5e-9401-43bf-9f37-5f035dea1a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:55:19.601790 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:55:19.647029 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 649/1316] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:55:19 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 09:55:19.693648 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de515eb9-6e81-4e7f-b07f-86798156bfe7 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:55:19.696215 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-de515eb9-6e81-4e7f-b07f-86798156bfe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:55:19.706694 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:55:19.804982 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de515eb9-6e81-4e7f-b07f-86798156bfe7 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:55:19.880564 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb724d09-47c9-4b25-a48b-4605c1959b44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4294c170df354fe892831281acd4ea7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:55:19.881192 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb724d09-47c9-4b25-a48b-4605c1959b44 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:55:19.881472 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb724d09-47c9-4b25-a48b-4605c1959b44 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:55:19.881744 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb724d09-47c9-4b25-a48b-4605c1959b44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:55:19.883329 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-eb724d09-47c9-4b25-a48b-4605c1959b44 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:55:19.959904 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:55:20.007540 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb724d09-47c9-4b25-a48b-4605c1959b44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:55:20.008970 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb724d09-47c9-4b25-a48b-4605c1959b44 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:55:20.027160 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 668/1317] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 09:55:19 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 09:55:22.575141 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ab14fe-174a-4984-b353-d1b707c8c8e3 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:55:22.575758 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ab14fe-174a-4984-b353-d1b707c8c8e3 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:55:22.575758 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ab14fe-174a-4984-b353-d1b707c8c8e3 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:55:22.577052 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 650/1318] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:55:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:55:22.583348 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d389d9e-6bf5-4932-bdfe-d2f043e4f9e5 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:55:22.584070 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d389d9e-6bf5-4932-bdfe-d2f043e4f9e5 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:55:22.584269 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d389d9e-6bf5-4932-bdfe-d2f043e4f9e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:55:22.653569 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-1d389d9e-6bf5-4932-bdfe-d2f043e4f9e5 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:55:22.654767 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-1d389d9e-6bf5-4932-bdfe-d2f043e4f9e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:55:22.757188 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 669/1319] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:55:22 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 09:55:22.798593 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ab14fe-174a-4984-b353-d1b707c8c8e3 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:55:22.800147 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-11ab14fe-174a-4984-b353-d1b707c8c8e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:55:22.912741 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ab14fe-174a-4984-b353-d1b707c8c8e3 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:55:22.988510 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c359e8b9-18f6-4102-8965-c7b37e49b100 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4294c170df354fe892831281acd4ea7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:55:22.989107 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c359e8b9-18f6-4102-8965-c7b37e49b100 service neutron] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:55:22.989409 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c359e8b9-18f6-4102-8965-c7b37e49b100 service neutron] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:55:22.989672 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c359e8b9-18f6-4102-8965-c7b37e49b100 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:55:22.991239 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-c359e8b9-18f6-4102-8965-c7b37e49b100 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:55:22.998879 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:55:23.108678 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c359e8b9-18f6-4102-8965-c7b37e49b100 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:55:23.110172 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c359e8b9-18f6-4102-8965-c7b37e49b100 service neutron] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:55:23.128198 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 651/1320] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 09:55:22 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 09:55:25.785680 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3797741e-4b76-42cc-9524-96a2edde79bc None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:55:25.786230 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3797741e-4b76-42cc-9524-96a2edde79bc None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:55:25.786230 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3797741e-4b76-42cc-9524-96a2edde79bc None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:55:25.787646 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 670/1321] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:55:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:55:25.793009 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facda07f-fbca-47d2-bbf7-d2ce6dbe5543 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:55:25.793499 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facda07f-fbca-47d2-bbf7-d2ce6dbe5543 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:55:25.793596 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facda07f-fbca-47d2-bbf7-d2ce6dbe5543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:55:25.862109 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-facda07f-fbca-47d2-bbf7-d2ce6dbe5543 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:55:25.863338 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-facda07f-fbca-47d2-bbf7-d2ce6dbe5543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:55:25.926839 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:55:25.970339 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 652/1322] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:55:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 09:55:26.007284 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3797741e-4b76-42cc-9524-96a2edde79bc None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:55:26.008905 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-3797741e-4b76-42cc-9524-96a2edde79bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:55:26.029868 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:55:26.120719 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3797741e-4b76-42cc-9524-96a2edde79bc None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:55:26.195291 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d721aa-b534-4fdb-90da-530be78306cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4294c170df354fe892831281acd4ea7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:55:26.195958 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d721aa-b534-4fdb-90da-530be78306cd service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:55:26.196237 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d721aa-b534-4fdb-90da-530be78306cd service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:55:26.196502 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d721aa-b534-4fdb-90da-530be78306cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:55:26.198126 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-24d721aa-b534-4fdb-90da-530be78306cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:55:26.271231 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:55:26.310631 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d721aa-b534-4fdb-90da-530be78306cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:55:26.311997 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d721aa-b534-4fdb-90da-530be78306cd service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:55:26.331386 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 671/1323] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 09:55:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 09:55:28.362401 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e188d5b2-296e-417b-b9d2-a9807ecd6d92 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:55:28.362975 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e188d5b2-296e-417b-b9d2-a9807ecd6d92 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:55:28.362975 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e188d5b2-296e-417b-b9d2-a9807ecd6d92 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:55:28.364192 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 653/1324] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:55:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:55:28.369682 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814bb7b2-eeed-41af-acbd-c97327409bd7 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:55:28.370197 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814bb7b2-eeed-41af-acbd-c97327409bd7 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:55:28.370197 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814bb7b2-eeed-41af-acbd-c97327409bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:55:28.440833 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-814bb7b2-eeed-41af-acbd-c97327409bd7 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:55:28.442100 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-814bb7b2-eeed-41af-acbd-c97327409bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:55:28.540388 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 672/1325] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:55:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 09:55:28.591057 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc7cd2-7766-4616-902f-25651edaaa5d None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:55:28.591324 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc7cd2-7766-4616-902f-25651edaaa5d None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:55:28.591615 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc7cd2-7766-4616-902f-25651edaaa5d None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:55:28.593008 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 654/1326] 10.222.0.27 () {54 vars in 965 bytes} [Wed Aug 10 09:55:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:55:28.599121 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06991b6f-66ac-4b20-97f4-e352f6b3e151 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:55:28.599413 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06991b6f-66ac-4b20-97f4-e352f6b3e151 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:55:28.599695 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06991b6f-66ac-4b20-97f4-e352f6b3e151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:55:28.632614 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:55:28.683253 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-06991b6f-66ac-4b20-97f4-e352f6b3e151 None None] MFA Rules not processed for user `4294c170df354fe892831281acd4ea7d`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:55:28.684495 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-06991b6f-66ac-4b20-97f4-e352f6b3e151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:55:28.771005 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 673/1327] 10.222.0.27 () {58 vars in 1062 bytes} [Wed Aug 10 09:55:28 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 09:55:28.780363 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bc7cd2-7766-4616-902f-25651edaaa5d None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:55:28.782079 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-43bc7cd2-7766-4616-902f-25651edaaa5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:55:28.891834 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bc7cd2-7766-4616-902f-25651edaaa5d None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:55:28.977220 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51481ce9-f707-42d6-8aad-7cc39414e6be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4294c170df354fe892831281acd4ea7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:55:28.977828 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51481ce9-f707-42d6-8aad-7cc39414e6be service neutron] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:55:28.978108 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51481ce9-f707-42d6-8aad-7cc39414e6be service neutron] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:55:28.978382 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51481ce9-f707-42d6-8aad-7cc39414e6be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:55:28.979991 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-51481ce9-f707-42d6-8aad-7cc39414e6be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:55:28.997023 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:55:29.092101 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51481ce9-f707-42d6-8aad-7cc39414e6be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:55:29.093608 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51481ce9-f707-42d6-8aad-7cc39414e6be service neutron] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:55:29.112833 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 655/1328] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 09:55:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 09:55:31.364442 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91209ab-38db-4da0-91c8-d9a973fdd399 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:55:31.365003 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91209ab-38db-4da0-91c8-d9a973fdd399 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:55:31.365003 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91209ab-38db-4da0-91c8-d9a973fdd399 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:55:31.366398 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 674/1329] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:55:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:55:31.371799 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d9ea1-d88a-4926-ab8c-91b85042f56c None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:55:31.372238 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d9ea1-d88a-4926-ab8c-91b85042f56c None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:55:31.372329 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d9ea1-d88a-4926-ab8c-91b85042f56c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:55:31.438064 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-1a6d9ea1-d88a-4926-ab8c-91b85042f56c None None] MFA Rules not processed for user `09ce8c0b6d584400af33d8c86a3b8bba`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:55:31.439287 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-1a6d9ea1-d88a-4926-ab8c-91b85042f56c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:55:31.518078 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:55:31.553843 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 656/1330] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:55:31 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 09:55:31.592969 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91209ab-38db-4da0-91c8-d9a973fdd399 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:55:31.594565 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-f91209ab-38db-4da0-91c8-d9a973fdd399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:55:31.704962 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91209ab-38db-4da0-91c8-d9a973fdd399 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:55:31.724257 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:55:31.780957 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7b1a29-b9c0-4294-8d76-0cc3a82bd324 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4294c170df354fe892831281acd4ea7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:55:31.781604 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7b1a29-b9c0-4294-8d76-0cc3a82bd324 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:55:31.781882 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7b1a29-b9c0-4294-8d76-0cc3a82bd324 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:55:31.782148 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7b1a29-b9c0-4294-8d76-0cc3a82bd324 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:55:31.783737 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-5b7b1a29-b9c0-4294-8d76-0cc3a82bd324 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:55:31.902606 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7b1a29-b9c0-4294-8d76-0cc3a82bd324 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:55:31.904055 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7b1a29-b9c0-4294-8d76-0cc3a82bd324 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:55:31.923647 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 675/1331] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 09:55:31 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 09:55:34.151908 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f130f-8ff8-42d2-b1cd-18aa1bccfb94 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:55:34.152793 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f130f-8ff8-42d2-b1cd-18aa1bccfb94 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:55:34.152793 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f130f-8ff8-42d2-b1cd-18aa1bccfb94 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:55:34.155003 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 657/1332] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:55:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:55:34.163074 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a7332-b7ed-4140-92cf-9fe3e5a420b0 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:55:34.163534 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a7332-b7ed-4140-92cf-9fe3e5a420b0 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:55:34.163634 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a7332-b7ed-4140-92cf-9fe3e5a420b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:55:34.246933 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:55:34.250099 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-118a7332-b7ed-4140-92cf-9fe3e5a420b0 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:55:34.252004 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-118a7332-b7ed-4140-92cf-9fe3e5a420b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:55:34.354059 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 676/1333] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:55:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 09:55:34.398295 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0f130f-8ff8-42d2-b1cd-18aa1bccfb94 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:55:34.400606 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-7d0f130f-8ff8-42d2-b1cd-18aa1bccfb94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:55:34.514472 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0f130f-8ff8-42d2-b1cd-18aa1bccfb94 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:55:34.598905 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96ef071-cf1b-4a4e-accc-a2a928d93f46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4294c170df354fe892831281acd4ea7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:55:34.599501 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96ef071-cf1b-4a4e-accc-a2a928d93f46 service neutron] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:55:34.599792 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96ef071-cf1b-4a4e-accc-a2a928d93f46 service neutron] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:55:34.600061 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96ef071-cf1b-4a4e-accc-a2a928d93f46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:55:34.601703 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-d96ef071-cf1b-4a4e-accc-a2a928d93f46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:55:34.630628 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:55:34.716974 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96ef071-cf1b-4a4e-accc-a2a928d93f46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:55:34.718454 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96ef071-cf1b-4a4e-accc-a2a928d93f46 service neutron] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:55:34.736465 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 658/1334] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 09:55:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 09:55:36.770759 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539455a9-7968-4e09-9f4a-bfae993cf740 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:55:36.771635 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539455a9-7968-4e09-9f4a-bfae993cf740 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:55:36.771635 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539455a9-7968-4e09-9f4a-bfae993cf740 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:55:36.773938 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 677/1335] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:55:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:55:36.779902 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca6ec55-d2a1-4675-a084-1eddaa155436 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:55:36.780700 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca6ec55-d2a1-4675-a084-1eddaa155436 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:55:36.780898 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca6ec55-d2a1-4675-a084-1eddaa155436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:55:36.854184 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-dca6ec55-d2a1-4675-a084-1eddaa155436 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:55:36.855450 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-dca6ec55-d2a1-4675-a084-1eddaa155436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:55:36.951992 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:55:36.985830 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 659/1336] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:55:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 09:55:37.026424 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539455a9-7968-4e09-9f4a-bfae993cf740 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:55:37.028806 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-539455a9-7968-4e09-9f4a-bfae993cf740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:55:37.150936 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539455a9-7968-4e09-9f4a-bfae993cf740 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:55:37.179737 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:55:37.239295 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ace89d5-0126-4011-821f-269be2bf5b90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4294c170df354fe892831281acd4ea7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:55:37.239891 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ace89d5-0126-4011-821f-269be2bf5b90 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:55:37.240170 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ace89d5-0126-4011-821f-269be2bf5b90 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:55:37.240443 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ace89d5-0126-4011-821f-269be2bf5b90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:55:37.242093 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-1ace89d5-0126-4011-821f-269be2bf5b90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:55:37.356308 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ace89d5-0126-4011-821f-269be2bf5b90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:55:37.357779 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ace89d5-0126-4011-821f-269be2bf5b90 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:55:37.377040 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 678/1337] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 09:55:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 09:55:39.731258 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a379c02-6fb8-43c6-b0f2-cb101333ad42 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:55:39.732136 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a379c02-6fb8-43c6-b0f2-cb101333ad42 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:55:39.732136 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a379c02-6fb8-43c6-b0f2-cb101333ad42 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:55:39.734349 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 660/1338] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:55:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:55:39.742813 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7b6b21-3748-469d-93fb-d16c0afd43a8 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:55:39.743588 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7b6b21-3748-469d-93fb-d16c0afd43a8 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:55:39.743733 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7b6b21-3748-469d-93fb-d16c0afd43a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:55:39.818092 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-8d7b6b21-3748-469d-93fb-d16c0afd43a8 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:55:39.819312 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-8d7b6b21-3748-469d-93fb-d16c0afd43a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:55:39.827819 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:55:39.929387 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 679/1339] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:55:39 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 09:55:39.969054 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a379c02-6fb8-43c6-b0f2-cb101333ad42 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:55:39.970645 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-2a379c02-6fb8-43c6-b0f2-cb101333ad42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:55:40.076413 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a379c02-6fb8-43c6-b0f2-cb101333ad42 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:55:40.166066 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261b48d6-0925-4f59-8afb-579d5cfc8d50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4294c170df354fe892831281acd4ea7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:55:40.166654 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261b48d6-0925-4f59-8afb-579d5cfc8d50 service neutron] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:55:40.166929 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261b48d6-0925-4f59-8afb-579d5cfc8d50 service neutron] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:55:40.167198 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261b48d6-0925-4f59-8afb-579d5cfc8d50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:55:40.168761 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-261b48d6-0925-4f59-8afb-579d5cfc8d50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:55:40.210109 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:55:40.286762 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261b48d6-0925-4f59-8afb-579d5cfc8d50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:55:40.288214 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261b48d6-0925-4f59-8afb-579d5cfc8d50 service neutron] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:55:40.306998 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 661/1340] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 09:55:39 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 09:55:44.185932 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a114919f-4565-4907-8b5e-ed755ab43895 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:55:44.186536 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a114919f-4565-4907-8b5e-ed755ab43895 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:55:44.186536 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a114919f-4565-4907-8b5e-ed755ab43895 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:55:44.188174 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 680/1341] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:55:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:55:44.193575 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8756a75-8928-40b2-8bbb-913e623d07bd None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:55:44.194037 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8756a75-8928-40b2-8bbb-913e623d07bd None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:55:44.194153 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8756a75-8928-40b2-8bbb-913e623d07bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:55:44.261317 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-e8756a75-8928-40b2-8bbb-913e623d07bd None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:55:44.262538 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-e8756a75-8928-40b2-8bbb-913e623d07bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:55:44.350033 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:55:44.362555 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 662/1342] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:55:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 09:55:44.400907 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a114919f-4565-4907-8b5e-ed755ab43895 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:55:44.402509 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-a114919f-4565-4907-8b5e-ed755ab43895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:55:44.511326 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a114919f-4565-4907-8b5e-ed755ab43895 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:55:44.548823 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:55:44.586763 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfae1ab8-2b91-4628-a53d-6d67ca3770f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4294c170df354fe892831281acd4ea7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:55:44.587383 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfae1ab8-2b91-4628-a53d-6d67ca3770f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:55:44.587663 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfae1ab8-2b91-4628-a53d-6d67ca3770f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:55:44.587934 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfae1ab8-2b91-4628-a53d-6d67ca3770f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:55:44.589600 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-bfae1ab8-2b91-4628-a53d-6d67ca3770f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:55:44.700821 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfae1ab8-2b91-4628-a53d-6d67ca3770f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:55:44.702287 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfae1ab8-2b91-4628-a53d-6d67ca3770f1 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:55:44.720791 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 681/1343] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 09:55:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 09:55:47.673030 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa87dea3-01b8-4c18-86c1-ae411b8867bf None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:55:47.673599 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa87dea3-01b8-4c18-86c1-ae411b8867bf None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:55:47.673599 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa87dea3-01b8-4c18-86c1-ae411b8867bf None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:55:47.675069 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 663/1344] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:55:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:55:47.680583 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43334feb-5a84-4e57-a0be-cc0ce1c4a17e None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:55:47.681029 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43334feb-5a84-4e57-a0be-cc0ce1c4a17e None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:55:47.681181 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43334feb-5a84-4e57-a0be-cc0ce1c4a17e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:55:47.750556 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-43334feb-5a84-4e57-a0be-cc0ce1c4a17e None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:55:47.752478 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-43334feb-5a84-4e57-a0be-cc0ce1c4a17e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:55:47.771877 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:55:47.855864 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 682/1345] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:55:47 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 09:55:47.893363 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa87dea3-01b8-4c18-86c1-ae411b8867bf None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:55:47.894918 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-fa87dea3-01b8-4c18-86c1-ae411b8867bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:55:48.004149 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa87dea3-01b8-4c18-86c1-ae411b8867bf None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:55:48.084627 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fa123b-894b-4521-8c24-29565f2e3380 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4294c170df354fe892831281acd4ea7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:55:48.085299 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fa123b-894b-4521-8c24-29565f2e3380 service neutron] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:55:48.085582 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fa123b-894b-4521-8c24-29565f2e3380 service neutron] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:55:48.085851 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fa123b-894b-4521-8c24-29565f2e3380 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:55:48.087594 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-f3fa123b-894b-4521-8c24-29565f2e3380 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:55:48.136074 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:55:48.204646 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fa123b-894b-4521-8c24-29565f2e3380 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:55:48.206118 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fa123b-894b-4521-8c24-29565f2e3380 service neutron] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:55:48.225974 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 664/1346] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 09:55:47 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 09:55:52.272491 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cd9976-4d4d-4a73-a5be-13c2504e7a4e None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:55:52.273144 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cd9976-4d4d-4a73-a5be-13c2504e7a4e None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:55:52.273144 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cd9976-4d4d-4a73-a5be-13c2504e7a4e None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:55:52.274510 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 683/1347] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:55:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:55:52.280521 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33533e16-cc27-4a86-8597-b4e362191b1e None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:55:52.281099 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33533e16-cc27-4a86-8597-b4e362191b1e None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:55:52.281099 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33533e16-cc27-4a86-8597-b4e362191b1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:55:52.355726 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-33533e16-cc27-4a86-8597-b4e362191b1e None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:55:52.356955 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-33533e16-cc27-4a86-8597-b4e362191b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:55:52.457016 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:55:52.460379 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 665/1348] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:55:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 09:55:52.498423 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cd9976-4d4d-4a73-a5be-13c2504e7a4e None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:55:52.499984 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-a9cd9976-4d4d-4a73-a5be-13c2504e7a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:55:52.613561 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cd9976-4d4d-4a73-a5be-13c2504e7a4e None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:55:52.662530 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:55:52.697997 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e306cef0-64e7-4726-86a8-df1dbf2d9d45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4294c170df354fe892831281acd4ea7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:55:52.698621 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e306cef0-64e7-4726-86a8-df1dbf2d9d45 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:55:52.698902 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e306cef0-64e7-4726-86a8-df1dbf2d9d45 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:55:52.699169 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e306cef0-64e7-4726-86a8-df1dbf2d9d45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:55:52.700864 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-e306cef0-64e7-4726-86a8-df1dbf2d9d45 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:55:52.817551 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e306cef0-64e7-4726-86a8-df1dbf2d9d45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:55:52.818997 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e306cef0-64e7-4726-86a8-df1dbf2d9d45 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:55:52.840869 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 684/1349] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 09:55:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 09:55:57.655091 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94612c8-70df-419c-b890-ba2d0628ef04 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:55:57.655574 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94612c8-70df-419c-b890-ba2d0628ef04 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:55:57.655658 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94612c8-70df-419c-b890-ba2d0628ef04 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:55:57.661018 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 666/1350] 10.222.0.27 () {54 vars in 921 bytes} [Wed Aug 10 09:55:57 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:55:57.668991 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b67663-f16a-4f4a-acf1-39aaad4a6bf8 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:55:57.669498 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b67663-f16a-4f4a-acf1-39aaad4a6bf8 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:55:57.669706 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b67663-f16a-4f4a-acf1-39aaad4a6bf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:55:57.759321 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-e1b67663-f16a-4f4a-acf1-39aaad4a6bf8 None None] MFA Rules not processed for user `a6b658f1e27b4dfb96de71dc6a7e9496`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:55:57.759321 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-e1b67663-f16a-4f4a-acf1-39aaad4a6bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:55:57.775514 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:55:57.921778 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 685/1351] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Aug 10 09:55:57 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 09:56:02.025495 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72701b97-30a4-47da-97a1-ec10cf745ba5 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:56:02.026077 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72701b97-30a4-47da-97a1-ec10cf745ba5 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:56:02.026077 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72701b97-30a4-47da-97a1-ec10cf745ba5 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:56:02.027948 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 667/1352] 10.222.0.27 () {54 vars in 921 bytes} [Wed Aug 10 09:56:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:56:02.033093 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a5fa73-0112-4115-b35f-2920f7089e60 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:56:02.033560 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a5fa73-0112-4115-b35f-2920f7089e60 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:56:02.033656 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a5fa73-0112-4115-b35f-2920f7089e60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:56:02.135012 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-95a5fa73-0112-4115-b35f-2920f7089e60 None None] MFA Rules not processed for user `a6b658f1e27b4dfb96de71dc6a7e9496`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:56:02.136258 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-95a5fa73-0112-4115-b35f-2920f7089e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:56:02.210568 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:56:02.249355 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 686/1353] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Aug 10 09:56:02 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 09:56:03.715732 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352869b3-315b-4348-9b26-19342f59c210 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:56:03.716270 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352869b3-315b-4348-9b26-19342f59c210 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:56:03.716270 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352869b3-315b-4348-9b26-19342f59c210 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:56:03.717705 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 668/1354] 10.222.0.27 () {54 vars in 921 bytes} [Wed Aug 10 09:56:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:56:03.722807 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366cc355-30b3-41b2-b9ad-44e551f8930c None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:56:03.723240 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366cc355-30b3-41b2-b9ad-44e551f8930c None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:56:03.723351 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366cc355-30b3-41b2-b9ad-44e551f8930c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:56:03.799901 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-366cc355-30b3-41b2-b9ad-44e551f8930c None None] MFA Rules not processed for user `a6b658f1e27b4dfb96de71dc6a7e9496`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:56:03.801114 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-366cc355-30b3-41b2-b9ad-44e551f8930c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:56:03.910935 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 687/1355] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Aug 10 09:56:03 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 09:56:07.298760 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf1091-c4e3-4b17-889e-24e6d4f7a094 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:56:07.299333 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf1091-c4e3-4b17-889e-24e6d4f7a094 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:56:07.299333 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf1091-c4e3-4b17-889e-24e6d4f7a094 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:56:07.304906 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 669/1356] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:56:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:56:07.306767 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd65ac83-3d74-4dd1-939e-ad96cad57f0d None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:56:07.306767 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd65ac83-3d74-4dd1-939e-ad96cad57f0d None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:56:07.307322 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd65ac83-3d74-4dd1-939e-ad96cad57f0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:56:07.358081 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:56:07.392312 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-fd65ac83-3d74-4dd1-939e-ad96cad57f0d None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:56:07.393536 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-fd65ac83-3d74-4dd1-939e-ad96cad57f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:56:07.499588 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 688/1357] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:56:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 09:56:07.560356 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2334de92-6576-4db2-bce7-b608709408b5 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:56:07.561023 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2334de92-6576-4db2-bce7-b608709408b5 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:56:07.561585 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2334de92-6576-4db2-bce7-b608709408b5 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:56:07.564576 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 670/1358] 10.222.0.27 () {54 vars in 962 bytes} [Wed Aug 10 09:56:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:56:07.574961 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6b4853-0440-487c-9652-1d94e7fd64f8 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:56:07.577036 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6b4853-0440-487c-9652-1d94e7fd64f8 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:56:07.577740 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6b4853-0440-487c-9652-1d94e7fd64f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:56:07.664370 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-fa6b4853-0440-487c-9652-1d94e7fd64f8 None None] MFA Rules not processed for user `dd8580888cba41a88566da4540b1130c`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:56:07.665618 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-fa6b4853-0440-487c-9652-1d94e7fd64f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:56:07.720582 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:56:07.790503 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 689/1359] 10.222.0.27 () {58 vars in 1059 bytes} [Wed Aug 10 09:56:07 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 09:56:07.798409 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2334de92-6576-4db2-bce7-b608709408b5 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:56:07.800007 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-2334de92-6576-4db2-bce7-b608709408b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:56:07.960489 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2334de92-6576-4db2-bce7-b608709408b5 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:56:08.034785 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:56:08.076687 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b13eb00-6804-485a-9a00-da9949135a9b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd8580888cba41a88566da4540b1130c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:56:08.077426 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b13eb00-6804-485a-9a00-da9949135a9b service nova] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:56:08.077793 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b13eb00-6804-485a-9a00-da9949135a9b service nova] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:56:08.078131 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b13eb00-6804-485a-9a00-da9949135a9b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:56:08.079792 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-9b13eb00-6804-485a-9a00-da9949135a9b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:56:08.176199 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b13eb00-6804-485a-9a00-da9949135a9b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:56:08.178211 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b13eb00-6804-485a-9a00-da9949135a9b service nova] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:56:08.198858 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 671/1360] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 09:56:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 09:56:10.384813 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988db667-5b47-4bc6-a933-d2a5e1760435 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:56:10.385308 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988db667-5b47-4bc6-a933-d2a5e1760435 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:56:10.385390 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988db667-5b47-4bc6-a933-d2a5e1760435 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:56:10.389394 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 690/1361] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:56:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:56:10.392095 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa30b85-1422-4559-99e0-942fce1aa26e None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:56:10.393163 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa30b85-1422-4559-99e0-942fce1aa26e None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:56:10.394786 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa30b85-1422-4559-99e0-942fce1aa26e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:56:10.469386 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-6fa30b85-1422-4559-99e0-942fce1aa26e None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:56:10.470671 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-6fa30b85-1422-4559-99e0-942fce1aa26e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:56:10.509840 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:56:10.573911 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 672/1362] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:56:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 09:56:10.630122 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988db667-5b47-4bc6-a933-d2a5e1760435 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:56:10.631626 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-988db667-5b47-4bc6-a933-d2a5e1760435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:56:10.807351 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988db667-5b47-4bc6-a933-d2a5e1760435 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:56:10.819309 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:56:10.961747 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e8b69d-b301-487b-904b-1e857d144a1f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd8580888cba41a88566da4540b1130c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:56:10.962406 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e8b69d-b301-487b-904b-1e857d144a1f service nova] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:56:10.962628 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e8b69d-b301-487b-904b-1e857d144a1f service nova] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:56:10.962895 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e8b69d-b301-487b-904b-1e857d144a1f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:56:10.964464 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-95e8b69d-b301-487b-904b-1e857d144a1f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:56:11.059395 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e8b69d-b301-487b-904b-1e857d144a1f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:56:11.061041 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e8b69d-b301-487b-904b-1e857d144a1f service nova] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:56:11.080691 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 691/1363] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 09:56:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 09:56:13.430673 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f947df77-dac2-4d92-82dc-964cf1254a4e None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:56:13.431221 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f947df77-dac2-4d92-82dc-964cf1254a4e None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:56:13.431221 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f947df77-dac2-4d92-82dc-964cf1254a4e None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:56:13.432678 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 673/1364] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:56:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:56:13.439143 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8297dd79-f862-4089-92e7-afe7af720f94 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:56:13.439625 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8297dd79-f862-4089-92e7-afe7af720f94 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:56:13.439798 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8297dd79-f862-4089-92e7-afe7af720f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:56:13.457277 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:56:13.518752 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-8297dd79-f862-4089-92e7-afe7af720f94 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:56:13.519978 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-8297dd79-f862-4089-92e7-afe7af720f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:56:13.641389 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 692/1365] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:56:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 09:56:13.691961 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de2b4a1-03d3-4bbe-9ad5-6321315166c4 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:56:13.692137 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de2b4a1-03d3-4bbe-9ad5-6321315166c4 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:56:13.692391 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de2b4a1-03d3-4bbe-9ad5-6321315166c4 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:56:13.694681 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 674/1366] 10.222.0.27 () {54 vars in 962 bytes} [Wed Aug 10 09:56:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:56:13.700790 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00045dd-315f-4b41-9ff2-8a8bb9261e64 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:56:13.701160 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00045dd-315f-4b41-9ff2-8a8bb9261e64 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:56:13.701469 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00045dd-315f-4b41-9ff2-8a8bb9261e64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:56:13.785611 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-c00045dd-315f-4b41-9ff2-8a8bb9261e64 None None] MFA Rules not processed for user `dd8580888cba41a88566da4540b1130c`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:56:13.786819 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-c00045dd-315f-4b41-9ff2-8a8bb9261e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:56:13.825896 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:56:13.909697 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 693/1367] 10.222.0.27 () {58 vars in 1059 bytes} [Wed Aug 10 09:56:13 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 09:56:13.917654 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de2b4a1-03d3-4bbe-9ad5-6321315166c4 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:56:13.919183 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-2de2b4a1-03d3-4bbe-9ad5-6321315166c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:56:14.072729 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de2b4a1-03d3-4bbe-9ad5-6321315166c4 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:56:14.093827 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:56:14.191472 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0180f856-0aef-4c4b-bdd9-e838341b7470 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd8580888cba41a88566da4540b1130c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:56:14.192060 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0180f856-0aef-4c4b-bdd9-e838341b7470 service nova] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:56:14.192337 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0180f856-0aef-4c4b-bdd9-e838341b7470 service nova] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:56:14.192589 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0180f856-0aef-4c4b-bdd9-e838341b7470 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:56:14.194250 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-0180f856-0aef-4c4b-bdd9-e838341b7470 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:56:14.286385 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0180f856-0aef-4c4b-bdd9-e838341b7470 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:56:14.287967 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0180f856-0aef-4c4b-bdd9-e838341b7470 service nova] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:56:14.307017 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 675/1368] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 09:56:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 09:56:15.294816 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa9dd0e-8d45-4d3f-b71f-f24e92cf3596 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:56:15.295349 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa9dd0e-8d45-4d3f-b71f-f24e92cf3596 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:56:15.295349 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa9dd0e-8d45-4d3f-b71f-f24e92cf3596 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:56:15.297018 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 694/1369] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:56:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:56:15.303044 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e87841-c1b6-4011-87a4-1547e2473d71 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:56:15.303536 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e87841-c1b6-4011-87a4-1547e2473d71 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:56:15.303642 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e87841-c1b6-4011-87a4-1547e2473d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:56:15.346175 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:56:15.385934 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-70e87841-c1b6-4011-87a4-1547e2473d71 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:56:15.387214 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-70e87841-c1b6-4011-87a4-1547e2473d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:56:15.503784 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 676/1370] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:56:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 09:56:15.843737 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecba945-9055-45f4-9b61-d3c380ceea0b None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:56:15.843737 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecba945-9055-45f4-9b61-d3c380ceea0b None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:56:15.843737 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecba945-9055-45f4-9b61-d3c380ceea0b None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:56:15.844838 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 695/1371] 10.222.0.27 () {54 vars in 964 bytes} [Wed Aug 10 09:56:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:56:15.849799 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b292abfd-25f3-45f9-869a-ae5f3dfc57b4 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:56:15.850162 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b292abfd-25f3-45f9-869a-ae5f3dfc57b4 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:56:15.850595 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b292abfd-25f3-45f9-869a-ae5f3dfc57b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:56:15.935350 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-b292abfd-25f3-45f9-869a-ae5f3dfc57b4 None None] MFA Rules not processed for user `bbf8e725cbe0403d943b136235eac057`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:56:15.936635 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-b292abfd-25f3-45f9-869a-ae5f3dfc57b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:56:15.990850 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:56:16.028810 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 677/1372] 10.222.0.27 () {58 vars in 1061 bytes} [Wed Aug 10 09:56:15 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 09:56:16.037758 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecba945-9055-45f4-9b61-d3c380ceea0b None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:56:16.039551 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-1ecba945-9055-45f4-9b61-d3c380ceea0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:56:16.156782 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecba945-9055-45f4-9b61-d3c380ceea0b None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:56:16.199968 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:56:16.235259 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2810dfbc-7d54-440b-aada-396046328ba3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf8e725cbe0403d943b136235eac057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:56:16.235869 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2810dfbc-7d54-440b-aada-396046328ba3 service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:56:16.236133 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2810dfbc-7d54-440b-aada-396046328ba3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:56:16.236419 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2810dfbc-7d54-440b-aada-396046328ba3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:56:16.238045 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-2810dfbc-7d54-440b-aada-396046328ba3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:56:16.367913 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2810dfbc-7d54-440b-aada-396046328ba3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:56:16.369480 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2810dfbc-7d54-440b-aada-396046328ba3 service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:56:16.373041 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf5c169-b996-4d4f-a920-b63d4ba3a229 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:56:16.373475 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf5c169-b996-4d4f-a920-b63d4ba3a229 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:56:16.373686 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf5c169-b996-4d4f-a920-b63d4ba3a229 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:56:16.375131 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 678/1373] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:56:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:56:16.380041 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bad35fd-08ad-447c-89ac-34943fcf8f5a None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:56:16.380326 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bad35fd-08ad-447c-89ac-34943fcf8f5a None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:56:16.380598 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bad35fd-08ad-447c-89ac-34943fcf8f5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:56:16.393323 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 696/1374] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 09:56:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 09:56:16.461244 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-7bad35fd-08ad-447c-89ac-34943fcf8f5a None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:56:16.462700 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-7bad35fd-08ad-447c-89ac-34943fcf8f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:56:16.569700 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 679/1375] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:56:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 09:56:16.608737 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2810dfbc-7d54-440b-aada-396046328ba3 service cinder] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:56:16.610084 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-2810dfbc-7d54-440b-aada-396046328ba3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:56:16.684303 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:56:16.718627 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2810dfbc-7d54-440b-aada-396046328ba3 service cinder] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:56:16.837136 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acceeb5-1bd7-447b-bff4-d349f898314b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd8580888cba41a88566da4540b1130c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:56:16.837762 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acceeb5-1bd7-447b-bff4-d349f898314b service nova] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:56:16.838045 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acceeb5-1bd7-447b-bff4-d349f898314b service nova] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:56:16.838317 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acceeb5-1bd7-447b-bff4-d349f898314b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:56:16.839960 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-7acceeb5-1bd7-447b-bff4-d349f898314b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:56:16.922831 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:56:16.935111 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acceeb5-1bd7-447b-bff4-d349f898314b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:56:16.936757 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acceeb5-1bd7-447b-bff4-d349f898314b service nova] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:56:16.955668 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 697/1376] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 09:56:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 09:56:18.967842 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8205d9-de98-4790-b42b-2c3dec4d1dae None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:56:18.968370 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8205d9-de98-4790-b42b-2c3dec4d1dae None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:56:18.968370 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8205d9-de98-4790-b42b-2c3dec4d1dae None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:56:18.969915 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 680/1377] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:56:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:56:18.974865 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0f7ec0-54ba-4113-877c-b57dec29de61 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:56:18.975262 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0f7ec0-54ba-4113-877c-b57dec29de61 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:56:18.975444 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0f7ec0-54ba-4113-877c-b57dec29de61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:56:19.043891 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-4e0f7ec0-54ba-4113-877c-b57dec29de61 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:56:19.045020 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-4e0f7ec0-54ba-4113-877c-b57dec29de61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:56:19.144238 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 698/1378] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:56:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 09:56:19.187917 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8205d9-de98-4790-b42b-2c3dec4d1dae None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:56:19.189501 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-3f8205d9-de98-4790-b42b-2c3dec4d1dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:56:19.243642 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:56:19.486330 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8205d9-de98-4790-b42b-2c3dec4d1dae None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:56:19.602202 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9ac083-c940-4770-a2b4-19747975f074 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd8580888cba41a88566da4540b1130c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:56:19.603449 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9ac083-c940-4770-a2b4-19747975f074 service nova] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:56:19.603449 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9ac083-c940-4770-a2b4-19747975f074 service nova] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:56:19.603449 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9ac083-c940-4770-a2b4-19747975f074 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:56:19.605241 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-8d9ac083-c940-4770-a2b4-19747975f074 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:56:19.617034 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:56:19.704013 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9ac083-c940-4770-a2b4-19747975f074 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:56:19.705688 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9ac083-c940-4770-a2b4-19747975f074 service nova] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:56:19.730024 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 681/1379] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 09:56:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 09:56:21.773667 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c15707-844e-41b0-aa12-1ee08746e975 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:56:21.774294 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c15707-844e-41b0-aa12-1ee08746e975 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:56:21.774294 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c15707-844e-41b0-aa12-1ee08746e975 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:56:21.775534 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 699/1380] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:56:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:56:21.781017 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bf2717-05e0-40ef-a561-6cc6391873b1 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:56:21.781521 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bf2717-05e0-40ef-a561-6cc6391873b1 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:56:21.781754 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bf2717-05e0-40ef-a561-6cc6391873b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:56:21.862456 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-e6bf2717-05e0-40ef-a561-6cc6391873b1 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:56:21.863659 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-e6bf2717-05e0-40ef-a561-6cc6391873b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:56:21.954611 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:56:21.968328 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 682/1381] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:56:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 09:56:22.011342 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c15707-844e-41b0-aa12-1ee08746e975 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:56:22.012845 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-89c15707-844e-41b0-aa12-1ee08746e975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:56:22.080465 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:56:22.173879 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c15707-844e-41b0-aa12-1ee08746e975 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:56:22.291332 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2f3785-c799-41c0-9404-71273e8385e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd8580888cba41a88566da4540b1130c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:56:22.291855 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2f3785-c799-41c0-9404-71273e8385e0 service nova] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:56:22.292129 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2f3785-c799-41c0-9404-71273e8385e0 service nova] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:56:22.292390 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2f3785-c799-41c0-9404-71273e8385e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:56:22.294000 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-ef2f3785-c799-41c0-9404-71273e8385e0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:56:22.324388 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:56:22.399609 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2f3785-c799-41c0-9404-71273e8385e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:56:22.401221 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2f3785-c799-41c0-9404-71273e8385e0 service nova] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:56:22.419876 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 700/1382] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 09:56:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 09:56:24.505494 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7d526e-8515-4917-b126-544c13f836e7 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:56:24.506590 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7d526e-8515-4917-b126-544c13f836e7 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:56:24.506590 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7d526e-8515-4917-b126-544c13f836e7 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:56:24.507504 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 683/1383] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:56:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:56:24.513539 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f22711c-1de0-400e-adf2-4c57fb4f9228 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:56:24.514424 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f22711c-1de0-400e-adf2-4c57fb4f9228 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:56:24.514424 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f22711c-1de0-400e-adf2-4c57fb4f9228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:56:24.613533 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-4f22711c-1de0-400e-adf2-4c57fb4f9228 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:56:24.614798 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-4f22711c-1de0-400e-adf2-4c57fb4f9228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:56:24.724210 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:56:24.728164 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 701/1384] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:56:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 09:56:24.782951 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7d526e-8515-4917-b126-544c13f836e7 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:56:24.784616 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-dd7d526e-8515-4917-b126-544c13f836e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:56:24.962983 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7d526e-8515-4917-b126-544c13f836e7 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:56:25.030687 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:56:25.083820 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec4d758-f15e-49e2-a78e-d5678d83beaf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd8580888cba41a88566da4540b1130c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:56:25.084492 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec4d758-f15e-49e2-a78e-d5678d83beaf service nova] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:56:25.084780 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec4d758-f15e-49e2-a78e-d5678d83beaf service nova] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:56:25.085057 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec4d758-f15e-49e2-a78e-d5678d83beaf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:56:25.086913 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-3ec4d758-f15e-49e2-a78e-d5678d83beaf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:56:25.202290 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec4d758-f15e-49e2-a78e-d5678d83beaf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:56:25.204263 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec4d758-f15e-49e2-a78e-d5678d83beaf service nova] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:56:25.226580 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 684/1385] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 09:56:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 09:56:27.378944 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb755669-d029-4ba8-a8cb-9e4dcba34b8b None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:56:27.379541 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb755669-d029-4ba8-a8cb-9e4dcba34b8b None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:56:27.379541 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb755669-d029-4ba8-a8cb-9e4dcba34b8b None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:56:27.380921 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 702/1386] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:56:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:56:27.386796 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963a0688-4f46-49de-bb41-2a276632b183 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:56:27.387215 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963a0688-4f46-49de-bb41-2a276632b183 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:56:27.387364 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963a0688-4f46-49de-bb41-2a276632b183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:56:27.460593 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-963a0688-4f46-49de-bb41-2a276632b183 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:56:27.462275 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-963a0688-4f46-49de-bb41-2a276632b183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:56:27.490311 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:56:27.568553 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 685/1387] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:56:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 09:56:27.620387 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb755669-d029-4ba8-a8cb-9e4dcba34b8b None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:56:27.622168 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-cb755669-d029-4ba8-a8cb-9e4dcba34b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:56:27.775682 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb755669-d029-4ba8-a8cb-9e4dcba34b8b None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:56:27.853896 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:56:27.909478 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0cece1-b51b-4aa4-8eef-af6d1285d759 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd8580888cba41a88566da4540b1130c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:56:27.910084 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0cece1-b51b-4aa4-8eef-af6d1285d759 service nova] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:56:27.910375 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0cece1-b51b-4aa4-8eef-af6d1285d759 service nova] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:56:27.910653 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0cece1-b51b-4aa4-8eef-af6d1285d759 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:56:27.912380 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-7f0cece1-b51b-4aa4-8eef-af6d1285d759 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:56:28.009180 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0cece1-b51b-4aa4-8eef-af6d1285d759 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:56:28.010854 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0cece1-b51b-4aa4-8eef-af6d1285d759 service nova] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:56:28.029519 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 703/1388] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 09:56:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 09:56:30.218565 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45995f21-8180-4aa0-b04a-0f1253ed1d02 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:56:30.219242 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45995f21-8180-4aa0-b04a-0f1253ed1d02 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:56:30.219242 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45995f21-8180-4aa0-b04a-0f1253ed1d02 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:56:30.220655 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 686/1389] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:56:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:56:30.225796 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b802840d-d748-463f-a999-172e4b9dbfb5 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:56:30.226274 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b802840d-d748-463f-a999-172e4b9dbfb5 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:56:30.226383 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b802840d-d748-463f-a999-172e4b9dbfb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:56:30.295882 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-b802840d-d748-463f-a999-172e4b9dbfb5 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:56:30.297074 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-b802840d-d748-463f-a999-172e4b9dbfb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:56:30.332622 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:56:30.396121 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 704/1390] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:56:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 09:56:30.440626 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45995f21-8180-4aa0-b04a-0f1253ed1d02 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:56:30.442404 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-45995f21-8180-4aa0-b04a-0f1253ed1d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:56:30.589458 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45995f21-8180-4aa0-b04a-0f1253ed1d02 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:56:30.598851 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:56:30.702138 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f399dff-6273-4e89-8de6-965ce745a3f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd8580888cba41a88566da4540b1130c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:56:30.702744 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f399dff-6273-4e89-8de6-965ce745a3f9 service nova] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:56:30.703019 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f399dff-6273-4e89-8de6-965ce745a3f9 service nova] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:56:30.703281 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f399dff-6273-4e89-8de6-965ce745a3f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:56:30.704874 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-3f399dff-6273-4e89-8de6-965ce745a3f9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:56:30.795969 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f399dff-6273-4e89-8de6-965ce745a3f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:56:30.797676 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f399dff-6273-4e89-8de6-965ce745a3f9 service nova] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:56:30.816393 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 687/1391] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 09:56:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 09:56:31.278541 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4976b52-5663-40ec-8b20-078e2085d93d None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:56:31.279129 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4976b52-5663-40ec-8b20-078e2085d93d None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:56:31.279129 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4976b52-5663-40ec-8b20-078e2085d93d None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:56:31.280542 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 705/1392] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:56:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:56:31.286052 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796deee9-090d-47af-a5e8-55436f080834 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:56:31.286520 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796deee9-090d-47af-a5e8-55436f080834 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:56:31.286637 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796deee9-090d-47af-a5e8-55436f080834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:56:31.302750 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:56:31.354506 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-796deee9-090d-47af-a5e8-55436f080834 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:56:31.355644 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-796deee9-090d-47af-a5e8-55436f080834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:56:31.453819 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 688/1393] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:56:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 09:56:31.512566 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cbfd9b-afad-4e65-b170-f6a19ab08280 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:56:31.512866 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cbfd9b-afad-4e65-b170-f6a19ab08280 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:56:31.513142 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cbfd9b-afad-4e65-b170-f6a19ab08280 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:56:31.514539 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 706/1394] 10.222.0.27 () {54 vars in 967 bytes} [Wed Aug 10 09:56:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:56:31.519741 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96339737-b7b2-4693-8553-ce9b79ec9121 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:56:31.520048 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96339737-b7b2-4693-8553-ce9b79ec9121 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:56:31.520323 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96339737-b7b2-4693-8553-ce9b79ec9121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:56:31.596934 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-96339737-b7b2-4693-8553-ce9b79ec9121 None None] MFA Rules not processed for user `f9e7f1ec6ad64b978f8817a5d2a73757`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:56:31.598190 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-96339737-b7b2-4693-8553-ce9b79ec9121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:56:31.636257 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:56:31.683654 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 689/1395] 10.222.0.27 () {58 vars in 1064 bytes} [Wed Aug 10 09:56:31 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 09:56:31.692285 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cbfd9b-afad-4e65-b170-f6a19ab08280 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:56:31.693931 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-91cbfd9b-afad-4e65-b170-f6a19ab08280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:56:31.799571 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cbfd9b-afad-4e65-b170-f6a19ab08280 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:56:31.864976 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:56:31.877706 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffff9950-38ab-4d9b-b4d6-6020c81dd1bb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e7f1ec6ad64b978f8817a5d2a73757', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:56:31.878316 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffff9950-38ab-4d9b-b4d6-6020c81dd1bb service glance] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:56:31.878595 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffff9950-38ab-4d9b-b4d6-6020c81dd1bb service glance] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:56:31.878863 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffff9950-38ab-4d9b-b4d6-6020c81dd1bb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:56:31.880490 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-ffff9950-38ab-4d9b-b4d6-6020c81dd1bb service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:56:31.994174 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffff9950-38ab-4d9b-b4d6-6020c81dd1bb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:56:31.995643 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffff9950-38ab-4d9b-b4d6-6020c81dd1bb service glance] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:56:32.018608 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 707/1396] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 09:56:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 09:56:32.754904 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda6a97-1e84-46ff-afe2-4c6c3776d217 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:56:32.755417 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda6a97-1e84-46ff-afe2-4c6c3776d217 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:56:32.755520 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda6a97-1e84-46ff-afe2-4c6c3776d217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:56:32.822299 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-cbda6a97-1e84-46ff-afe2-4c6c3776d217 None None] MFA Rules not processed for user `179709fe7d8343689f096ac0d9a333b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:56:32.823515 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-cbda6a97-1e84-46ff-afe2-4c6c3776d217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:56:32.851978 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b477d1f4-0995-4cc7-a2cd-6a10e5e760a9 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:56:32.852599 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b477d1f4-0995-4cc7-a2cd-6a10e5e760a9 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:56:32.852599 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b477d1f4-0995-4cc7-a2cd-6a10e5e760a9 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:56:32.854121 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 708/1397] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:56:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:56:32.859179 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b68eeb-23ab-4648-ad80-40b960accc0b None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:56:32.859458 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b68eeb-23ab-4648-ad80-40b960accc0b None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:56:32.859738 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b68eeb-23ab-4648-ad80-40b960accc0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:56:32.913168 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 690/1398] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Aug 10 09:56:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 09:56:32.931638 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-d0b68eeb-23ab-4648-ad80-40b960accc0b None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:56:32.932138 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-d0b68eeb-23ab-4648-ad80-40b960accc0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:56:32.960254 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ac4722-d156-4128-91bd-891a286c6d41 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:56:32.960612 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ac4722-d156-4128-91bd-891a286c6d41 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:56:32.960942 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ac4722-d156-4128-91bd-891a286c6d41 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:56:32.962637 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 691/1399] 10.222.0.27 () {54 vars in 943 bytes} [Wed Aug 10 09:56:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 09:56:32.968440 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d766bd81-f2a7-41c6-b281-bdc54b6bfa55 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:56:32.968719 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d766bd81-f2a7-41c6-b281-bdc54b6bfa55 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:56:32.969098 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d766bd81-f2a7-41c6-b281-bdc54b6bfa55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:56:32.976269 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:56:33.024617 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:56:33.032830 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 709/1400] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:56:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 09:56:33.044262 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-d766bd81-f2a7-41c6-b281-bdc54b6bfa55 None None] MFA Rules not processed for user `b801551d29ff4687ab8c1ce8cfa51614`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:56:33.045567 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-d766bd81-f2a7-41c6-b281-bdc54b6bfa55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:56:33.077308 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b68eeb-23ab-4648-ad80-40b960accc0b None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:56:33.078536 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-d0b68eeb-23ab-4648-ad80-40b960accc0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:56:33.154071 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 692/1401] 10.222.0.27 () {58 vars in 1040 bytes} [Wed Aug 10 09:56:32 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 09:56:33.163384 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d766bd81-f2a7-41c6-b281-bdc54b6bfa55 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:56:33.172899 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d766bd81-f2a7-41c6-b281-bdc54b6bfa55 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:56:33.195190 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b68eeb-23ab-4648-ad80-40b960accc0b None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:56:33.252406 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:56:33.273257 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:56:33.279375 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aec805a-e57f-49b1-8719-67431128fd25 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b801551d29ff4687ab8c1ce8cfa51614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:56:33.279979 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aec805a-e57f-49b1-8719-67431128fd25 service swift] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:56:33.280254 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aec805a-e57f-49b1-8719-67431128fd25 service swift] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:56:33.280521 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aec805a-e57f-49b1-8719-67431128fd25 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:56:33.282199 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-8aec805a-e57f-49b1-8719-67431128fd25 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:56:33.310411 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e24287-4913-46fb-bf6b-8a93fa3072ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd8580888cba41a88566da4540b1130c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:56:33.311022 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e24287-4913-46fb-bf6b-8a93fa3072ab service nova] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:56:33.311304 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e24287-4913-46fb-bf6b-8a93fa3072ab service nova] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:56:33.311570 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e24287-4913-46fb-bf6b-8a93fa3072ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:56:33.313775 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-f6e24287-4913-46fb-bf6b-8a93fa3072ab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:56:33.377146 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aec805a-e57f-49b1-8719-67431128fd25 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:56:33.378773 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aec805a-e57f-49b1-8719-67431128fd25 service swift] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:56:33.387914 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 693/1402] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Aug 10 09:56:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 10 09:56:33.430656 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e24287-4913-46fb-bf6b-8a93fa3072ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:56:33.432257 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e24287-4913-46fb-bf6b-8a93fa3072ab service nova] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:56:33.452306 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 710/1403] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 09:56:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 09:56:35.539332 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af58fc82-75f1-43ab-a623-a73f60c9a97b None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:56:35.539918 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af58fc82-75f1-43ab-a623-a73f60c9a97b None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:56:35.539918 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af58fc82-75f1-43ab-a623-a73f60c9a97b None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:56:35.541277 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 694/1404] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:56:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:56:35.546617 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60efa0ad-ab1d-44cb-80d6-7bdfd784477d None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:56:35.547033 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60efa0ad-ab1d-44cb-80d6-7bdfd784477d None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:56:35.547150 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60efa0ad-ab1d-44cb-80d6-7bdfd784477d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:56:35.637451 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-60efa0ad-ab1d-44cb-80d6-7bdfd784477d None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:56:35.638966 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-60efa0ad-ab1d-44cb-80d6-7bdfd784477d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:56:35.660074 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:56:35.754429 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 711/1405] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:56:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 09:56:35.791434 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af58fc82-75f1-43ab-a623-a73f60c9a97b None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:56:35.792379 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-af58fc82-75f1-43ab-a623-a73f60c9a97b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:56:35.944801 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:56:35.956615 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af58fc82-75f1-43ab-a623-a73f60c9a97b None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:56:36.074461 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2486e55-1ddc-407e-aad1-091440988fbd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd8580888cba41a88566da4540b1130c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:56:36.075395 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2486e55-1ddc-407e-aad1-091440988fbd service nova] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:56:36.075677 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2486e55-1ddc-407e-aad1-091440988fbd service nova] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:56:36.075953 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2486e55-1ddc-407e-aad1-091440988fbd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:56:36.077631 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-d2486e55-1ddc-407e-aad1-091440988fbd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:56:36.177711 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2486e55-1ddc-407e-aad1-091440988fbd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:56:36.179303 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2486e55-1ddc-407e-aad1-091440988fbd service nova] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:56:36.192817 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:56:36.203938 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 695/1406] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 09:56:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 09:56:38.275690 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417080de-6801-4371-9ce2-5c034189b599 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:56:38.276334 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417080de-6801-4371-9ce2-5c034189b599 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:56:38.276334 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417080de-6801-4371-9ce2-5c034189b599 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:56:38.278687 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 712/1407] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:56:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:56:38.283928 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92572d2c-6c29-404a-bcc9-08dc19a0daab None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:56:38.284398 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92572d2c-6c29-404a-bcc9-08dc19a0daab None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:56:38.284503 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92572d2c-6c29-404a-bcc9-08dc19a0daab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:56:38.360125 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-92572d2c-6c29-404a-bcc9-08dc19a0daab None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:56:38.361472 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-92572d2c-6c29-404a-bcc9-08dc19a0daab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:56:38.469169 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 696/1408] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:56:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 09:56:38.513909 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417080de-6801-4371-9ce2-5c034189b599 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:56:38.515823 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-417080de-6801-4371-9ce2-5c034189b599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:56:38.685517 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:56:38.688119 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417080de-6801-4371-9ce2-5c034189b599 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:56:38.817696 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466b9a0c-e405-4261-a89e-0c677ab3d024 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd8580888cba41a88566da4540b1130c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:56:38.817696 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466b9a0c-e405-4261-a89e-0c677ab3d024 service nova] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:56:38.817696 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466b9a0c-e405-4261-a89e-0c677ab3d024 service nova] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:56:38.817696 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466b9a0c-e405-4261-a89e-0c677ab3d024 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:56:38.818201 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-466b9a0c-e405-4261-a89e-0c677ab3d024 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:56:38.916827 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466b9a0c-e405-4261-a89e-0c677ab3d024 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:56:38.918763 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466b9a0c-e405-4261-a89e-0c677ab3d024 service nova] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:56:38.941384 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 713/1409] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 09:56:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 09:56:48.467112 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=67 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:56:48.939106 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=98 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:56:55.305263 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0ee193-e5fd-4c99-8540-e6fbbe81b769 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:56:55.305872 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0ee193-e5fd-4c99-8540-e6fbbe81b769 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:56:55.305872 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0ee193-e5fd-4c99-8540-e6fbbe81b769 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:56:55.307231 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 697/1410] 10.222.0.27 () {54 vars in 918 bytes} [Wed Aug 10 09:56:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:56:55.313026 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57e53b9-a765-4ff2-8f74-94f08a4b65c9 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:56:55.313465 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57e53b9-a765-4ff2-8f74-94f08a4b65c9 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:56:55.313604 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57e53b9-a765-4ff2-8f74-94f08a4b65c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:56:55.400363 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-a57e53b9-a765-4ff2-8f74-94f08a4b65c9 None None] MFA Rules not processed for user `a6b658f1e27b4dfb96de71dc6a7e9496`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:56:55.401539 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-a57e53b9-a765-4ff2-8f74-94f08a4b65c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:56:55.514964 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 714/1411] 10.222.0.27 () {58 vars in 1015 bytes} [Wed Aug 10 09:56:55 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 09:56:55.529807 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb8bcb6-a21a-44cb-97d4-89339ebca31a None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:56:55.530090 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb8bcb6-a21a-44cb-97d4-89339ebca31a None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:56:55.530358 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb8bcb6-a21a-44cb-97d4-89339ebca31a None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:56:55.531701 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 698/1412] 10.222.0.27 () {54 vars in 918 bytes} [Wed Aug 10 09:56:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:56:55.536458 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e73713-85fd-47a1-8338-e339fa356e61 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:56:55.536747 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e73713-85fd-47a1-8338-e339fa356e61 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:56:55.537026 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e73713-85fd-47a1-8338-e339fa356e61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:56:55.609622 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:56:55.612867 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-a0e73713-85fd-47a1-8338-e339fa356e61 None None] MFA Rules not processed for user `dd8580888cba41a88566da4540b1130c`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:56:55.614746 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-a0e73713-85fd-47a1-8338-e339fa356e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:56:55.748851 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 715/1413] 10.222.0.27 () {58 vars in 1015 bytes} [Wed Aug 10 09:56:55 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 09:56:58.214687 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cee5d79-d2fd-4ea2-9b70-1fe1cbdd3293 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:56:58.215654 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cee5d79-d2fd-4ea2-9b70-1fe1cbdd3293 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:56:58.215654 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cee5d79-d2fd-4ea2-9b70-1fe1cbdd3293 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:56:58.217756 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 699/1414] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 09:56:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:56:58.224208 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21613644-41ea-40f3-97f5-ddb4f06c5bf6 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:56:58.224992 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21613644-41ea-40f3-97f5-ddb4f06c5bf6 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:56:58.225228 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21613644-41ea-40f3-97f5-ddb4f06c5bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:56:58.301768 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-21613644-41ea-40f3-97f5-ddb4f06c5bf6 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:56:58.302992 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-21613644-41ea-40f3-97f5-ddb4f06c5bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:56:58.360029 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:56:58.405207 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 716/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 09:56:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 09:56:58.450079 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cee5d79-d2fd-4ea2-9b70-1fe1cbdd3293 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:56:58.451621 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-6cee5d79-d2fd-4ea2-9b70-1fe1cbdd3293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:56:58.606925 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cee5d79-d2fd-4ea2-9b70-1fe1cbdd3293 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:56:58.681133 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:56:58.723910 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0903dc45-6375-48e4-ab54-3ec213d509c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd8580888cba41a88566da4540b1130c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:56:58.724523 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0903dc45-6375-48e4-ab54-3ec213d509c0 service nova] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:56:58.724798 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0903dc45-6375-48e4-ab54-3ec213d509c0 service nova] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:56:58.725088 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0903dc45-6375-48e4-ab54-3ec213d509c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:56:58.726738 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-0903dc45-6375-48e4-ab54-3ec213d509c0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:56:58.821432 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0903dc45-6375-48e4-ab54-3ec213d509c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:56:58.823060 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0903dc45-6375-48e4-ab54-3ec213d509c0 service nova] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:56:58.841973 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 700/1416] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 09:56:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 09:56:59.738182 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aea69b0-21c3-4fab-a813-fb697bf56d1f None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:56:59.738704 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aea69b0-21c3-4fab-a813-fb697bf56d1f None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:56:59.738799 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aea69b0-21c3-4fab-a813-fb697bf56d1f None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:56:59.740717 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 717/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 10 09:56:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:56:59.747744 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e3e83c-9c20-4703-a385-954e31885a6a None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:56:59.748142 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e3e83c-9c20-4703-a385-954e31885a6a None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:56:59.748291 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e3e83c-9c20-4703-a385-954e31885a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:56:59.842940 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-68e3e83c-9c20-4703-a385-954e31885a6a None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:56:59.844158 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-68e3e83c-9c20-4703-a385-954e31885a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:56:59.872649 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:56:59.945907 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 701/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 10 09:56:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 09:57:00.097958 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aea69b0-21c3-4fab-a813-fb697bf56d1f None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:57:00.100465 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-1aea69b0-21c3-4fab-a813-fb697bf56d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:57:00.381489 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aea69b0-21c3-4fab-a813-fb697bf56d1f None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:57:00.424582 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:57:00.512862 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0ee7ec-e0fd-4382-9fe5-9b2e5ab1ddae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd8580888cba41a88566da4540b1130c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:57:00.513486 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0ee7ec-e0fd-4382-9fe5-9b2e5ab1ddae service nova] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:57:00.513764 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0ee7ec-e0fd-4382-9fe5-9b2e5ab1ddae service nova] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:57:00.514035 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0ee7ec-e0fd-4382-9fe5-9b2e5ab1ddae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:57:00.515643 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-ec0ee7ec-e0fd-4382-9fe5-9b2e5ab1ddae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:57:00.610885 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0ee7ec-e0fd-4382-9fe5-9b2e5ab1ddae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:57:00.612538 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0ee7ec-e0fd-4382-9fe5-9b2e5ab1ddae service nova] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:57:00.632029 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 718/1419] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 09:57:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 535 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 09:57:01.499799 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e47a4c-a6e3-41ff-b88e-1794aafe1905 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:57:01.500683 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e47a4c-a6e3-41ff-b88e-1794aafe1905 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:57:01.500683 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e47a4c-a6e3-41ff-b88e-1794aafe1905 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:57:01.502820 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 702/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 10 09:57:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:57:01.510257 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa03eee0-f929-4918-8b69-c1e691b6ee1a None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:57:01.510679 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa03eee0-f929-4918-8b69-c1e691b6ee1a None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:57:01.510858 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa03eee0-f929-4918-8b69-c1e691b6ee1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:57:01.567677 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:57:01.592732 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-fa03eee0-f929-4918-8b69-c1e691b6ee1a None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:57:01.593985 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-fa03eee0-f929-4918-8b69-c1e691b6ee1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:57:01.695859 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 719/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 10 09:57:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 09:57:01.850833 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e47a4c-a6e3-41ff-b88e-1794aafe1905 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:57:01.852379 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-40e47a4c-a6e3-41ff-b88e-1794aafe1905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:57:02.009925 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e47a4c-a6e3-41ff-b88e-1794aafe1905 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:57:02.023460 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:57:02.139033 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edba739-13c1-437d-bd00-1fdf691f13b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd8580888cba41a88566da4540b1130c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:57:02.139550 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edba739-13c1-437d-bd00-1fdf691f13b3 service nova] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:57:02.139826 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edba739-13c1-437d-bd00-1fdf691f13b3 service nova] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:57:02.140099 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edba739-13c1-437d-bd00-1fdf691f13b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:57:02.141808 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-9edba739-13c1-437d-bd00-1fdf691f13b3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:57:02.234012 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edba739-13c1-437d-bd00-1fdf691f13b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:57:02.235616 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edba739-13c1-437d-bd00-1fdf691f13b3 service nova] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:57:02.253504 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 703/1422] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 09:57:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 09:57:03.115809 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6644fb8e-7aab-4d4b-8215-2446a2e78917 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:57:03.116254 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6644fb8e-7aab-4d4b-8215-2446a2e78917 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:57:03.116458 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6644fb8e-7aab-4d4b-8215-2446a2e78917 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:57:03.117777 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 720/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 10 09:57:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:57:03.123860 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a19dac-adef-4e1d-b319-bfc85c05efa5 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:57:03.124573 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a19dac-adef-4e1d-b319-bfc85c05efa5 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:57:03.124724 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a19dac-adef-4e1d-b319-bfc85c05efa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:57:03.153947 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:57:03.242630 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-e4a19dac-adef-4e1d-b319-bfc85c05efa5 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:57:03.243870 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-e4a19dac-adef-4e1d-b319-bfc85c05efa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:57:03.344513 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 704/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 10 09:57:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 09:57:03.498137 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6644fb8e-7aab-4d4b-8215-2446a2e78917 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:57:03.499720 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-6644fb8e-7aab-4d4b-8215-2446a2e78917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:57:03.615138 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:57:03.653543 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6644fb8e-7aab-4d4b-8215-2446a2e78917 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:57:03.776930 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392f350d-b896-4a9e-ac9f-fa58e3b59c6e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd8580888cba41a88566da4540b1130c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:57:03.777492 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392f350d-b896-4a9e-ac9f-fa58e3b59c6e service nova] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:57:03.777763 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392f350d-b896-4a9e-ac9f-fa58e3b59c6e service nova] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:57:03.778031 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392f350d-b896-4a9e-ac9f-fa58e3b59c6e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:57:03.779741 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-392f350d-b896-4a9e-ac9f-fa58e3b59c6e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:57:03.858755 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:57:03.874737 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392f350d-b896-4a9e-ac9f-fa58e3b59c6e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:57:03.877229 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392f350d-b896-4a9e-ac9f-fa58e3b59c6e service nova] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:57:03.898083 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 721/1425] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 09:57:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 09:57:04.755751 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2649f3-cff4-4997-9ecc-4e04bb322c89 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:57:04.756437 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2649f3-cff4-4997-9ecc-4e04bb322c89 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:57:04.756437 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2649f3-cff4-4997-9ecc-4e04bb322c89 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:57:04.758578 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 705/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 10 09:57:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:57:04.764566 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ca4cd-860f-4dfc-a389-de2ffd687d8a None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:57:04.765326 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ca4cd-860f-4dfc-a389-de2ffd687d8a None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:57:04.765479 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ca4cd-860f-4dfc-a389-de2ffd687d8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:57:04.847846 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-ee7ca4cd-860f-4dfc-a389-de2ffd687d8a None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:57:04.849723 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-ee7ca4cd-860f-4dfc-a389-de2ffd687d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:57:04.968455 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 722/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 10 09:57:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 09:57:05.123371 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2649f3-cff4-4997-9ecc-4e04bb322c89 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:57:05.126012 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-fb2649f3-cff4-4997-9ecc-4e04bb322c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:57:05.222051 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:57:05.285944 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2649f3-cff4-4997-9ecc-4e04bb322c89 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:57:05.403841 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c036b259-e599-4f7c-9603-5729fa6f914f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd8580888cba41a88566da4540b1130c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:57:05.404447 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c036b259-e599-4f7c-9603-5729fa6f914f service nova] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:57:05.404726 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c036b259-e599-4f7c-9603-5729fa6f914f service nova] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:57:05.404991 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c036b259-e599-4f7c-9603-5729fa6f914f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:57:05.406685 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-c036b259-e599-4f7c-9603-5729fa6f914f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:57:05.457701 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:57:05.510057 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c036b259-e599-4f7c-9603-5729fa6f914f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:57:05.511610 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c036b259-e599-4f7c-9603-5729fa6f914f service nova] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:57:05.530068 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 706/1428] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 09:57:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 09:57:06.342547 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14408947-4306-461d-90ae-b427cf8e3ba2 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:57:06.343168 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14408947-4306-461d-90ae-b427cf8e3ba2 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:57:06.343168 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14408947-4306-461d-90ae-b427cf8e3ba2 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:57:06.348028 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 723/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 10 09:57:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:57:06.354057 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab8cb6a-d57f-450e-b9d6-005b166049fb None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:57:06.354829 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab8cb6a-d57f-450e-b9d6-005b166049fb None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:57:06.355029 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab8cb6a-d57f-450e-b9d6-005b166049fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:57:06.440403 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-0ab8cb6a-d57f-450e-b9d6-005b166049fb None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:57:06.441707 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-0ab8cb6a-d57f-450e-b9d6-005b166049fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:57:06.548518 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 707/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 10 09:57:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 09:57:06.701183 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14408947-4306-461d-90ae-b427cf8e3ba2 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:57:06.702737 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-14408947-4306-461d-90ae-b427cf8e3ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:57:06.756091 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:57:06.858324 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14408947-4306-461d-90ae-b427cf8e3ba2 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:57:06.982166 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a626396c-b584-4fe9-b0d2-4439894687ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd8580888cba41a88566da4540b1130c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:57:06.982784 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a626396c-b584-4fe9-b0d2-4439894687ea service nova] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:57:06.983060 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a626396c-b584-4fe9-b0d2-4439894687ea service nova] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:57:06.983322 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a626396c-b584-4fe9-b0d2-4439894687ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:57:06.984971 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-a626396c-b584-4fe9-b0d2-4439894687ea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:57:06.992366 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:57:07.080449 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a626396c-b584-4fe9-b0d2-4439894687ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:57:07.082064 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a626396c-b584-4fe9-b0d2-4439894687ea service nova] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:57:07.100461 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 724/1431] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 09:57:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 09:57:07.891234 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885308e0-2aed-4780-b3df-d72930dd80aa None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:57:07.891875 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885308e0-2aed-4780-b3df-d72930dd80aa None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:57:07.891875 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885308e0-2aed-4780-b3df-d72930dd80aa None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:57:07.893118 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 708/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 10 09:57:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:57:07.898344 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079da758-eb03-4a1c-bfea-97d9b3ceb99b None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:57:07.898856 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079da758-eb03-4a1c-bfea-97d9b3ceb99b None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:57:07.898970 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079da758-eb03-4a1c-bfea-97d9b3ceb99b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:57:07.977420 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-079da758-eb03-4a1c-bfea-97d9b3ceb99b None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:57:07.978625 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-079da758-eb03-4a1c-bfea-97d9b3ceb99b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:57:08.050919 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:57:08.082440 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 725/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 10 09:57:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 09:57:08.231527 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885308e0-2aed-4780-b3df-d72930dd80aa None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:57:08.233763 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-885308e0-2aed-4780-b3df-d72930dd80aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:57:08.260743 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:57:08.403716 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885308e0-2aed-4780-b3df-d72930dd80aa None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:57:08.501751 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:57:08.528405 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4752c25b-4ea9-40e9-a2a6-844cad1d736b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd8580888cba41a88566da4540b1130c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:57:08.529003 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4752c25b-4ea9-40e9-a2a6-844cad1d736b service nova] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:57:08.529317 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4752c25b-4ea9-40e9-a2a6-844cad1d736b service nova] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:57:08.529586 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4752c25b-4ea9-40e9-a2a6-844cad1d736b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:57:08.531195 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-4752c25b-4ea9-40e9-a2a6-844cad1d736b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:57:08.623111 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4752c25b-4ea9-40e9-a2a6-844cad1d736b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:57:08.624717 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4752c25b-4ea9-40e9-a2a6-844cad1d736b service nova] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:57:08.642936 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 709/1434] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 09:57:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 09:57:09.450413 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4369b06-66ec-4384-8977-925e378a5ccb None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:57:09.451012 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4369b06-66ec-4384-8977-925e378a5ccb None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:57:09.451012 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4369b06-66ec-4384-8977-925e378a5ccb None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:57:09.452237 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 726/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 10 09:57:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:57:09.458318 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f3949-988e-4429-ac4a-987f70903a9a None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:57:09.459083 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f3949-988e-4429-ac4a-987f70903a9a None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:57:09.459230 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f3949-988e-4429-ac4a-987f70903a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:57:09.539181 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-2d4f3949-988e-4429-ac4a-987f70903a9a None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:57:09.540410 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-2d4f3949-988e-4429-ac4a-987f70903a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:57:09.587007 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:57:09.646854 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 710/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 10 09:57:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 09:57:09.810534 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4369b06-66ec-4384-8977-925e378a5ccb None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:57:09.812386 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-e4369b06-66ec-4384-8977-925e378a5ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:57:09.964558 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4369b06-66ec-4384-8977-925e378a5ccb None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:57:10.044745 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:57:10.107443 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fa3cb5-b3d8-4abd-a1ec-3a2550832e61 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd8580888cba41a88566da4540b1130c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:57:10.107965 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fa3cb5-b3d8-4abd-a1ec-3a2550832e61 service nova] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:57:10.108252 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fa3cb5-b3d8-4abd-a1ec-3a2550832e61 service nova] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:57:10.108512 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fa3cb5-b3d8-4abd-a1ec-3a2550832e61 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:57:10.110157 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-15fa3cb5-b3d8-4abd-a1ec-3a2550832e61 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:57:10.207740 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fa3cb5-b3d8-4abd-a1ec-3a2550832e61 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:57:10.209367 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fa3cb5-b3d8-4abd-a1ec-3a2550832e61 service nova] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:57:10.228951 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 727/1437] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 09:57:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 09:57:11.027793 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66599cc-1f82-48cd-9aa3-694f2db541fc None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:57:11.028417 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66599cc-1f82-48cd-9aa3-694f2db541fc None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:57:11.028417 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66599cc-1f82-48cd-9aa3-694f2db541fc None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:57:11.029722 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 711/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 10 09:57:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:57:11.036104 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bf0112-1887-4ec3-90a6-a0d61d82c848 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:57:11.036884 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bf0112-1887-4ec3-90a6-a0d61d82c848 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:57:11.037035 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bf0112-1887-4ec3-90a6-a0d61d82c848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:57:11.121024 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-51bf0112-1887-4ec3-90a6-a0d61d82c848 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:57:11.122287 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-51bf0112-1887-4ec3-90a6-a0d61d82c848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:57:11.124578 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:57:11.227337 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 728/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 10 09:57:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 09:57:11.390494 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66599cc-1f82-48cd-9aa3-694f2db541fc None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:57:11.393488 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-f66599cc-1f82-48cd-9aa3-694f2db541fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:57:11.558504 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66599cc-1f82-48cd-9aa3-694f2db541fc None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:57:11.593841 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:57:11.685653 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4ec01b-e663-4360-810e-198983fcfc18 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd8580888cba41a88566da4540b1130c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:57:11.686274 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4ec01b-e663-4360-810e-198983fcfc18 service nova] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:57:11.686894 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4ec01b-e663-4360-810e-198983fcfc18 service nova] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:57:11.687165 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4ec01b-e663-4360-810e-198983fcfc18 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:57:11.688783 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-8b4ec01b-e663-4360-810e-198983fcfc18 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:57:11.791971 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4ec01b-e663-4360-810e-198983fcfc18 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:57:11.793626 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4ec01b-e663-4360-810e-198983fcfc18 service nova] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:57:11.813189 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 712/1440] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 09:57:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 09:57:13.697549 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269f704d-06d4-4440-84ba-d821f5f0ff1a None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:57:13.697955 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269f704d-06d4-4440-84ba-d821f5f0ff1a None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:57:13.698061 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269f704d-06d4-4440-84ba-d821f5f0ff1a None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:57:13.699437 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 729/1441] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 09:57:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:57:13.705059 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00ebed5-9bd0-4766-91dc-5a6699b8c6a5 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:57:13.705561 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00ebed5-9bd0-4766-91dc-5a6699b8c6a5 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:57:13.705670 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00ebed5-9bd0-4766-91dc-5a6699b8c6a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:57:13.747665 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:57:13.775225 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-c00ebed5-9bd0-4766-91dc-5a6699b8c6a5 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:57:13.776460 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-c00ebed5-9bd0-4766-91dc-5a6699b8c6a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:57:13.875785 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 713/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 09:57:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 09:57:13.918929 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269f704d-06d4-4440-84ba-d821f5f0ff1a None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:57:13.921467 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-269f704d-06d4-4440-84ba-d821f5f0ff1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:57:14.035369 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269f704d-06d4-4440-84ba-d821f5f0ff1a None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:57:14.067882 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:57:14.109921 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4ee34b-829f-4444-b156-6e1140ef69ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4294c170df354fe892831281acd4ea7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:57:14.110522 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4ee34b-829f-4444-b156-6e1140ef69ef service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:57:14.110800 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4ee34b-829f-4444-b156-6e1140ef69ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:57:14.111067 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4ee34b-829f-4444-b156-6e1140ef69ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:57:14.112635 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-fd4ee34b-829f-4444-b156-6e1140ef69ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:57:14.222723 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4ee34b-829f-4444-b156-6e1140ef69ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:57:14.224171 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4ee34b-829f-4444-b156-6e1140ef69ef service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:57:14.242239 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 730/1443] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 09:57:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 09:57:16.371839 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a1e839-02a0-4823-bdfb-f26ff502cf38 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:57:16.372451 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a1e839-02a0-4823-bdfb-f26ff502cf38 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:57:16.372451 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a1e839-02a0-4823-bdfb-f26ff502cf38 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:57:16.373752 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 714/1444] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 09:57:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:57:16.380089 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12d1447-4506-4ada-b370-e15175d3b340 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:57:16.380811 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12d1447-4506-4ada-b370-e15175d3b340 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:57:16.381116 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12d1447-4506-4ada-b370-e15175d3b340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:57:16.452723 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-e12d1447-4506-4ada-b370-e15175d3b340 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:57:16.453974 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-e12d1447-4506-4ada-b370-e15175d3b340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:57:16.467341 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:57:16.563957 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 731/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 09:57:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 09:57:16.604127 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a1e839-02a0-4823-bdfb-f26ff502cf38 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:57:16.605707 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-34a1e839-02a0-4823-bdfb-f26ff502cf38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:57:16.724327 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a1e839-02a0-4823-bdfb-f26ff502cf38 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:57:16.736763 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:57:16.800753 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e22dc46-b259-4cf2-ad90-ab67fe99a645 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4294c170df354fe892831281acd4ea7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:57:16.801374 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e22dc46-b259-4cf2-ad90-ab67fe99a645 service neutron] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:57:16.801659 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e22dc46-b259-4cf2-ad90-ab67fe99a645 service neutron] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:57:16.801922 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e22dc46-b259-4cf2-ad90-ab67fe99a645 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:57:16.803518 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-2e22dc46-b259-4cf2-ad90-ab67fe99a645 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:57:16.926259 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e22dc46-b259-4cf2-ad90-ab67fe99a645 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:57:16.927663 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e22dc46-b259-4cf2-ad90-ab67fe99a645 service neutron] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:57:16.946859 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 715/1446] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 09:57:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 09:57:19.265964 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b47ad5c-f478-4f8a-9d9c-9c0452f90c19 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:57:19.266571 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b47ad5c-f478-4f8a-9d9c-9c0452f90c19 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:57:19.266571 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b47ad5c-f478-4f8a-9d9c-9c0452f90c19 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:57:19.267870 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 732/1447] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 09:57:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:57:19.273409 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d8fefc-6814-488f-956c-ef32139c1b58 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:57:19.273890 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d8fefc-6814-488f-956c-ef32139c1b58 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:57:19.274018 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d8fefc-6814-488f-956c-ef32139c1b58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:57:19.324587 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:57:19.343086 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-80d8fefc-6814-488f-956c-ef32139c1b58 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:57:19.344309 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-80d8fefc-6814-488f-956c-ef32139c1b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:57:19.446975 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 716/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 09:57:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 09:57:19.489955 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b47ad5c-f478-4f8a-9d9c-9c0452f90c19 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:57:19.492352 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-3b47ad5c-f478-4f8a-9d9c-9c0452f90c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:57:19.611880 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b47ad5c-f478-4f8a-9d9c-9c0452f90c19 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:57:19.664669 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:57:19.703708 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d701b757-08f0-44a0-87e6-ee07825e9b12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4294c170df354fe892831281acd4ea7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:57:19.704243 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d701b757-08f0-44a0-87e6-ee07825e9b12 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:57:19.704514 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d701b757-08f0-44a0-87e6-ee07825e9b12 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:57:19.704778 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d701b757-08f0-44a0-87e6-ee07825e9b12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:57:19.706533 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-d701b757-08f0-44a0-87e6-ee07825e9b12 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:57:19.819431 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d701b757-08f0-44a0-87e6-ee07825e9b12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:57:19.820896 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d701b757-08f0-44a0-87e6-ee07825e9b12 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:57:19.838944 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 733/1449] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 09:57:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 09:57:21.953992 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce2cc48-cb61-498f-b7b3-3287fd624410 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:57:21.954568 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce2cc48-cb61-498f-b7b3-3287fd624410 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:57:21.954568 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce2cc48-cb61-498f-b7b3-3287fd624410 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:57:21.955881 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 717/1450] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 09:57:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:57:21.963509 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0fdf70-96cb-4fac-b6a5-edabe15744b0 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:57:21.964234 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0fdf70-96cb-4fac-b6a5-edabe15744b0 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:57:21.964524 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0fdf70-96cb-4fac-b6a5-edabe15744b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:57:22.041853 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-2a0fdf70-96cb-4fac-b6a5-edabe15744b0 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:57:22.043089 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-2a0fdf70-96cb-4fac-b6a5-edabe15744b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:57:22.064758 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:57:22.143244 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 734/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 09:57:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 09:57:22.183325 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce2cc48-cb61-498f-b7b3-3287fd624410 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:57:22.185460 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-8ce2cc48-cb61-498f-b7b3-3287fd624410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:57:22.312948 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce2cc48-cb61-498f-b7b3-3287fd624410 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:57:22.335142 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:57:22.395496 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590bd3dd-bbd9-411e-bb24-d98e2e79f344 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4294c170df354fe892831281acd4ea7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:57:22.396103 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590bd3dd-bbd9-411e-bb24-d98e2e79f344 service neutron] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:57:22.396380 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590bd3dd-bbd9-411e-bb24-d98e2e79f344 service neutron] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:57:22.396649 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590bd3dd-bbd9-411e-bb24-d98e2e79f344 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:57:22.398312 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-590bd3dd-bbd9-411e-bb24-d98e2e79f344 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:57:22.511643 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590bd3dd-bbd9-411e-bb24-d98e2e79f344 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:57:22.513100 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590bd3dd-bbd9-411e-bb24-d98e2e79f344 service neutron] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:57:22.531610 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 718/1452] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 09:57:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 09:57:24.573091 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650a861f-4c5d-47bd-b1a2-2f8ab9c560ad None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:57:24.573730 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650a861f-4c5d-47bd-b1a2-2f8ab9c560ad None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:57:24.573730 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650a861f-4c5d-47bd-b1a2-2f8ab9c560ad None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:57:24.575772 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 735/1453] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 09:57:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:57:24.581059 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f40a3a-c168-4ac8-8bfd-e3a926c79cf4 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:57:24.581535 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f40a3a-c168-4ac8-8bfd-e3a926c79cf4 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:57:24.581643 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f40a3a-c168-4ac8-8bfd-e3a926c79cf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:57:24.647049 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:57:24.650178 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-60f40a3a-c168-4ac8-8bfd-e3a926c79cf4 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:57:24.652021 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-60f40a3a-c168-4ac8-8bfd-e3a926c79cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:57:24.756977 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 719/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 09:57:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 09:57:24.795668 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650a861f-4c5d-47bd-b1a2-2f8ab9c560ad None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:57:24.798248 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-650a861f-4c5d-47bd-b1a2-2f8ab9c560ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:57:24.913744 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650a861f-4c5d-47bd-b1a2-2f8ab9c560ad None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:57:24.965913 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:57:24.994583 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb49e710-c61d-47f8-bd7f-86ba805bf332 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4294c170df354fe892831281acd4ea7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:57:24.995185 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb49e710-c61d-47f8-bd7f-86ba805bf332 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:57:24.995463 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb49e710-c61d-47f8-bd7f-86ba805bf332 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:57:24.995734 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb49e710-c61d-47f8-bd7f-86ba805bf332 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:57:24.997379 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-eb49e710-c61d-47f8-bd7f-86ba805bf332 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:57:25.113218 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb49e710-c61d-47f8-bd7f-86ba805bf332 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:57:25.114672 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb49e710-c61d-47f8-bd7f-86ba805bf332 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:57:25.136158 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 736/1455] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 09:57:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 09:57:27.188241 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f358bec-f724-42c4-99c3-772ed7ea209f None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:57:27.189105 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f358bec-f724-42c4-99c3-772ed7ea209f None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:57:27.189229 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f358bec-f724-42c4-99c3-772ed7ea209f None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:57:27.191406 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 720/1456] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 09:57:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:57:27.198602 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22b1dbd-982d-4c50-9bee-9adbf05f6719 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:57:27.199093 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22b1dbd-982d-4c50-9bee-9adbf05f6719 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:57:27.199199 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22b1dbd-982d-4c50-9bee-9adbf05f6719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:57:27.273555 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-d22b1dbd-982d-4c50-9bee-9adbf05f6719 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:57:27.274751 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-d22b1dbd-982d-4c50-9bee-9adbf05f6719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:57:27.304081 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:57:27.389611 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 737/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 09:57:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 09:57:27.430647 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f358bec-f724-42c4-99c3-772ed7ea209f None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:57:27.432194 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-1f358bec-f724-42c4-99c3-772ed7ea209f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:57:27.541618 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f358bec-f724-42c4-99c3-772ed7ea209f None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:57:27.571531 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:57:27.617132 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72798f39-f4e7-4daa-8b3a-edae3ac1ada7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4294c170df354fe892831281acd4ea7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:57:27.617760 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72798f39-f4e7-4daa-8b3a-edae3ac1ada7 service neutron] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:57:27.618046 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72798f39-f4e7-4daa-8b3a-edae3ac1ada7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:57:27.618317 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72798f39-f4e7-4daa-8b3a-edae3ac1ada7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:57:27.619923 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-72798f39-f4e7-4daa-8b3a-edae3ac1ada7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:57:27.740063 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72798f39-f4e7-4daa-8b3a-edae3ac1ada7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:57:27.741564 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72798f39-f4e7-4daa-8b3a-edae3ac1ada7 service neutron] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:57:27.760954 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 721/1458] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 09:57:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 09:57:29.795413 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441a9661-1aa7-44aa-b163-c50869de4aaf None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:57:29.796015 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441a9661-1aa7-44aa-b163-c50869de4aaf None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:57:29.796015 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441a9661-1aa7-44aa-b163-c50869de4aaf None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:57:29.797351 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 738/1459] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 09:57:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 09:57:29.802917 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f909bfb0-e061-4239-8c93-e4190500c480 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:57:29.803373 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f909bfb0-e061-4239-8c93-e4190500c480 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:57:29.803465 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f909bfb0-e061-4239-8c93-e4190500c480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:57:29.871587 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-f909bfb0-e061-4239-8c93-e4190500c480 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:57:29.872808 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-f909bfb0-e061-4239-8c93-e4190500c480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:57:29.881091 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:57:29.973138 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 722/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 09:57:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 09:57:30.012823 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441a9661-1aa7-44aa-b163-c50869de4aaf None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:57:30.015211 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-441a9661-1aa7-44aa-b163-c50869de4aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:57:30.128172 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441a9661-1aa7-44aa-b163-c50869de4aaf None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:57:30.183819 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:57:30.203340 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bd1e92-b437-4ed4-9e94-a3ba17ece776 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4294c170df354fe892831281acd4ea7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:57:30.203939 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bd1e92-b437-4ed4-9e94-a3ba17ece776 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:57:30.204219 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bd1e92-b437-4ed4-9e94-a3ba17ece776 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:57:30.204487 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bd1e92-b437-4ed4-9e94-a3ba17ece776 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:57:30.206213 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-55bd1e92-b437-4ed4-9e94-a3ba17ece776 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:57:30.336084 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bd1e92-b437-4ed4-9e94-a3ba17ece776 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:57:30.337494 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bd1e92-b437-4ed4-9e94-a3ba17ece776 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:57:30.356562 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 739/1461] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 09:57:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 09:57:32.392581 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7bdbb0-58b6-4cf4-89e0-51d88cae066d None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:57:32.393226 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7bdbb0-58b6-4cf4-89e0-51d88cae066d None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:57:32.393226 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7bdbb0-58b6-4cf4-89e0-51d88cae066d None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:57:32.395144 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 723/1462] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 09:57:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:57:32.400644 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4102783-f92a-450c-bdd4-d6fa6cd29e41 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:57:32.401107 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4102783-f92a-450c-bdd4-d6fa6cd29e41 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:57:32.401226 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4102783-f92a-450c-bdd4-d6fa6cd29e41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:57:32.473277 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-b4102783-f92a-450c-bdd4-d6fa6cd29e41 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:57:32.474495 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-b4102783-f92a-450c-bdd4-d6fa6cd29e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:57:32.514549 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:57:32.580913 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 740/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 09:57:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 09:57:32.620119 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7bdbb0-58b6-4cf4-89e0-51d88cae066d None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:57:32.621741 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-0b7bdbb0-58b6-4cf4-89e0-51d88cae066d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:57:32.730672 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7bdbb0-58b6-4cf4-89e0-51d88cae066d None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:57:32.769570 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:57:32.806850 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cbf218-0fb9-4b76-8145-db40957da928 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4294c170df354fe892831281acd4ea7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:57:32.807454 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cbf218-0fb9-4b76-8145-db40957da928 service neutron] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:57:32.807730 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cbf218-0fb9-4b76-8145-db40957da928 service neutron] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:57:32.808008 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cbf218-0fb9-4b76-8145-db40957da928 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:57:32.809654 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-41cbf218-0fb9-4b76-8145-db40957da928 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:57:32.928882 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cbf218-0fb9-4b76-8145-db40957da928 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:57:32.930366 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cbf218-0fb9-4b76-8145-db40957da928 service neutron] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:57:32.950611 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 724/1464] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 09:57:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 09:57:34.964139 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572bcda1-4869-40c5-98d2-400f63910042 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:57:34.964740 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572bcda1-4869-40c5-98d2-400f63910042 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:57:34.964740 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572bcda1-4869-40c5-98d2-400f63910042 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:57:34.966081 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 741/1465] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 09:57:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:57:34.972628 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d7c1d-a1c4-4188-ab24-5e801a19aad8 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:57:34.973419 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d7c1d-a1c4-4188-ab24-5e801a19aad8 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:57:34.973572 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d7c1d-a1c4-4188-ab24-5e801a19aad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:57:35.048785 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-c31d7c1d-a1c4-4188-ab24-5e801a19aad8 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:57:35.050027 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-c31d7c1d-a1c4-4188-ab24-5e801a19aad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:57:35.075494 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:57:35.167079 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 725/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 09:57:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 09:57:35.209355 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572bcda1-4869-40c5-98d2-400f63910042 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:57:35.211842 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-572bcda1-4869-40c5-98d2-400f63910042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:57:35.323858 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572bcda1-4869-40c5-98d2-400f63910042 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:57:35.392277 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:57:35.400793 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c434b426-01d1-414a-a3f1-a581eadf93ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4294c170df354fe892831281acd4ea7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:57:35.401467 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c434b426-01d1-414a-a3f1-a581eadf93ba service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:57:35.401742 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c434b426-01d1-414a-a3f1-a581eadf93ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:57:35.402008 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c434b426-01d1-414a-a3f1-a581eadf93ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:57:35.403596 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-c434b426-01d1-414a-a3f1-a581eadf93ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:57:35.515448 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c434b426-01d1-414a-a3f1-a581eadf93ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:57:35.516880 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c434b426-01d1-414a-a3f1-a581eadf93ba service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:57:35.535258 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 742/1467] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 09:57:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 09:57:37.539826 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1582a0-d2ba-42f2-8e8e-0a9b68a17069 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:57:37.540447 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1582a0-d2ba-42f2-8e8e-0a9b68a17069 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:57:37.540447 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1582a0-d2ba-42f2-8e8e-0a9b68a17069 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:57:37.541853 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 726/1468] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 09:57:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:57:37.547394 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356e15a3-572f-4cd3-815a-1a3c167349b6 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:57:37.547856 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356e15a3-572f-4cd3-815a-1a3c167349b6 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:57:37.547962 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356e15a3-572f-4cd3-815a-1a3c167349b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:57:37.618879 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-356e15a3-572f-4cd3-815a-1a3c167349b6 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:57:37.620096 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-356e15a3-572f-4cd3-815a-1a3c167349b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:57:37.672239 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:57:37.723176 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 743/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 09:57:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 09:57:37.761114 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1582a0-d2ba-42f2-8e8e-0a9b68a17069 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:57:37.763512 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-7c1582a0-d2ba-42f2-8e8e-0a9b68a17069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:57:37.881959 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1582a0-d2ba-42f2-8e8e-0a9b68a17069 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:57:37.938646 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:57:37.966923 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb8753d-74f1-4a85-8fad-dc4e6d1a267f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4294c170df354fe892831281acd4ea7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:57:37.967529 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb8753d-74f1-4a85-8fad-dc4e6d1a267f service neutron] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:57:37.967807 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb8753d-74f1-4a85-8fad-dc4e6d1a267f service neutron] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:57:37.968079 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb8753d-74f1-4a85-8fad-dc4e6d1a267f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:57:37.969727 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-0bb8753d-74f1-4a85-8fad-dc4e6d1a267f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:57:38.081769 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb8753d-74f1-4a85-8fad-dc4e6d1a267f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:57:38.083134 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb8753d-74f1-4a85-8fad-dc4e6d1a267f service neutron] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:57:38.102362 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 727/1470] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 09:57:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 09:57:47.721468 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=22 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:57:48.099356 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=66 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:57:57.490548 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9bba39-e5f8-4c74-a543-7de347cd559d None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:57:57.491153 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9bba39-e5f8-4c74-a543-7de347cd559d None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:57:57.491153 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9bba39-e5f8-4c74-a543-7de347cd559d None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:57:57.492473 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 744/1471] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:57:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:57:57.498737 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82d97a8-37e5-43cd-81f1-7c14c4ad19bb None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:57:57.499218 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82d97a8-37e5-43cd-81f1-7c14c4ad19bb None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:57:57.499335 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82d97a8-37e5-43cd-81f1-7c14c4ad19bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:57:57.579265 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-d82d97a8-37e5-43cd-81f1-7c14c4ad19bb None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:57:57.581257 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-d82d97a8-37e5-43cd-81f1-7c14c4ad19bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:57:57.689852 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 728/1472] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:57:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 09:57:57.776204 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d48f06-b721-47fb-8cd0-539b9af37a23 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:57:57.776488 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d48f06-b721-47fb-8cd0-539b9af37a23 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:57:57.776773 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d48f06-b721-47fb-8cd0-539b9af37a23 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:57:57.778152 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 745/1473] 10.222.0.27 () {54 vars in 967 bytes} [Wed Aug 10 09:57:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:57:57.783204 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a59e87-2543-4093-8be4-8190e0180935 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:57:57.783460 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a59e87-2543-4093-8be4-8190e0180935 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:57:57.783729 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a59e87-2543-4093-8be4-8190e0180935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:57:57.864253 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-95a59e87-2543-4093-8be4-8190e0180935 None None] MFA Rules not processed for user `f9e7f1ec6ad64b978f8817a5d2a73757`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:57:57.865494 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-95a59e87-2543-4093-8be4-8190e0180935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:57:57.885725 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:57:57.949952 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 729/1474] 10.222.0.27 () {58 vars in 1064 bytes} [Wed Aug 10 09:57:57 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 09:57:57.962091 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d48f06-b721-47fb-8cd0-539b9af37a23 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:57:57.963598 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-34d48f06-b721-47fb-8cd0-539b9af37a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:57:58.081444 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d48f06-b721-47fb-8cd0-539b9af37a23 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:57:58.163035 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bce0006-bddc-4dda-9706-4964f5509e0f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e7f1ec6ad64b978f8817a5d2a73757', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:57:58.163623 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bce0006-bddc-4dda-9706-4964f5509e0f service glance] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:57:58.163896 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bce0006-bddc-4dda-9706-4964f5509e0f service glance] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:57:58.164165 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bce0006-bddc-4dda-9706-4964f5509e0f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:57:58.165817 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-1bce0006-bddc-4dda-9706-4964f5509e0f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:57:58.220362 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:57:58.276728 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bce0006-bddc-4dda-9706-4964f5509e0f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:57:58.278192 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bce0006-bddc-4dda-9706-4964f5509e0f service glance] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:57:58.297085 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 746/1475] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 09:57:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 09:58:00.380486 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4e0322-79a5-41d7-88a6-89c05e26cec1 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:58:00.381056 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4e0322-79a5-41d7-88a6-89c05e26cec1 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:58:00.381056 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4e0322-79a5-41d7-88a6-89c05e26cec1 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:58:00.382445 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 730/1476] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:58:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:58:00.387840 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ef41d8-d5c8-4844-a104-9d58ebfde57f None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:58:00.388296 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ef41d8-d5c8-4844-a104-9d58ebfde57f None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:58:00.388399 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ef41d8-d5c8-4844-a104-9d58ebfde57f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:58:00.459548 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-94ef41d8-d5c8-4844-a104-9d58ebfde57f None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:58:00.460780 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-94ef41d8-d5c8-4844-a104-9d58ebfde57f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:58:00.559516 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 747/1477] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:58:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 09:58:00.583316 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4e0322-79a5-41d7-88a6-89c05e26cec1 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:58:00.584926 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-1a4e0322-79a5-41d7-88a6-89c05e26cec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:58:00.719622 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4e0322-79a5-41d7-88a6-89c05e26cec1 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:58:00.778563 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:58:00.824430 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011e12e6-0740-4dc9-9334-a353aceb4b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:58:00.825052 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e12e6-0740-4dc9-9334-a353aceb4b81 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:58:00.825352 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e12e6-0740-4dc9-9334-a353aceb4b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:58:00.825640 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e12e6-0740-4dc9-9334-a353aceb4b81 admin admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:58:00.826254 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011e12e6-0740-4dc9-9334-a353aceb4b81 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:58:00.827997 dv-cinder-850836-5-smb devstack@keystone.service[80232]: WARNING py.warnings [None req-011e12e6-0740-4dc9-9334-a353aceb4b81 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 09:58:00.827997 dv-cinder-850836-5-smb devstack@keystone.service[80232]: warnings.warn(msg) Aug 10 09:58:00.827997 dv-cinder-850836-5-smb devstack@keystone.service[80232]: Aug 10 09:58:00.829126 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011e12e6-0740-4dc9-9334-a353aceb4b81 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:58:00.847754 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 731/1478] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Aug 10 09:58:00 2022] GET /identity/v3/projects => generated 2553 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 09:58:02.855117 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b33f92f-2288-431c-8d49-da720ee2ea49 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:58:02.856035 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b33f92f-2288-431c-8d49-da720ee2ea49 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:58:02.856035 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b33f92f-2288-431c-8d49-da720ee2ea49 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:58:02.858163 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 748/1479] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:58:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:58:02.867024 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce49792a-c261-438f-8477-0065d40fd0d0 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:58:02.867785 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce49792a-c261-438f-8477-0065d40fd0d0 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:58:02.867959 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce49792a-c261-438f-8477-0065d40fd0d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:58:02.941449 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-ce49792a-c261-438f-8477-0065d40fd0d0 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:58:02.942591 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-ce49792a-c261-438f-8477-0065d40fd0d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:58:03.053105 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 732/1480] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:58:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 09:58:03.096677 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b33f92f-2288-431c-8d49-da720ee2ea49 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:58:03.098247 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-1b33f92f-2288-431c-8d49-da720ee2ea49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:58:03.108400 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:58:03.248292 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b33f92f-2288-431c-8d49-da720ee2ea49 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:58:03.330856 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:58:03.366195 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11601f8-c84b-4daa-b929-ebee322aee26 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd8580888cba41a88566da4540b1130c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:58:03.366785 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11601f8-c84b-4daa-b929-ebee322aee26 service nova] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:58:03.367075 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11601f8-c84b-4daa-b929-ebee322aee26 service nova] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:58:03.367407 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11601f8-c84b-4daa-b929-ebee322aee26 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:58:03.369019 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-d11601f8-c84b-4daa-b929-ebee322aee26 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:58:03.463282 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11601f8-c84b-4daa-b929-ebee322aee26 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:58:03.464895 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11601f8-c84b-4daa-b929-ebee322aee26 service nova] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:58:03.484234 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 749/1481] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 09:58:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 09:58:05.645099 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf9f61-da1f-4297-bebe-99af15585dfc None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:58:05.645714 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf9f61-da1f-4297-bebe-99af15585dfc None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:58:05.645714 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf9f61-da1f-4297-bebe-99af15585dfc None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:58:05.647010 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 733/1482] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:58:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:58:05.652453 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be63ffa6-81d7-4abc-ae11-3b3be41634d7 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:58:05.652902 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be63ffa6-81d7-4abc-ae11-3b3be41634d7 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:58:05.652995 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be63ffa6-81d7-4abc-ae11-3b3be41634d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:58:05.721684 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-be63ffa6-81d7-4abc-ae11-3b3be41634d7 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:58:05.722905 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-be63ffa6-81d7-4abc-ae11-3b3be41634d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:58:05.777357 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:58:05.829692 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 750/1483] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:58:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 09:58:05.874349 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabf9f61-da1f-4297-bebe-99af15585dfc None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:58:05.876139 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-eabf9f61-da1f-4297-bebe-99af15585dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:58:05.906250 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:58:06.012363 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabf9f61-da1f-4297-bebe-99af15585dfc None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:58:06.098444 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1dc66d-7a33-413c-8f98-ef790b03d329 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4294c170df354fe892831281acd4ea7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:58:06.099042 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1dc66d-7a33-413c-8f98-ef790b03d329 service neutron] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:58:06.099320 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1dc66d-7a33-413c-8f98-ef790b03d329 service neutron] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:58:06.099591 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1dc66d-7a33-413c-8f98-ef790b03d329 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:58:06.101232 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-cb1dc66d-7a33-413c-8f98-ef790b03d329 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:58:06.176122 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:58:06.210932 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1dc66d-7a33-413c-8f98-ef790b03d329 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:58:06.212440 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1dc66d-7a33-413c-8f98-ef790b03d329 service neutron] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:58:06.231432 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 734/1484] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 09:58:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 09:58:08.286265 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188df984-bbe1-4a0b-8b47-1c057e8c0d01 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:58:08.287147 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188df984-bbe1-4a0b-8b47-1c057e8c0d01 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:58:08.287147 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188df984-bbe1-4a0b-8b47-1c057e8c0d01 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:58:08.289446 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 751/1485] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:58:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:58:08.295583 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e945c1-e62b-4ca7-9cc1-ff4c0cc995e7 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:58:08.296372 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e945c1-e62b-4ca7-9cc1-ff4c0cc995e7 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:58:08.296372 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e945c1-e62b-4ca7-9cc1-ff4c0cc995e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:58:08.373273 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-01e945c1-e62b-4ca7-9cc1-ff4c0cc995e7 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:58:08.374493 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-01e945c1-e62b-4ca7-9cc1-ff4c0cc995e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:58:08.479286 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 735/1486] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:58:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 09:58:08.517763 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188df984-bbe1-4a0b-8b47-1c057e8c0d01 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:58:08.519292 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-188df984-bbe1-4a0b-8b47-1c057e8c0d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:58:08.629186 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188df984-bbe1-4a0b-8b47-1c057e8c0d01 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:58:08.703108 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:58:08.705329 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413334db-3cb9-4c9a-b3b0-6d1ce2e5b93f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4294c170df354fe892831281acd4ea7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:58:08.705951 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413334db-3cb9-4c9a-b3b0-6d1ce2e5b93f service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:58:08.706236 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413334db-3cb9-4c9a-b3b0-6d1ce2e5b93f service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:58:08.706518 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413334db-3cb9-4c9a-b3b0-6d1ce2e5b93f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:58:08.708698 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-413334db-3cb9-4c9a-b3b0-6d1ce2e5b93f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:58:08.827508 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413334db-3cb9-4c9a-b3b0-6d1ce2e5b93f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:58:08.828984 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413334db-3cb9-4c9a-b3b0-6d1ce2e5b93f service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:58:08.849963 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 752/1487] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 09:58:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 09:58:11.046215 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e17b0f-8d8e-41a8-b691-1bbd23c8223b None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:58:11.047143 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e17b0f-8d8e-41a8-b691-1bbd23c8223b None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:58:11.047143 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e17b0f-8d8e-41a8-b691-1bbd23c8223b None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:58:11.049273 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 736/1488] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:58:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:58:11.057114 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf2ea40-69d0-4f6b-837b-e9fa7d77c4bb None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:58:11.057575 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf2ea40-69d0-4f6b-837b-e9fa7d77c4bb None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:58:11.057680 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf2ea40-69d0-4f6b-837b-e9fa7d77c4bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:58:11.126731 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-ddf2ea40-69d0-4f6b-837b-e9fa7d77c4bb None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:58:11.127941 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-ddf2ea40-69d0-4f6b-837b-e9fa7d77c4bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:58:11.191241 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:58:11.236154 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 753/1489] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:58:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 09:58:11.276585 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e17b0f-8d8e-41a8-b691-1bbd23c8223b None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:58:11.278193 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-56e17b0f-8d8e-41a8-b691-1bbd23c8223b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:58:11.317139 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:58:11.387251 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e17b0f-8d8e-41a8-b691-1bbd23c8223b None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:58:11.470466 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b9e9e6-630b-4ba3-8b18-fbb46b2946ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4294c170df354fe892831281acd4ea7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:58:11.471077 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b9e9e6-630b-4ba3-8b18-fbb46b2946ed service neutron] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:58:11.471363 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b9e9e6-630b-4ba3-8b18-fbb46b2946ed service neutron] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:58:11.471630 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b9e9e6-630b-4ba3-8b18-fbb46b2946ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:58:11.473283 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-f8b9e9e6-630b-4ba3-8b18-fbb46b2946ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:58:11.565848 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:58:11.596906 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b9e9e6-630b-4ba3-8b18-fbb46b2946ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:58:11.598324 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b9e9e6-630b-4ba3-8b18-fbb46b2946ed service neutron] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:58:11.617430 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 737/1490] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 09:58:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 09:58:13.820814 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429ec600-82a7-42b9-b6cc-1eef0cbd874b None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:58:13.821484 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429ec600-82a7-42b9-b6cc-1eef0cbd874b None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:58:13.821484 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429ec600-82a7-42b9-b6cc-1eef0cbd874b None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:58:13.823392 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 754/1491] 10.222.0.27 () {54 vars in 927 bytes} [Wed Aug 10 09:58:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:58:13.828841 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e04d49-3888-4b60-9eb0-3ede81538411 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:58:13.829353 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e04d49-3888-4b60-9eb0-3ede81538411 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:58:13.829471 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e04d49-3888-4b60-9eb0-3ede81538411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:58:13.900390 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-a9e04d49-3888-4b60-9eb0-3ede81538411 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:58:13.901677 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-a9e04d49-3888-4b60-9eb0-3ede81538411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:58:14.003842 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 738/1492] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Aug 10 09:58:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 09:58:14.048074 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429ec600-82a7-42b9-b6cc-1eef0cbd874b None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:58:14.049667 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-429ec600-82a7-42b9-b6cc-1eef0cbd874b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:58:14.161989 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429ec600-82a7-42b9-b6cc-1eef0cbd874b None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:58:14.235432 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16acf33c-74b1-45e4-af60-1e7ddfdf3baf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4294c170df354fe892831281acd4ea7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:58:14.236029 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16acf33c-74b1-45e4-af60-1e7ddfdf3baf service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:58:14.236308 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16acf33c-74b1-45e4-af60-1e7ddfdf3baf service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:58:14.236578 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16acf33c-74b1-45e4-af60-1e7ddfdf3baf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:58:14.238216 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-16acf33c-74b1-45e4-af60-1e7ddfdf3baf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:58:14.247202 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:58:14.351057 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16acf33c-74b1-45e4-af60-1e7ddfdf3baf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:58:14.352522 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16acf33c-74b1-45e4-af60-1e7ddfdf3baf service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:58:14.370992 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 755/1493] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 09:58:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 09:58:24.001796 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=82 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:58:24.368632 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=50 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:59:31.441217 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773ea734-9753-4c72-aac4-65a57e7a6a7b None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:59:31.442285 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773ea734-9753-4c72-aac4-65a57e7a6a7b None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:59:31.442285 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773ea734-9753-4c72-aac4-65a57e7a6a7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:59:31.527593 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-773ea734-9753-4c72-aac4-65a57e7a6a7b None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:59:31.529503 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-773ea734-9753-4c72-aac4-65a57e7a6a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:59:31.631138 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 739/1494] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 09:59:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 09:59:31.644093 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ae129d-43bf-4206-8d08-b3e109d809b4 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:59:31.644618 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ae129d-43bf-4206-8d08-b3e109d809b4 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:59:31.644749 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ae129d-43bf-4206-8d08-b3e109d809b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:59:31.726181 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-39ae129d-43bf-4206-8d08-b3e109d809b4 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:59:31.728030 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-39ae129d-43bf-4206-8d08-b3e109d809b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:59:31.834534 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 756/1495] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 09:59:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 09:59:31.841102 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773ea734-9753-4c72-aac4-65a57e7a6a7b None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:59:31.842304 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-773ea734-9753-4c72-aac4-65a57e7a6a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:59:31.853812 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773ea734-9753-4c72-aac4-65a57e7a6a7b None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:59:31.922878 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:59:31.958973 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bacfc20-ea37-46ed-9b79-9070ad382687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:59:31.959571 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bacfc20-ea37-46ed-9b79-9070ad382687 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:59:31.959840 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bacfc20-ea37-46ed-9b79-9070ad382687 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:59:31.960105 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bacfc20-ea37-46ed-9b79-9070ad382687 admin admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:59:31.960751 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bacfc20-ea37-46ed-9b79-9070ad382687 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 09:59:31.961049 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bacfc20-ea37-46ed-9b79-9070ad382687 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:59:31.962137 dv-cinder-850836-5-smb devstack@keystone.service[80232]: WARNING py.warnings [None req-8bacfc20-ea37-46ed-9b79-9070ad382687 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 09:59:31.962137 dv-cinder-850836-5-smb devstack@keystone.service[80232]: warnings.warn(msg) Aug 10 09:59:31.962137 dv-cinder-850836-5-smb devstack@keystone.service[80232]: Aug 10 09:59:31.963020 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bacfc20-ea37-46ed-9b79-9070ad382687 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:59:31.974499 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 740/1496] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 10 09:59:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 09:59:31.983236 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ae129d-43bf-4206-8d08-b3e109d809b4 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:59:31.995590 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ae129d-43bf-4206-8d08-b3e109d809b4 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:59:32.063868 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:59:32.099050 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b0a73a-51a7-4664-bca7-801aebe5dacc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:59:32.099572 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b0a73a-51a7-4664-bca7-801aebe5dacc admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:59:32.099845 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b0a73a-51a7-4664-bca7-801aebe5dacc admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:59:32.100106 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b0a73a-51a7-4664-bca7-801aebe5dacc admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:59:32.100720 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b0a73a-51a7-4664-bca7-801aebe5dacc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:59:32.102545 dv-cinder-850836-5-smb devstack@keystone.service[80231]: WARNING py.warnings [None req-c5b0a73a-51a7-4664-bca7-801aebe5dacc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 09:59:32.102545 dv-cinder-850836-5-smb devstack@keystone.service[80231]: warnings.warn(msg) Aug 10 09:59:32.102545 dv-cinder-850836-5-smb devstack@keystone.service[80231]: Aug 10 09:59:32.103743 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b0a73a-51a7-4664-bca7-801aebe5dacc admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:59:32.162312 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 757/1497] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 10 09:59:31 2022] POST /identity/v3/projects => generated 379 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 09:59:32.167299 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bacfc20-ea37-46ed-9b79-9070ad382687 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:59:32.168978 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-8bacfc20-ea37-46ed-9b79-9070ad382687 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:59:32.204416 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bacfc20-ea37-46ed-9b79-9070ad382687 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:59:32.302408 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed8d42f-6ca7-434f-bd5d-9475be86d296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:59:32.302998 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed8d42f-6ca7-434f-bd5d-9475be86d296 admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:59:32.303278 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed8d42f-6ca7-434f-bd5d-9475be86d296 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:59:32.303544 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed8d42f-6ca7-434f-bd5d-9475be86d296 admin admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:59:32.304167 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed8d42f-6ca7-434f-bd5d-9475be86d296 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:59:32.305212 dv-cinder-850836-5-smb devstack@keystone.service[80232]: WARNING py.warnings [None req-2ed8d42f-6ca7-434f-bd5d-9475be86d296 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 09:59:32.305212 dv-cinder-850836-5-smb devstack@keystone.service[80232]: warnings.warn(msg) Aug 10 09:59:32.305212 dv-cinder-850836-5-smb devstack@keystone.service[80232]: Aug 10 09:59:32.306415 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed8d42f-6ca7-434f-bd5d-9475be86d296 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:59:32.352422 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 741/1498] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 10 09:59:32 2022] POST /identity/v3/users => generated 290 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 09:59:32.356715 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b0a73a-51a7-4664-bca7-801aebe5dacc admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:59:32.358258 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-c5b0a73a-51a7-4664-bca7-801aebe5dacc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:59:32.422292 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b0a73a-51a7-4664-bca7-801aebe5dacc admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:59:32.507781 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:59:32.520840 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61e7861-c82e-4cec-acd9-40c18ebabb9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:59:32.521808 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61e7861-c82e-4cec-acd9-40c18ebabb9c admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:59:32.522218 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61e7861-c82e-4cec-acd9-40c18ebabb9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:59:32.522579 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61e7861-c82e-4cec-acd9-40c18ebabb9c admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:59:32.523599 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61e7861-c82e-4cec-acd9-40c18ebabb9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:59:32.525228 dv-cinder-850836-5-smb devstack@keystone.service[80231]: WARNING py.warnings [None req-e61e7861-c82e-4cec-acd9-40c18ebabb9c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 09:59:32.525228 dv-cinder-850836-5-smb devstack@keystone.service[80231]: warnings.warn(msg) Aug 10 09:59:32.525228 dv-cinder-850836-5-smb devstack@keystone.service[80231]: Aug 10 09:59:32.526527 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61e7861-c82e-4cec-acd9-40c18ebabb9c admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:59:32.539912 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 758/1499] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 09:59:32 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 09:59:32.543983 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed8d42f-6ca7-434f-bd5d-9475be86d296 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:59:32.545537 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-2ed8d42f-6ca7-434f-bd5d-9475be86d296 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:59:32.557018 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed8d42f-6ca7-434f-bd5d-9475be86d296 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:59:32.584405 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:59:32.657367 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9b856f-a8d7-41eb-b1e5-bfda5b26a2f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:59:32.657894 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9b856f-a8d7-41eb-b1e5-bfda5b26a2f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:59:32.658173 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9b856f-a8d7-41eb-b1e5-bfda5b26a2f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:59:32.658441 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9b856f-a8d7-41eb-b1e5-bfda5b26a2f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:59:32.659091 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9b856f-a8d7-41eb-b1e5-bfda5b26a2f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:59:32.660117 dv-cinder-850836-5-smb devstack@keystone.service[80232]: WARNING py.warnings [None req-ec9b856f-a8d7-41eb-b1e5-bfda5b26a2f7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 09:59:32.660117 dv-cinder-850836-5-smb devstack@keystone.service[80232]: warnings.warn(msg) Aug 10 09:59:32.660117 dv-cinder-850836-5-smb devstack@keystone.service[80232]: Aug 10 09:59:32.661005 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9b856f-a8d7-41eb-b1e5-bfda5b26a2f7 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:59:32.673861 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 742/1500] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 09:59:32 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 09:59:32.679414 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61e7861-c82e-4cec-acd9-40c18ebabb9c admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:59:32.680401 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-e61e7861-c82e-4cec-acd9-40c18ebabb9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:59:32.716075 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61e7861-c82e-4cec-acd9-40c18ebabb9c admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:59:32.814894 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae308632-7e89-4521-a853-531f6178dc7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:59:32.815558 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae308632-7e89-4521-a853-531f6178dc7a admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:59:32.815835 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae308632-7e89-4521-a853-531f6178dc7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:59:32.816106 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae308632-7e89-4521-a853-531f6178dc7a admin admin] PATH_INFO: `/v3/projects/d4361b3950884307ab562f982334c2db/users/b22ab692fae24bc481887019d22e1d2a/roles/8daabcb6b7394e39b06a3453e33e32db` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:59:32.839419 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae308632-7e89-4521-a853-531f6178dc7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4361b3950884307ab562f982334c2db, user_id=b22ab692fae24bc481887019d22e1d2a, role_id=8daabcb6b7394e39b06a3453e33e32db)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:59:32.840435 dv-cinder-850836-5-smb devstack@keystone.service[80231]: WARNING py.warnings [None req-ae308632-7e89-4521-a853-531f6178dc7a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 09:59:32.840435 dv-cinder-850836-5-smb devstack@keystone.service[80231]: warnings.warn(msg) Aug 10 09:59:32.840435 dv-cinder-850836-5-smb devstack@keystone.service[80231]: Aug 10 09:59:32.842424 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae308632-7e89-4521-a853-531f6178dc7a admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:59:32.872822 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 759/1501] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 09:59:32 2022] PUT /identity/v3/projects/d4361b3950884307ab562f982334c2db/users/b22ab692fae24bc481887019d22e1d2a/roles/8daabcb6b7394e39b06a3453e33e32db => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 09:59:32.885320 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de62b6-3374-4c57-8f3f-bc5084bc0dd6 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:59:32.885607 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de62b6-3374-4c57-8f3f-bc5084bc0dd6 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:59:32.885876 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de62b6-3374-4c57-8f3f-bc5084bc0dd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:59:32.947448 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-47de62b6-3374-4c57-8f3f-bc5084bc0dd6 None None] MFA Rules not processed for user `b22ab692fae24bc481887019d22e1d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:59:32.949135 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-47de62b6-3374-4c57-8f3f-bc5084bc0dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:59:33.028527 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 743/1502] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 09:59:32 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 09:59:33.043344 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b95d3-5c96-4063-b0e3-696262d5e6d6 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:59:33.043637 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b95d3-5c96-4063-b0e3-696262d5e6d6 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:59:33.043930 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b95d3-5c96-4063-b0e3-696262d5e6d6 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:59:33.045355 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 760/1503] 10.222.0.27 () {54 vars in 964 bytes} [Wed Aug 10 09:59:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:59:33.051889 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9159ef8-e411-4f09-b82e-8bb4c58e087e None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:59:33.052157 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9159ef8-e411-4f09-b82e-8bb4c58e087e None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:59:33.052450 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9159ef8-e411-4f09-b82e-8bb4c58e087e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:59:33.084100 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:59:33.130556 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-e9159ef8-e411-4f09-b82e-8bb4c58e087e None None] MFA Rules not processed for user `bbf8e725cbe0403d943b136235eac057`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:59:33.131777 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-e9159ef8-e411-4f09-b82e-8bb4c58e087e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:59:33.208947 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 744/1504] 10.222.0.27 () {58 vars in 1061 bytes} [Wed Aug 10 09:59:33 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 09:59:33.216926 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1b95d3-5c96-4063-b0e3-696262d5e6d6 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:59:33.218466 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-2a1b95d3-5c96-4063-b0e3-696262d5e6d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:59:33.270872 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:59:33.325381 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1b95d3-5c96-4063-b0e3-696262d5e6d6 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:59:33.400940 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06291417-9644-4c75-bc13-19f666b299c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf8e725cbe0403d943b136235eac057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:59:33.401582 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06291417-9644-4c75-bc13-19f666b299c5 service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:59:33.401862 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06291417-9644-4c75-bc13-19f666b299c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:59:33.402128 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06291417-9644-4c75-bc13-19f666b299c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:59:33.403812 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-06291417-9644-4c75-bc13-19f666b299c5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:59:33.502673 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06291417-9644-4c75-bc13-19f666b299c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:59:33.504117 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06291417-9644-4c75-bc13-19f666b299c5 service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:59:33.507910 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:59:33.523497 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 761/1505] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 09:59:33 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 09:59:33.569609 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3213f47a-48d6-4248-98b6-c4c57331db17 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:59:33.570017 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3213f47a-48d6-4248-98b6-c4c57331db17 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:59:33.570151 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3213f47a-48d6-4248-98b6-c4c57331db17 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:59:33.571441 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 745/1506] 10.222.0.27 () {52 vars in 830 bytes} [Wed Aug 10 09:59:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 09:59:33.576158 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06291417-9644-4c75-bc13-19f666b299c5 service cinder] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:59:33.577472 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-06291417-9644-4c75-bc13-19f666b299c5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:59:33.693274 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06291417-9644-4c75-bc13-19f666b299c5 service cinder] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:59:33.792791 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14635c15-2137-4290-9ca1-c36afc98a2cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:59:33.793389 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14635c15-2137-4290-9ca1-c36afc98a2cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:59:33.793660 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14635c15-2137-4290-9ca1-c36afc98a2cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:59:33.793957 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14635c15-2137-4290-9ca1-c36afc98a2cb admin admin] PATH_INFO: `/v3/users/b22ab692fae24bc481887019d22e1d2a` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:59:33.806889 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14635c15-2137-4290-9ca1-c36afc98a2cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=b22ab692fae24bc481887019d22e1d2a)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:59:33.807936 dv-cinder-850836-5-smb devstack@keystone.service[80231]: WARNING py.warnings [None req-14635c15-2137-4290-9ca1-c36afc98a2cb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 09:59:33.807936 dv-cinder-850836-5-smb devstack@keystone.service[80231]: warnings.warn(msg) Aug 10 09:59:33.807936 dv-cinder-850836-5-smb devstack@keystone.service[80231]: Aug 10 09:59:33.810818 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14635c15-2137-4290-9ca1-c36afc98a2cb admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:59:33.820395 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:59:33.878146 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-14635c15-2137-4290-9ca1-c36afc98a2cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b22ab692fae24bc481887019d22e1d2a'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 09:59:33.890406 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-14635c15-2137-4290-9ca1-c36afc98a2cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b22ab692fae24bc481887019d22e1d2a'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 09:59:33.890973 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-14635c15-2137-4290-9ca1-c36afc98a2cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b22ab692fae24bc481887019d22e1d2a'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 09:59:33.891391 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-14635c15-2137-4290-9ca1-c36afc98a2cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b22ab692fae24bc481887019d22e1d2a'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 09:59:33.904721 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-14635c15-2137-4290-9ca1-c36afc98a2cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b22ab692fae24bc481887019d22e1d2a'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 09:59:33.934046 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 762/1507] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 10 09:59:33 2022] DELETE /identity/v3/users/b22ab692fae24bc481887019d22e1d2a => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 09:59:33.940486 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efed0f64-6686-40e3-85e5-7c06473dccb8 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:59:33.940772 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efed0f64-6686-40e3-85e5-7c06473dccb8 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:59:33.941047 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efed0f64-6686-40e3-85e5-7c06473dccb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:59:34.008574 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-efed0f64-6686-40e3-85e5-7c06473dccb8 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 09:59:34.009823 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-efed0f64-6686-40e3-85e5-7c06473dccb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:59:34.089465 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:59:34.102999 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 746/1508] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 09:59:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 09:59:34.113492 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14635c15-2137-4290-9ca1-c36afc98a2cb admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:59:34.114770 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-14635c15-2137-4290-9ca1-c36afc98a2cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:59:34.221624 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14635c15-2137-4290-9ca1-c36afc98a2cb admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:59:34.282217 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:59:34.308488 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a9accd-2f32-463d-96c2-beff3aeb6f75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4294c170df354fe892831281acd4ea7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:59:34.309247 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a9accd-2f32-463d-96c2-beff3aeb6f75 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:59:34.309532 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a9accd-2f32-463d-96c2-beff3aeb6f75 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:59:34.310168 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a9accd-2f32-463d-96c2-beff3aeb6f75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:59:34.311775 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-e6a9accd-2f32-463d-96c2-beff3aeb6f75 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:59:34.429798 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a9accd-2f32-463d-96c2-beff3aeb6f75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:59:34.431151 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a9accd-2f32-463d-96c2-beff3aeb6f75 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:59:34.450607 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 763/1509] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 09:59:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 09:59:34.861282 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efed0f64-6686-40e3-85e5-7c06473dccb8 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 09:59:34.862779 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-efed0f64-6686-40e3-85e5-7c06473dccb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 09:59:34.876998 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efed0f64-6686-40e3-85e5-7c06473dccb8 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 09:59:34.976302 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1522cd-d3ce-4c97-b3fd-49e58b8f2e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 09:59:34.976935 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1522cd-d3ce-4c97-b3fd-49e58b8f2e72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 09:59:34.977203 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1522cd-d3ce-4c97-b3fd-49e58b8f2e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 09:59:34.977503 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1522cd-d3ce-4c97-b3fd-49e58b8f2e72 admin admin] PATH_INFO: `/v3/projects/d4361b3950884307ab562f982334c2db` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 09:59:34.987544 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1522cd-d3ce-4c97-b3fd-49e58b8f2e72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4361b3950884307ab562f982334c2db)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 09:59:34.988578 dv-cinder-850836-5-smb devstack@keystone.service[80232]: WARNING py.warnings [None req-ac1522cd-d3ce-4c97-b3fd-49e58b8f2e72 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 09:59:34.988578 dv-cinder-850836-5-smb devstack@keystone.service[80232]: warnings.warn(msg) Aug 10 09:59:34.988578 dv-cinder-850836-5-smb devstack@keystone.service[80232]: Aug 10 09:59:34.989814 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1522cd-d3ce-4c97-b3fd-49e58b8f2e72 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 09:59:35.050243 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-ac1522cd-d3ce-4c97-b3fd-49e58b8f2e72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4361b3950884307ab562f982334c2db', 'request_id': 'req-ac1522cd-d3ce-4c97-b3fd-49e58b8f2e72'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 09:59:35.056485 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-ac1522cd-d3ce-4c97-b3fd-49e58b8f2e72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4361b3950884307ab562f982334c2db', 'request_id': 'req-ac1522cd-d3ce-4c97-b3fd-49e58b8f2e72'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 09:59:35.066459 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-ac1522cd-d3ce-4c97-b3fd-49e58b8f2e72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4361b3950884307ab562f982334c2db', 'request_id': 'req-ac1522cd-d3ce-4c97-b3fd-49e58b8f2e72'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 09:59:35.096971 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-ac1522cd-d3ce-4c97-b3fd-49e58b8f2e72 admin admin] The token cache is being invalidate because project d4361b3950884307ab562f982334c2db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 09:59:35.097290 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-ac1522cd-d3ce-4c97-b3fd-49e58b8f2e72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 09:59:35.097800 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-ac1522cd-d3ce-4c97-b3fd-49e58b8f2e72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 09:59:35.099123 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 747/1510] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 10 09:59:34 2022] DELETE /identity/v3/projects/d4361b3950884307ab562f982334c2db => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 09:59:44.447807 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=62 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 09:59:45.094670 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:01:10.657997 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4dc4b1-d5b1-4013-85e7-ec8e6e0e3f5b None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:01:10.658606 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4dc4b1-d5b1-4013-85e7-ec8e6e0e3f5b None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:01:10.658606 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4dc4b1-d5b1-4013-85e7-ec8e6e0e3f5b None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:01:10.659906 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 764/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 10 10:01:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:01:10.664865 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2404b67c-e9a8-4c13-ad36-3f1537a669c8 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:01:10.665376 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2404b67c-e9a8-4c13-ad36-3f1537a669c8 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:01:10.665502 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2404b67c-e9a8-4c13-ad36-3f1537a669c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:01:10.749103 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-2404b67c-e9a8-4c13-ad36-3f1537a669c8 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:01:10.750339 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-2404b67c-e9a8-4c13-ad36-3f1537a669c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:01:10.865958 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 748/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 10 10:01:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:01:11.024221 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4dc4b1-d5b1-4013-85e7-ec8e6e0e3f5b None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:01:11.028268 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-3f4dc4b1-d5b1-4013-85e7-ec8e6e0e3f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:01:11.157393 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4dc4b1-d5b1-4013-85e7-ec8e6e0e3f5b None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:01:11.163543 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efbb4a0-7fda-44a0-9a28-b72f041648c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd8580888cba41a88566da4540b1130c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:01:11.164138 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efbb4a0-7fda-44a0-9a28-b72f041648c2 service nova] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:01:11.164416 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efbb4a0-7fda-44a0-9a28-b72f041648c2 service nova] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:01:11.164686 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efbb4a0-7fda-44a0-9a28-b72f041648c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:01:11.173401 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efbb4a0-7fda-44a0-9a28-b72f041648c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:01:11.174981 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efbb4a0-7fda-44a0-9a28-b72f041648c2 service nova] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:01:11.184758 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 765/1513] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:01:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:01:12.008233 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dffa47f-2587-4eeb-ae2f-b9be32b27887 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:01:12.008233 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dffa47f-2587-4eeb-ae2f-b9be32b27887 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:01:12.008233 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dffa47f-2587-4eeb-ae2f-b9be32b27887 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:01:12.009609 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 749/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 10 10:01:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:01:12.015843 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c762d460-675d-429a-825b-f70ef8942ce3 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:01:12.016318 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c762d460-675d-429a-825b-f70ef8942ce3 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:01:12.016437 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c762d460-675d-429a-825b-f70ef8942ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:01:12.037753 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-c762d460-675d-429a-825b-f70ef8942ce3 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:01:12.038939 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-c762d460-675d-429a-825b-f70ef8942ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:01:12.047721 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 766/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 10 10:01:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:01:12.202075 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dffa47f-2587-4eeb-ae2f-b9be32b27887 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:01:12.218006 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dffa47f-2587-4eeb-ae2f-b9be32b27887 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:01:12.226993 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5684a8c2-2623-475c-9bf5-a69e9c9b4a2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd8580888cba41a88566da4540b1130c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:01:12.227905 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5684a8c2-2623-475c-9bf5-a69e9c9b4a2d service nova] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:01:12.228276 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5684a8c2-2623-475c-9bf5-a69e9c9b4a2d service nova] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:01:12.228647 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5684a8c2-2623-475c-9bf5-a69e9c9b4a2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:01:12.241274 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5684a8c2-2623-475c-9bf5-a69e9c9b4a2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:01:12.243253 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5684a8c2-2623-475c-9bf5-a69e9c9b4a2d service nova] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:01:12.254103 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 750/1516] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:01:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:01:12.273504 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b7555-50a0-4276-bb22-b404034532e9 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:01:12.273762 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b7555-50a0-4276-bb22-b404034532e9 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:01:12.274033 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b7555-50a0-4276-bb22-b404034532e9 None None] PATH_INFO: `/v3` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:01:12.275357 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 767/1517] 10.222.0.40 () {54 vars in 925 bytes} [Wed Aug 10 10:01:12 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:01:12.289985 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c829aaf1-1115-4991-808b-e3367f657dc3 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:01:12.290277 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c829aaf1-1115-4991-808b-e3367f657dc3 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:01:12.290682 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c829aaf1-1115-4991-808b-e3367f657dc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:01:12.360158 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-c829aaf1-1115-4991-808b-e3367f657dc3 None None] MFA Rules not processed for user `a6b658f1e27b4dfb96de71dc6a7e9496`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:01:12.361416 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-c829aaf1-1115-4991-808b-e3367f657dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:01:12.379660 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:01:12.437289 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 751/1518] 10.222.0.40 () {58 vars in 1015 bytes} [Wed Aug 10 10:01:12 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:01:21.846621 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149f1714-0148-4e1f-9e6a-de33bd9ba4e4 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:01:21.847190 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149f1714-0148-4e1f-9e6a-de33bd9ba4e4 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:01:21.847190 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149f1714-0148-4e1f-9e6a-de33bd9ba4e4 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:01:21.849056 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 768/1519] 10.222.0.27 () {54 vars in 961 bytes} [Wed Aug 10 10:01:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:01:21.856998 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f317c5-e1f8-4481-98cc-0a5cb67cf26f None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:01:21.857748 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f317c5-e1f8-4481-98cc-0a5cb67cf26f None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:01:21.857859 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f317c5-e1f8-4481-98cc-0a5cb67cf26f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:01:21.883041 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-57f317c5-e1f8-4481-98cc-0a5cb67cf26f None None] MFA Rules not processed for user `a6b658f1e27b4dfb96de71dc6a7e9496`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:01:21.884252 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-57f317c5-e1f8-4481-98cc-0a5cb67cf26f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:01:21.894445 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 752/1520] 10.222.0.27 () {58 vars in 1058 bytes} [Wed Aug 10 10:01:21 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:01:21.902002 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149f1714-0148-4e1f-9e6a-de33bd9ba4e4 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:01:21.916828 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149f1714-0148-4e1f-9e6a-de33bd9ba4e4 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:01:21.922571 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bce956-a598-43b8-b5a2-a3b24c2cc607 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6b658f1e27b4dfb96de71dc6a7e9496', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:01:21.923152 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bce956-a598-43b8-b5a2-a3b24c2cc607 service placement] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:01:21.923428 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bce956-a598-43b8-b5a2-a3b24c2cc607 service placement] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:01:21.923695 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bce956-a598-43b8-b5a2-a3b24c2cc607 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:01:21.932111 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bce956-a598-43b8-b5a2-a3b24c2cc607 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:01:21.934131 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bce956-a598-43b8-b5a2-a3b24c2cc607 service placement] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:01:21.943724 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 769/1521] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:01:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:01:23.489951 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d3ee0e-0917-4b83-aa07-158e91eb0dbe None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:01:23.490573 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d3ee0e-0917-4b83-aa07-158e91eb0dbe None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:01:23.490573 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d3ee0e-0917-4b83-aa07-158e91eb0dbe None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:01:23.491830 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 753/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 10 10:01:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:01:23.497917 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4b48ed-e9fd-4391-b8e4-183220d2efb0 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:01:23.498400 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4b48ed-e9fd-4391-b8e4-183220d2efb0 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:01:23.498497 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4b48ed-e9fd-4391-b8e4-183220d2efb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:01:23.518238 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-1d4b48ed-e9fd-4391-b8e4-183220d2efb0 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:01:23.519434 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-1d4b48ed-e9fd-4391-b8e4-183220d2efb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:01:23.528799 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 770/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 10 10:01:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:01:23.694566 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d3ee0e-0917-4b83-aa07-158e91eb0dbe None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:01:23.710509 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d3ee0e-0917-4b83-aa07-158e91eb0dbe None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:01:23.716893 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba8eda9-b605-42ff-8a50-63f2ada02c51 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd8580888cba41a88566da4540b1130c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:01:23.717525 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba8eda9-b605-42ff-8a50-63f2ada02c51 service nova] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:01:23.717803 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba8eda9-b605-42ff-8a50-63f2ada02c51 service nova] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:01:23.718061 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba8eda9-b605-42ff-8a50-63f2ada02c51 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:01:23.726473 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba8eda9-b605-42ff-8a50-63f2ada02c51 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:01:23.728062 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba8eda9-b605-42ff-8a50-63f2ada02c51 service nova] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:01:23.737748 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 754/1524] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:01:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:01:24.557298 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c999ed-e333-4518-b5d0-b019279ec1f3 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:01:24.557905 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c999ed-e333-4518-b5d0-b019279ec1f3 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:01:24.557905 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c999ed-e333-4518-b5d0-b019279ec1f3 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:01:24.559696 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 771/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 10 10:01:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:01:24.565514 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9f6194-52d5-4ca8-b297-85831a06ef1f None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:01:24.566256 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9f6194-52d5-4ca8-b297-85831a06ef1f None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:01:24.566403 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9f6194-52d5-4ca8-b297-85831a06ef1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:01:24.591286 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-6c9f6194-52d5-4ca8-b297-85831a06ef1f None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:01:24.592497 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-6c9f6194-52d5-4ca8-b297-85831a06ef1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:01:24.601991 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 755/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 10 10:01:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:01:24.754327 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c999ed-e333-4518-b5d0-b019279ec1f3 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:01:24.774256 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c999ed-e333-4518-b5d0-b019279ec1f3 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:01:24.780965 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e725465-7fff-4282-a90e-03947f7f0079 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd8580888cba41a88566da4540b1130c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:01:24.781594 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e725465-7fff-4282-a90e-03947f7f0079 service nova] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:01:24.781872 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e725465-7fff-4282-a90e-03947f7f0079 service nova] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:01:24.782138 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e725465-7fff-4282-a90e-03947f7f0079 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:01:24.790907 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e725465-7fff-4282-a90e-03947f7f0079 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:01:24.792514 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e725465-7fff-4282-a90e-03947f7f0079 service nova] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:01:24.802812 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 772/1527] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:01:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:01:28.485708 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183f5bb9-98ac-4964-b31a-e1b61b9e10f5 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:01:28.486618 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183f5bb9-98ac-4964-b31a-e1b61b9e10f5 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:01:28.486618 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183f5bb9-98ac-4964-b31a-e1b61b9e10f5 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:01:28.488703 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 756/1528] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 10:01:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:01:28.495061 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcb5350-445b-40ad-a85e-971730090af8 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:01:28.495520 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcb5350-445b-40ad-a85e-971730090af8 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:01:28.495631 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcb5350-445b-40ad-a85e-971730090af8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:01:28.524063 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-7fcb5350-445b-40ad-a85e-971730090af8 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:01:28.525300 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-7fcb5350-445b-40ad-a85e-971730090af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:01:28.534412 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 773/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 10:01:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:01:28.608799 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183f5bb9-98ac-4964-b31a-e1b61b9e10f5 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:01:28.610983 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-183f5bb9-98ac-4964-b31a-e1b61b9e10f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:01:28.698801 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183f5bb9-98ac-4964-b31a-e1b61b9e10f5 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:01:28.702866 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b2eb90-5d08-44f4-ad15-953d0ac08269 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4294c170df354fe892831281acd4ea7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:01:28.703472 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b2eb90-5d08-44f4-ad15-953d0ac08269 service neutron] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:01:28.703818 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b2eb90-5d08-44f4-ad15-953d0ac08269 service neutron] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:01:28.704101 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b2eb90-5d08-44f4-ad15-953d0ac08269 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:01:28.713185 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b2eb90-5d08-44f4-ad15-953d0ac08269 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:01:28.714625 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b2eb90-5d08-44f4-ad15-953d0ac08269 service neutron] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:01:28.724442 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 757/1530] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:01:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:01:30.685545 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d499dff-c6d2-4d75-8524-8bd4a8a14fc6 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:01:30.686035 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d499dff-c6d2-4d75-8524-8bd4a8a14fc6 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:01:30.686035 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d499dff-c6d2-4d75-8524-8bd4a8a14fc6 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:01:30.687461 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 774/1531] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 10:01:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:01:30.693848 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eccb34e-43bc-49dd-b9d1-3bbe364b1335 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:01:30.694656 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eccb34e-43bc-49dd-b9d1-3bbe364b1335 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:01:30.694855 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eccb34e-43bc-49dd-b9d1-3bbe364b1335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:01:30.716995 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-7eccb34e-43bc-49dd-b9d1-3bbe364b1335 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:01:30.718219 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-7eccb34e-43bc-49dd-b9d1-3bbe364b1335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:01:30.726629 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 758/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 10:01:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:01:30.761865 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d499dff-c6d2-4d75-8524-8bd4a8a14fc6 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:01:30.773590 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d499dff-c6d2-4d75-8524-8bd4a8a14fc6 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:01:30.777679 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff34bd3-4795-4723-921f-2cd90baa090f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4294c170df354fe892831281acd4ea7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:01:30.778269 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff34bd3-4795-4723-921f-2cd90baa090f service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:01:30.778546 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff34bd3-4795-4723-921f-2cd90baa090f service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:01:30.778779 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff34bd3-4795-4723-921f-2cd90baa090f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:01:30.788009 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff34bd3-4795-4723-921f-2cd90baa090f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:01:30.789454 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff34bd3-4795-4723-921f-2cd90baa090f service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:01:30.798845 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 775/1533] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:01:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 10:01:34.267169 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f711842-e407-4efd-804a-601fe2991018 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:01:34.267853 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f711842-e407-4efd-804a-601fe2991018 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:01:34.267853 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f711842-e407-4efd-804a-601fe2991018 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:01:34.269711 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 759/1534] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 10:01:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:01:34.276281 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b47719-ddfe-439d-b039-6ff13a613967 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:01:34.276767 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b47719-ddfe-439d-b039-6ff13a613967 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:01:34.277114 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b47719-ddfe-439d-b039-6ff13a613967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:01:34.304626 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-e2b47719-ddfe-439d-b039-6ff13a613967 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:01:34.305867 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-e2b47719-ddfe-439d-b039-6ff13a613967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:01:34.316647 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 776/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 10:01:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:01:34.620730 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f711842-e407-4efd-804a-601fe2991018 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:01:34.624062 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-2f711842-e407-4efd-804a-601fe2991018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:01:34.698147 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:01:34.712512 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f711842-e407-4efd-804a-601fe2991018 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:01:34.716495 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756e060a-fd6f-411c-a823-b97b6d147717 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf8e725cbe0403d943b136235eac057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:01:34.717144 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756e060a-fd6f-411c-a823-b97b6d147717 service cinder] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:01:34.717423 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756e060a-fd6f-411c-a823-b97b6d147717 service cinder] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:01:34.717696 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756e060a-fd6f-411c-a823-b97b6d147717 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:01:34.727027 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756e060a-fd6f-411c-a823-b97b6d147717 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:01:34.728471 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756e060a-fd6f-411c-a823-b97b6d147717 service cinder] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:01:34.738053 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 760/1536] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:01:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 10:01:36.743286 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5605a71-1425-4849-b4ec-a7c648971aac None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:01:36.744233 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5605a71-1425-4849-b4ec-a7c648971aac None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:01:36.744233 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5605a71-1425-4849-b4ec-a7c648971aac None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:01:36.746377 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 777/1537] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 10 10:01:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:01:36.752020 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3908ed17-9918-484f-8a12-bf9e90fb84d0 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:01:36.752484 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3908ed17-9918-484f-8a12-bf9e90fb84d0 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:01:36.752595 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3908ed17-9918-484f-8a12-bf9e90fb84d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:01:36.773631 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-3908ed17-9918-484f-8a12-bf9e90fb84d0 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:01:36.774836 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-3908ed17-9918-484f-8a12-bf9e90fb84d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:01:36.783292 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 761/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 10 10:01:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:01:37.087649 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5605a71-1425-4849-b4ec-a7c648971aac None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:01:37.090719 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-e5605a71-1425-4849-b4ec-a7c648971aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:01:37.099687 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=84 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:01:37.109273 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5605a71-1425-4849-b4ec-a7c648971aac None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:01:37.115413 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0fccc6-fd88-43aa-a9d6-58530bf450ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf8e725cbe0403d943b136235eac057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:01:37.116013 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0fccc6-fd88-43aa-a9d6-58530bf450ef service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:01:37.116318 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0fccc6-fd88-43aa-a9d6-58530bf450ef service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:01:37.116582 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0fccc6-fd88-43aa-a9d6-58530bf450ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:01:37.127113 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0fccc6-fd88-43aa-a9d6-58530bf450ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:01:37.128538 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0fccc6-fd88-43aa-a9d6-58530bf450ef service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:01:37.138205 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 778/1539] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:01:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:01:46.768874 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=11 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:01:47.133872 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=5 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:03.850175 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3178491c-8c2c-4d3a-9ada-e6ffb2387ed0 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:03.850904 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3178491c-8c2c-4d3a-9ada-e6ffb2387ed0 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:03.850904 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3178491c-8c2c-4d3a-9ada-e6ffb2387ed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:03.883238 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-3178491c-8c2c-4d3a-9ada-e6ffb2387ed0 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:03:03.884461 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-3178491c-8c2c-4d3a-9ada-e6ffb2387ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:03.900006 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 762/1540] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:03:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:03:03.908930 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec9b1d6-0246-47c2-8248-3b119806ba1e None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:03.909551 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec9b1d6-0246-47c2-8248-3b119806ba1e None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:03.909551 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec9b1d6-0246-47c2-8248-3b119806ba1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:03.935891 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-0ec9b1d6-0246-47c2-8248-3b119806ba1e None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:03:03.937019 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-0ec9b1d6-0246-47c2-8248-3b119806ba1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:03.953486 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 779/1541] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:03:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:03:03.958047 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3178491c-8c2c-4d3a-9ada-e6ffb2387ed0 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:03.979748 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3178491c-8c2c-4d3a-9ada-e6ffb2387ed0 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:03.989953 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcde5c74-a080-42a7-89e4-f2ca1c063b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:03.990604 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcde5c74-a080-42a7-89e4-f2ca1c063b20 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:03.990882 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcde5c74-a080-42a7-89e4-f2ca1c063b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:03.991156 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcde5c74-a080-42a7-89e4-f2ca1c063b20 admin admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:03.991845 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcde5c74-a080-42a7-89e4-f2ca1c063b20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:03:03.992150 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcde5c74-a080-42a7-89e4-f2ca1c063b20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:03.998173 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcde5c74-a080-42a7-89e4-f2ca1c063b20 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:04.016043 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 763/1542] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 10 10:03:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:03:04.025058 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec9b1d6-0246-47c2-8248-3b119806ba1e None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:04.035231 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec9b1d6-0246-47c2-8248-3b119806ba1e None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:04.045487 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3bb4c1-a88f-4723-b9ad-8b1c959d758d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:04.046125 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3bb4c1-a88f-4723-b9ad-8b1c959d758d admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:04.046428 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3bb4c1-a88f-4723-b9ad-8b1c959d758d admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:04.046715 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3bb4c1-a88f-4723-b9ad-8b1c959d758d admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:04.047305 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3bb4c1-a88f-4723-b9ad-8b1c959d758d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:04.049455 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3bb4c1-a88f-4723-b9ad-8b1c959d758d admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:04.115857 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 780/1543] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 10 10:03:04 2022] POST /identity/v3/projects => generated 389 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:03:04.120263 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcde5c74-a080-42a7-89e4-f2ca1c063b20 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:04.132992 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcde5c74-a080-42a7-89e4-f2ca1c063b20 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:04.214604 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b585fd7c-e5b7-41fd-9760-c1227236680a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:04.215300 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b585fd7c-e5b7-41fd-9760-c1227236680a admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:04.215585 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b585fd7c-e5b7-41fd-9760-c1227236680a admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:04.215856 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b585fd7c-e5b7-41fd-9760-c1227236680a admin admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:04.216505 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b585fd7c-e5b7-41fd-9760-c1227236680a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:04.218480 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b585fd7c-e5b7-41fd-9760-c1227236680a admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:04.253102 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 764/1544] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 10 10:03:04 2022] POST /identity/v3/users => generated 295 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:03:04.257340 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3bb4c1-a88f-4723-b9ad-8b1c959d758d admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:04.272686 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd52f07-afdb-4466-96dc-8c2822256837 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:04.273056 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd52f07-afdb-4466-96dc-8c2822256837 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:04.273294 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd52f07-afdb-4466-96dc-8c2822256837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:04.275670 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3bb4c1-a88f-4723-b9ad-8b1c959d758d admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:04.289172 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eba023-1899-40c1-8c00-6d35900fdbfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:04.290115 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eba023-1899-40c1-8c00-6d35900fdbfb admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:04.290409 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eba023-1899-40c1-8c00-6d35900fdbfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:04.291103 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eba023-1899-40c1-8c00-6d35900fdbfb admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:04.291384 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71eba023-1899-40c1-8c00-6d35900fdbfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:04.294090 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71eba023-1899-40c1-8c00-6d35900fdbfb admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:04.314539 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-3cd52f07-afdb-4466-96dc-8c2822256837 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:03:04.314802 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 781/1545] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:03:04 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:03:04.315865 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-3cd52f07-afdb-4466-96dc-8c2822256837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:04.322492 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eba023-1899-40c1-8c00-6d35900fdbfb admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:04.335650 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eba023-1899-40c1-8c00-6d35900fdbfb admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:04.340661 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 765/1546] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:03:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:03:04.345776 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5255d70-e8d5-44b3-bd3f-745fc2a1b76b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:04.346418 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5255d70-e8d5-44b3-bd3f-745fc2a1b76b admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:04.346703 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5255d70-e8d5-44b3-bd3f-745fc2a1b76b admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:04.346982 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5255d70-e8d5-44b3-bd3f-745fc2a1b76b admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:04.347683 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5255d70-e8d5-44b3-bd3f-745fc2a1b76b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:04.354889 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5255d70-e8d5-44b3-bd3f-745fc2a1b76b admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:04.371856 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 782/1547] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:03:04 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:03:04.375414 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b87ee5a-a6dd-4a25-8f8a-476562726503 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:04.377900 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b87ee5a-a6dd-4a25-8f8a-476562726503 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:04.377900 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b87ee5a-a6dd-4a25-8f8a-476562726503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:04.386670 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5255d70-e8d5-44b3-bd3f-745fc2a1b76b admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:04.406628 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5255d70-e8d5-44b3-bd3f-745fc2a1b76b admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:04.412667 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd86072-ba74-425e-8120-db722b3bc0df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:04.413403 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd86072-ba74-425e-8120-db722b3bc0df admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:04.413685 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd86072-ba74-425e-8120-db722b3bc0df admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:04.413960 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd86072-ba74-425e-8120-db722b3bc0df admin admin] PATH_INFO: `/v3/projects/7874da1d05f54801b0724eb40ffa2317/users/3027050c9e124590971f3930146522d1/roles/8daabcb6b7394e39b06a3453e33e32db` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:04.422480 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-2b87ee5a-a6dd-4a25-8f8a-476562726503 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:03:04.425113 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-2b87ee5a-a6dd-4a25-8f8a-476562726503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:04.447674 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd86072-ba74-425e-8120-db722b3bc0df admin admin] RBAC: Authorizing `identity:create_grant(project_id=7874da1d05f54801b0724eb40ffa2317, user_id=3027050c9e124590971f3930146522d1, role_id=8daabcb6b7394e39b06a3453e33e32db)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:04.449660 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 766/1548] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:03:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:03:04.450909 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd86072-ba74-425e-8120-db722b3bc0df admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:04.454715 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b87ee5a-a6dd-4a25-8f8a-476562726503 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:04.476408 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b87ee5a-a6dd-4a25-8f8a-476562726503 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:04.489472 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 783/1549] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:03:04 2022] PUT /identity/v3/projects/7874da1d05f54801b0724eb40ffa2317/users/3027050c9e124590971f3930146522d1/roles/8daabcb6b7394e39b06a3453e33e32db => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 10:03:04.500658 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e41d34-c361-40c6-9a6e-7ce48d2fea83 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:04.501108 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e41d34-c361-40c6-9a6e-7ce48d2fea83 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:04.501462 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e41d34-c361-40c6-9a6e-7ce48d2fea83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:04.538560 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-81e41d34-c361-40c6-9a6e-7ce48d2fea83 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:03:04.545099 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-81e41d34-c361-40c6-9a6e-7ce48d2fea83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:04.610832 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f02a08-8182-4dac-ae4e-6f82341d2416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:04.611760 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f02a08-8182-4dac-ae4e-6f82341d2416 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:04.612221 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f02a08-8182-4dac-ae4e-6f82341d2416 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:04.612651 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f02a08-8182-4dac-ae4e-6f82341d2416 admin admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:04.613555 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f02a08-8182-4dac-ae4e-6f82341d2416 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:03:04.614023 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f02a08-8182-4dac-ae4e-6f82341d2416 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:04.615815 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f02a08-8182-4dac-ae4e-6f82341d2416 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:04.639628 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 767/1550] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 10 10:03:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 10:03:04.641548 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf117eb3-4ec0-4d3c-8160-62ed9f634322 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:04.641987 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf117eb3-4ec0-4d3c-8160-62ed9f634322 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:04.642424 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf117eb3-4ec0-4d3c-8160-62ed9f634322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:04.685984 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-cf117eb3-4ec0-4d3c-8160-62ed9f634322 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:03:04.686225 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 784/1551] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:03:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 10:03:04.687206 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e41d34-c361-40c6-9a6e-7ce48d2fea83 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:04.688163 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-cf117eb3-4ec0-4d3c-8160-62ed9f634322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:04.708478 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 768/1552] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:03:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:03:04.713873 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97738bc9-4f57-4201-bd06-c2e2d10349d0 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:04.714157 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97738bc9-4f57-4201-bd06-c2e2d10349d0 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:04.714434 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97738bc9-4f57-4201-bd06-c2e2d10349d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:04.718809 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e41d34-c361-40c6-9a6e-7ce48d2fea83 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:04.738439 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c577841-72d3-4156-82ee-e8937a51fcf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:04.739172 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c577841-72d3-4156-82ee-e8937a51fcf4 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:04.739550 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c577841-72d3-4156-82ee-e8937a51fcf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:04.739963 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c577841-72d3-4156-82ee-e8937a51fcf4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:04.740856 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c577841-72d3-4156-82ee-e8937a51fcf4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:04.744285 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-97738bc9-4f57-4201-bd06-c2e2d10349d0 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:03:04.745599 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-97738bc9-4f57-4201-bd06-c2e2d10349d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:04.746805 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c577841-72d3-4156-82ee-e8937a51fcf4 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:04.754921 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 769/1553] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:03:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:03:04.756790 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c90b3d-5167-432a-9b39-7a542a817b0d None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:04.757172 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c90b3d-5167-432a-9b39-7a542a817b0d None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:04.757463 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c90b3d-5167-432a-9b39-7a542a817b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:04.786156 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-27c90b3d-5167-432a-9b39-7a542a817b0d None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:03:04.787775 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-27c90b3d-5167-432a-9b39-7a542a817b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:04.797356 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 785/1554] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 10 10:03:04 2022] POST /identity/v3/projects => generated 381 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:03:04.798055 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 770/1555] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:03:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:03:04.798375 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c577841-72d3-4156-82ee-e8937a51fcf4 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:04.799387 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0822a2-ca40-4716-8818-cbe74e58135f None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:04.800861 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0822a2-ca40-4716-8818-cbe74e58135f None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:04.801189 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0822a2-ca40-4716-8818-cbe74e58135f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:04.821093 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-8e0822a2-ca40-4716-8818-cbe74e58135f None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:03:04.822282 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-8e0822a2-ca40-4716-8818-cbe74e58135f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:04.848658 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:04.854562 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c577841-72d3-4156-82ee-e8937a51fcf4 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:04.858565 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e1eb3a-3511-4e1d-ac0d-d09c7284cd40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4294c170df354fe892831281acd4ea7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:04.859166 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e1eb3a-3511-4e1d-ac0d-d09c7284cd40 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:04.859442 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e1eb3a-3511-4e1d-ac0d-d09c7284cd40 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:04.859712 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e1eb3a-3511-4e1d-ac0d-d09c7284cd40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:04.868069 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:04.883403 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 771/1556] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:03:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:03:04.884649 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c3cb2-2a5f-4052-898c-cbf565324e25 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:04.884935 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c3cb2-2a5f-4052-898c-cbf565324e25 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:04.885244 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c3cb2-2a5f-4052-898c-cbf565324e25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:04.903972 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-bb5c3cb2-2a5f-4052-898c-cbf565324e25 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:03:04.906049 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-bb5c3cb2-2a5f-4052-898c-cbf565324e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:04.914258 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 772/1557] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:03:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:03:04.915428 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93acee0a-b79c-48a7-9346-4366d2ad9b68 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:04.915703 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93acee0a-b79c-48a7-9346-4366d2ad9b68 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:04.915973 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93acee0a-b79c-48a7-9346-4366d2ad9b68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:04.923740 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e1eb3a-3511-4e1d-ac0d-d09c7284cd40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:04.925235 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e1eb3a-3511-4e1d-ac0d-d09c7284cd40 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:04.935736 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 786/1558] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:03:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:03:04.936046 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-93acee0a-b79c-48a7-9346-4366d2ad9b68 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:03:04.936940 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa96524f-fc99-4eab-b230-cfd81cdcae9e None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:04.937262 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-93acee0a-b79c-48a7-9346-4366d2ad9b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:04.937395 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa96524f-fc99-4eab-b230-cfd81cdcae9e None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:04.937634 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa96524f-fc99-4eab-b230-cfd81cdcae9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:04.944979 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 773/1559] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:03:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:03:04.946206 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27829e77-bb85-4cc3-8383-0a779afc6648 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:04.946483 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27829e77-bb85-4cc3-8383-0a779afc6648 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:04.946749 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27829e77-bb85-4cc3-8383-0a779afc6648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:04.959158 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-fa96524f-fc99-4eab-b230-cfd81cdcae9e None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:03:04.961282 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-fa96524f-fc99-4eab-b230-cfd81cdcae9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:04.966047 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-27829e77-bb85-4cc3-8383-0a779afc6648 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:03:04.967287 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-27829e77-bb85-4cc3-8383-0a779afc6648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:04.976367 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 774/1560] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:03:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:03:04.978798 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 787/1561] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:03:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:03:04.980207 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb5f3e0-350a-48bb-b443-3e612fbde426 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:04.980537 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb5f3e0-350a-48bb-b443-3e612fbde426 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:04.980816 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb5f3e0-350a-48bb-b443-3e612fbde426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:04.983962 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27829e77-bb85-4cc3-8383-0a779afc6648 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:04.993874 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27829e77-bb85-4cc3-8383-0a779afc6648 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:04.998788 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc5d9c0-4c78-4f0a-8255-9d39663873cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:04.999482 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc5d9c0-4c78-4f0a-8255-9d39663873cb admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:04.999822 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc5d9c0-4c78-4f0a-8255-9d39663873cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:05.000157 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc5d9c0-4c78-4f0a-8255-9d39663873cb admin admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:05.000847 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc5d9c0-4c78-4f0a-8255-9d39663873cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:05.001375 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-8eb5f3e0-350a-48bb-b443-3e612fbde426 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:03:05.002632 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-8eb5f3e0-350a-48bb-b443-3e612fbde426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:05.003024 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc5d9c0-4c78-4f0a-8255-9d39663873cb admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:05.015029 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 788/1562] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:03:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:03:05.015029 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb5f3e0-350a-48bb-b443-3e612fbde426 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:05.026633 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb5f3e0-350a-48bb-b443-3e612fbde426 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:05.031916 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6942f45-9884-4e64-9cbd-cd10d42361f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:05.032160 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 775/1563] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 10 10:03:04 2022] POST /identity/v3/users => generated 291 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:03:05.032592 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6942f45-9884-4e64-9cbd-cd10d42361f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:05.032876 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6942f45-9884-4e64-9cbd-cd10d42361f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:05.033170 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6942f45-9884-4e64-9cbd-cd10d42361f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:05.033831 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6942f45-9884-4e64-9cbd-cd10d42361f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:03:05.034133 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6942f45-9884-4e64-9cbd-cd10d42361f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:05.034534 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4caa8f-be8b-4444-b091-e16c499abf00 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:05.034963 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4caa8f-be8b-4444-b091-e16c499abf00 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:05.035388 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4caa8f-be8b-4444-b091-e16c499abf00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:05.035715 dv-cinder-850836-5-smb devstack@keystone.service[80231]: WARNING py.warnings [None req-a6942f45-9884-4e64-9cbd-cd10d42361f1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 10:03:05.035715 dv-cinder-850836-5-smb devstack@keystone.service[80231]: warnings.warn(msg) Aug 10 10:03:05.035715 dv-cinder-850836-5-smb devstack@keystone.service[80231]: Aug 10 10:03:05.036784 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6942f45-9884-4e64-9cbd-cd10d42361f1 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:05.060806 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 789/1564] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 10 10:03:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:03:05.060806 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6942f45-9884-4e64-9cbd-cd10d42361f1 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:05.061194 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-5d4caa8f-be8b-4444-b091-e16c499abf00 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:03:05.061194 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-5d4caa8f-be8b-4444-b091-e16c499abf00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:05.068823 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 776/1565] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:03:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:03:05.070160 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6620ae-3224-40e7-9c8f-67bca13370a1 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:05.070512 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6620ae-3224-40e7-9c8f-67bca13370a1 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:05.070861 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6620ae-3224-40e7-9c8f-67bca13370a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:05.071733 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6942f45-9884-4e64-9cbd-cd10d42361f1 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:05.077340 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e291f067-9c0e-4f4e-b68b-f889148246d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:05.078062 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e291f067-9c0e-4f4e-b68b-f889148246d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:05.078245 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e291f067-9c0e-4f4e-b68b-f889148246d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:05.078512 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e291f067-9c0e-4f4e-b68b-f889148246d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:05.079253 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e291f067-9c0e-4f4e-b68b-f889148246d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:03:05.079566 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e291f067-9c0e-4f4e-b68b-f889148246d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:05.082608 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e291f067-9c0e-4f4e-b68b-f889148246d5 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:05.092920 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-be6620ae-3224-40e7-9c8f-67bca13370a1 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:03:05.094272 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-be6620ae-3224-40e7-9c8f-67bca13370a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:05.099233 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 790/1566] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 10 10:03:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:03:05.103324 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 777/1567] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:03:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:03:05.104634 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6620ae-3224-40e7-9c8f-67bca13370a1 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:05.106899 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e865759-e18a-424c-b604-ad67ab1ae963 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:05.107181 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e865759-e18a-424c-b604-ad67ab1ae963 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:05.107453 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e865759-e18a-424c-b604-ad67ab1ae963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:05.117468 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6620ae-3224-40e7-9c8f-67bca13370a1 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:05.122534 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8f2c44-7c5a-4c37-82bf-f0babd03e7de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:05.123199 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8f2c44-7c5a-4c37-82bf-f0babd03e7de admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:05.123507 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8f2c44-7c5a-4c37-82bf-f0babd03e7de admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:05.123748 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8f2c44-7c5a-4c37-82bf-f0babd03e7de admin admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:05.124551 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8f2c44-7c5a-4c37-82bf-f0babd03e7de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:03:05.124866 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8f2c44-7c5a-4c37-82bf-f0babd03e7de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:05.126651 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8f2c44-7c5a-4c37-82bf-f0babd03e7de admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:05.136794 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-6e865759-e18a-424c-b604-ad67ab1ae963 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:03:05.138495 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-6e865759-e18a-424c-b604-ad67ab1ae963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:05.142842 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 778/1568] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 10 10:03:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:03:05.143848 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8f2c44-7c5a-4c37-82bf-f0babd03e7de admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:05.157953 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8f2c44-7c5a-4c37-82bf-f0babd03e7de admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:05.161277 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 791/1569] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:03:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:03:05.163238 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e865759-e18a-424c-b604-ad67ab1ae963 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:05.164113 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b160a25-99b9-4c1a-876b-f12b54f510c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:05.165109 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b160a25-99b9-4c1a-876b-f12b54f510c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:05.165426 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b160a25-99b9-4c1a-876b-f12b54f510c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:05.165790 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b160a25-99b9-4c1a-876b-f12b54f510c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:05.166648 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b160a25-99b9-4c1a-876b-f12b54f510c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:05.168500 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b160a25-99b9-4c1a-876b-f12b54f510c8 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:05.175695 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e865759-e18a-424c-b604-ad67ab1ae963 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:05.181130 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f709216-d991-4fb4-9d16-9a999b4634bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:05.181668 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 779/1570] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:03:05 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:03:05.181871 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b160a25-99b9-4c1a-876b-f12b54f510c8 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:05.182354 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f709216-d991-4fb4-9d16-9a999b4634bb admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:05.182581 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f709216-d991-4fb4-9d16-9a999b4634bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:05.182873 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f709216-d991-4fb4-9d16-9a999b4634bb admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:05.183676 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f709216-d991-4fb4-9d16-9a999b4634bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:05.185647 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f709216-d991-4fb4-9d16-9a999b4634bb admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:05.195845 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b160a25-99b9-4c1a-876b-f12b54f510c8 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:05.200696 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115cd453-b25e-4b71-bc63-c8c3dd4f3c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:05.201443 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115cd453-b25e-4b71-bc63-c8c3dd4f3c3c admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:05.201818 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115cd453-b25e-4b71-bc63-c8c3dd4f3c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:05.202155 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115cd453-b25e-4b71-bc63-c8c3dd4f3c3c admin admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:05.202891 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115cd453-b25e-4b71-bc63-c8c3dd4f3c3c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:03:05.203415 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115cd453-b25e-4b71-bc63-c8c3dd4f3c3c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:05.205482 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115cd453-b25e-4b71-bc63-c8c3dd4f3c3c admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:05.218990 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 780/1571] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 10 10:03:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:03:05.219683 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 792/1572] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 10 10:03:05 2022] POST /identity/v3/projects => generated 383 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:03:05.220504 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f709216-d991-4fb4-9d16-9a999b4634bb admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:05.221029 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115cd453-b25e-4b71-bc63-c8c3dd4f3c3c admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:05.232320 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115cd453-b25e-4b71-bc63-c8c3dd4f3c3c admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:05.294184 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f709216-d991-4fb4-9d16-9a999b4634bb admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:05.295378 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52637cc4-db0a-4c70-b565-d21c00fc29d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:05.296811 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52637cc4-db0a-4c70-b565-d21c00fc29d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:05.297124 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52637cc4-db0a-4c70-b565-d21c00fc29d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:05.297527 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52637cc4-db0a-4c70-b565-d21c00fc29d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:05.298283 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52637cc4-db0a-4c70-b565-d21c00fc29d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:03:05.298686 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52637cc4-db0a-4c70-b565-d21c00fc29d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:05.300421 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4bd94d-5339-4c86-964d-990154e57f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:05.300582 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52637cc4-db0a-4c70-b565-d21c00fc29d7 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:05.300843 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4bd94d-5339-4c86-964d-990154e57f8c admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:05.301253 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4bd94d-5339-4c86-964d-990154e57f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:05.301557 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4bd94d-5339-4c86-964d-990154e57f8c admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:05.302299 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4bd94d-5339-4c86-964d-990154e57f8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:05.304484 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4bd94d-5339-4c86-964d-990154e57f8c admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:05.315293 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 781/1573] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 10 10:03:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:03:05.316067 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52637cc4-db0a-4c70-b565-d21c00fc29d7 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:05.326674 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52637cc4-db0a-4c70-b565-d21c00fc29d7 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:05.332313 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02efd957-9dde-482e-a3e1-13aeef373a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:05.332944 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02efd957-9dde-482e-a3e1-13aeef373a3e admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:05.333262 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02efd957-9dde-482e-a3e1-13aeef373a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:05.333539 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02efd957-9dde-482e-a3e1-13aeef373a3e admin admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:05.334263 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02efd957-9dde-482e-a3e1-13aeef373a3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:05.335815 dv-cinder-850836-5-smb devstack@keystone.service[80232]: WARNING py.warnings [None req-02efd957-9dde-482e-a3e1-13aeef373a3e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 10:03:05.335815 dv-cinder-850836-5-smb devstack@keystone.service[80232]: warnings.warn(msg) Aug 10 10:03:05.335815 dv-cinder-850836-5-smb devstack@keystone.service[80232]: Aug 10 10:03:05.337224 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02efd957-9dde-482e-a3e1-13aeef373a3e admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:05.341107 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 793/1574] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 10 10:03:05 2022] POST /identity/v3/projects => generated 373 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:03:05.342047 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4bd94d-5339-4c86-964d-990154e57f8c admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:05.382937 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:05.384687 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 782/1575] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 10 10:03:05 2022] POST /identity/v3/projects => generated 377 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:03:05.388356 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02efd957-9dde-482e-a3e1-13aeef373a3e admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:05.432281 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4bd94d-5339-4c86-964d-990154e57f8c admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:05.432511 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:05.491067 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02efd957-9dde-482e-a3e1-13aeef373a3e admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:05.501147 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c5401e-9278-4c66-84cd-72293616e9d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:05.501827 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c5401e-9278-4c66-84cd-72293616e9d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:05.502105 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c5401e-9278-4c66-84cd-72293616e9d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:05.502378 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c5401e-9278-4c66-84cd-72293616e9d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:05.503463 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c5401e-9278-4c66-84cd-72293616e9d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:05.505283 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c5401e-9278-4c66-84cd-72293616e9d7 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:05.506080 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85197e49-3c8d-4308-959b-a9ce8db618b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:05.507196 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85197e49-3c8d-4308-959b-a9ce8db618b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:05.508133 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85197e49-3c8d-4308-959b-a9ce8db618b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:05.508581 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85197e49-3c8d-4308-959b-a9ce8db618b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:05.509572 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85197e49-3c8d-4308-959b-a9ce8db618b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:03:05.510963 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85197e49-3c8d-4308-959b-a9ce8db618b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:05.513816 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85197e49-3c8d-4308-959b-a9ce8db618b2 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:05.519685 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 783/1576] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:03:05 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:03:05.520826 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c5401e-9278-4c66-84cd-72293616e9d7 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:05.530437 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 794/1577] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 10 10:03:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:03:05.532041 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85197e49-3c8d-4308-959b-a9ce8db618b2 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:05.534732 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c5401e-9278-4c66-84cd-72293616e9d7 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:05.543571 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4306382e-2900-45eb-8788-bf452674be94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:05.544954 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4306382e-2900-45eb-8788-bf452674be94 admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:05.545401 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4306382e-2900-45eb-8788-bf452674be94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:05.545776 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4306382e-2900-45eb-8788-bf452674be94 admin admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:05.546500 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4306382e-2900-45eb-8788-bf452674be94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:05.548316 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85197e49-3c8d-4308-959b-a9ce8db618b2 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:05.548703 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4306382e-2900-45eb-8788-bf452674be94 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:05.553807 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d68efd2-70f6-4142-93c8-5ad9bce7b657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:05.554409 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d68efd2-70f6-4142-93c8-5ad9bce7b657 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:05.554842 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d68efd2-70f6-4142-93c8-5ad9bce7b657 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:05.555120 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d68efd2-70f6-4142-93c8-5ad9bce7b657 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:05.555743 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d68efd2-70f6-4142-93c8-5ad9bce7b657 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:05.558053 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d68efd2-70f6-4142-93c8-5ad9bce7b657 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:05.574895 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 784/1578] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 10 10:03:05 2022] POST /identity/v3/users => generated 292 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:03:05.575934 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4306382e-2900-45eb-8788-bf452674be94 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:05.587617 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4306382e-2900-45eb-8788-bf452674be94 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:05.592279 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 795/1579] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 10 10:03:05 2022] POST /identity/v3/projects => generated 375 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:03:05.592279 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d68efd2-70f6-4142-93c8-5ad9bce7b657 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:05.661502 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba59fc0-594b-4b89-a5db-8d4c9a5ce696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:05.662053 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d68efd2-70f6-4142-93c8-5ad9bce7b657 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:05.662204 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba59fc0-594b-4b89-a5db-8d4c9a5ce696 admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:05.662381 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba59fc0-594b-4b89-a5db-8d4c9a5ce696 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:05.662654 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba59fc0-594b-4b89-a5db-8d4c9a5ce696 admin admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:05.663373 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba59fc0-594b-4b89-a5db-8d4c9a5ce696 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:05.665411 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba59fc0-594b-4b89-a5db-8d4c9a5ce696 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:05.667077 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b544df32-1a28-459b-9d6f-4f2e7964fd8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:05.667761 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b544df32-1a28-459b-9d6f-4f2e7964fd8a admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:05.668255 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b544df32-1a28-459b-9d6f-4f2e7964fd8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:05.669787 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b544df32-1a28-459b-9d6f-4f2e7964fd8a admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:05.669787 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b544df32-1a28-459b-9d6f-4f2e7964fd8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:05.673778 dv-cinder-850836-5-smb devstack@keystone.service[80231]: WARNING py.warnings [None req-b544df32-1a28-459b-9d6f-4f2e7964fd8a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 10:03:05.673778 dv-cinder-850836-5-smb devstack@keystone.service[80231]: warnings.warn(msg) Aug 10 10:03:05.673778 dv-cinder-850836-5-smb devstack@keystone.service[80231]: Aug 10 10:03:05.673778 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b544df32-1a28-459b-9d6f-4f2e7964fd8a admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:05.699874 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 796/1580] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 10 10:03:05 2022] POST /identity/v3/users => generated 287 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:03:05.700772 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b544df32-1a28-459b-9d6f-4f2e7964fd8a admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:05.708067 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 785/1581] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 10 10:03:05 2022] POST /identity/v3/projects => generated 377 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:03:05.708845 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba59fc0-594b-4b89-a5db-8d4c9a5ce696 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:05.717179 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b544df32-1a28-459b-9d6f-4f2e7964fd8a admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:05.789899 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:05.811787 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba59fc0-594b-4b89-a5db-8d4c9a5ce696 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:05.817850 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ea931a-888b-4fad-ae51-1d04e94ccc1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:05.818788 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ea931a-888b-4fad-ae51-1d04e94ccc1d admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:05.819069 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ea931a-888b-4fad-ae51-1d04e94ccc1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:05.819776 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ea931a-888b-4fad-ae51-1d04e94ccc1d admin admin] PATH_INFO: `/v3/projects/9d74c724bf2e45aba270f9eb6b76382b/users/148f1d89db51465eafc951f62ee6c95e/roles/8daabcb6b7394e39b06a3453e33e32db` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:05.826455 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667465ff-f1d5-4107-9ded-02c5b972d542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:05.827268 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667465ff-f1d5-4107-9ded-02c5b972d542 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:05.827587 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667465ff-f1d5-4107-9ded-02c5b972d542 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:05.827862 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667465ff-f1d5-4107-9ded-02c5b972d542 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:05.828553 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667465ff-f1d5-4107-9ded-02c5b972d542 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:05.830930 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667465ff-f1d5-4107-9ded-02c5b972d542 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:05.838086 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ea931a-888b-4fad-ae51-1d04e94ccc1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d74c724bf2e45aba270f9eb6b76382b, user_id=148f1d89db51465eafc951f62ee6c95e, role_id=8daabcb6b7394e39b06a3453e33e32db)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:05.839097 dv-cinder-850836-5-smb devstack@keystone.service[80232]: WARNING py.warnings [None req-a8ea931a-888b-4fad-ae51-1d04e94ccc1d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 10:03:05.839097 dv-cinder-850836-5-smb devstack@keystone.service[80232]: warnings.warn(msg) Aug 10 10:03:05.839097 dv-cinder-850836-5-smb devstack@keystone.service[80232]: Aug 10 10:03:05.842754 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ea931a-888b-4fad-ae51-1d04e94ccc1d admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:05.862158 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 797/1582] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 10 10:03:05 2022] POST /identity/v3/users => generated 289 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:03:05.863335 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667465ff-f1d5-4107-9ded-02c5b972d542 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:05.866614 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 786/1583] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:03:05 2022] PUT /identity/v3/projects/9d74c724bf2e45aba270f9eb6b76382b/users/148f1d89db51465eafc951f62ee6c95e/roles/8daabcb6b7394e39b06a3453e33e32db => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:03:05.868164 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ea931a-888b-4fad-ae51-1d04e94ccc1d admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:05.874423 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667465ff-f1d5-4107-9ded-02c5b972d542 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:05.875743 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:05.942461 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998e9ef7-bc68-4ca8-8f06-f9dbcead9e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:05.943131 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e9ef7-bc68-4ca8-8f06-f9dbcead9e02 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:05.943613 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e9ef7-bc68-4ca8-8f06-f9dbcead9e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:05.943613 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e9ef7-bc68-4ca8-8f06-f9dbcead9e02 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:05.944251 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998e9ef7-bc68-4ca8-8f06-f9dbcead9e02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:05.946606 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998e9ef7-bc68-4ca8-8f06-f9dbcead9e02 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:05.964294 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ea931a-888b-4fad-ae51-1d04e94ccc1d admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:05.971199 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdb9978-151b-496c-b446-9e3eacf38b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:05.972311 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdb9978-151b-496c-b446-9e3eacf38b46 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:05.972586 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdb9978-151b-496c-b446-9e3eacf38b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:05.972854 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdb9978-151b-496c-b446-9e3eacf38b46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:05.973606 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdb9978-151b-496c-b446-9e3eacf38b46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:05.975929 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdb9978-151b-496c-b446-9e3eacf38b46 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:05.980759 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 798/1584] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 10 10:03:05 2022] POST /identity/v3/projects => generated 357 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:03:05.981991 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998e9ef7-bc68-4ca8-8f06-f9dbcead9e02 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:05.996103 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 787/1585] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:03:05 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:03:05.996103 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdb9978-151b-496c-b446-9e3eacf38b46 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:06.008922 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdb9978-151b-496c-b446-9e3eacf38b46 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:06.054534 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998e9ef7-bc68-4ca8-8f06-f9dbcead9e02 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:06.059846 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bec1b48-a59f-4ebd-994a-db8625ce680c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:06.060526 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bec1b48-a59f-4ebd-994a-db8625ce680c admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:06.060809 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bec1b48-a59f-4ebd-994a-db8625ce680c admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:06.061287 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bec1b48-a59f-4ebd-994a-db8625ce680c admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:06.061937 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bec1b48-a59f-4ebd-994a-db8625ce680c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:06.064226 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bec1b48-a59f-4ebd-994a-db8625ce680c admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:06.094505 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b208a34-0fbf-4bf3-9066-d89200a5f291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:06.095224 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b208a34-0fbf-4bf3-9066-d89200a5f291 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:06.095574 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b208a34-0fbf-4bf3-9066-d89200a5f291 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:06.095957 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b208a34-0fbf-4bf3-9066-d89200a5f291 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:06.096737 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b208a34-0fbf-4bf3-9066-d89200a5f291 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:06.098023 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 799/1586] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 10 10:03:05 2022] POST /identity/v3/users => generated 288 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:03:06.098844 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b208a34-0fbf-4bf3-9066-d89200a5f291 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:06.099726 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bec1b48-a59f-4ebd-994a-db8625ce680c admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:06.111348 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 788/1587] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:03:05 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:03:06.112375 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b208a34-0fbf-4bf3-9066-d89200a5f291 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:06.116388 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bec1b48-a59f-4ebd-994a-db8625ce680c admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:06.123323 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b208a34-0fbf-4bf3-9066-d89200a5f291 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:06.124261 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d8cc97-10a8-4abe-85ff-a54b56c594b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:06.126347 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d8cc97-10a8-4abe-85ff-a54b56c594b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:06.126715 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d8cc97-10a8-4abe-85ff-a54b56c594b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:06.127067 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d8cc97-10a8-4abe-85ff-a54b56c594b6 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:06.127969 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d8cc97-10a8-4abe-85ff-a54b56c594b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:06.129361 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b19753-b3e2-4be8-82eb-854c2dd520b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:06.130276 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b19753-b3e2-4be8-82eb-854c2dd520b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:06.130513 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d8cc97-10a8-4abe-85ff-a54b56c594b6 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:06.130916 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b19753-b3e2-4be8-82eb-854c2dd520b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:06.131329 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b19753-b3e2-4be8-82eb-854c2dd520b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:06.132272 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b19753-b3e2-4be8-82eb-854c2dd520b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:06.134439 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b19753-b3e2-4be8-82eb-854c2dd520b2 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:06.150682 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 789/1588] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:03:06 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:03:06.152459 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af89bfa4-197b-4e63-834a-83c1e84fcafd None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:06.152916 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af89bfa4-197b-4e63-834a-83c1e84fcafd None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:06.153525 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af89bfa4-197b-4e63-834a-83c1e84fcafd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:06.163605 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 800/1589] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 10 10:03:06 2022] POST /identity/v3/users => generated 289 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:03:06.164430 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d8cc97-10a8-4abe-85ff-a54b56c594b6 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:06.177314 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d8cc97-10a8-4abe-85ff-a54b56c594b6 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:06.186059 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-af89bfa4-197b-4e63-834a-83c1e84fcafd None None] MFA Rules not processed for user `148f1d89db51465eafc951f62ee6c95e`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:03:06.186221 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f7fdd7-05cd-4924-8ea7-69b8bda26652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:06.186697 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f7fdd7-05cd-4924-8ea7-69b8bda26652 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:06.186987 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f7fdd7-05cd-4924-8ea7-69b8bda26652 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:06.187280 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f7fdd7-05cd-4924-8ea7-69b8bda26652 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:06.187878 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f7fdd7-05cd-4924-8ea7-69b8bda26652 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:06.189852 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f7fdd7-05cd-4924-8ea7-69b8bda26652 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:06.190167 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-af89bfa4-197b-4e63-834a-83c1e84fcafd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:06.212593 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=87,keystone:INSERT=13 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:06.225212 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 801/1590] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 10 10:03:06 2022] POST /identity/v3/users => generated 279 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:03:06.226010 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f7fdd7-05cd-4924-8ea7-69b8bda26652 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:06.240358 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f7fdd7-05cd-4924-8ea7-69b8bda26652 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:06.245555 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a637aa7-572b-4339-b3f2-3a18be6ad23b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:06.246307 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a637aa7-572b-4339-b3f2-3a18be6ad23b admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:06.246591 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a637aa7-572b-4339-b3f2-3a18be6ad23b admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:06.246925 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a637aa7-572b-4339-b3f2-3a18be6ad23b admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:06.247695 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a637aa7-572b-4339-b3f2-3a18be6ad23b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:06.249602 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a637aa7-572b-4339-b3f2-3a18be6ad23b admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:06.266314 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 802/1591] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:03:06 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:03:06.268155 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a637aa7-572b-4339-b3f2-3a18be6ad23b admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:06.286222 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 790/1592] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:03:06 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:03:06.286222 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af89bfa4-197b-4e63-834a-83c1e84fcafd None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:06.291734 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a637aa7-572b-4339-b3f2-3a18be6ad23b admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:06.296146 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af89bfa4-197b-4e63-834a-83c1e84fcafd None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:06.298080 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f669962-be33-41f2-a660-de8a8ee4d2f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:06.299451 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f669962-be33-41f2-a660-de8a8ee4d2f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:06.299899 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f669962-be33-41f2-a660-de8a8ee4d2f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:06.300332 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f669962-be33-41f2-a660-de8a8ee4d2f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:06.301744 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f669962-be33-41f2-a660-de8a8ee4d2f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:06.301965 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366d2294-9d52-4c2c-a4a0-f9be211b0e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:06.302577 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d2294-9d52-4c2c-a4a0-f9be211b0e9e admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:06.303029 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d2294-9d52-4c2c-a4a0-f9be211b0e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:06.303261 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d2294-9d52-4c2c-a4a0-f9be211b0e9e admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:06.304398 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366d2294-9d52-4c2c-a4a0-f9be211b0e9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:06.305821 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366d2294-9d52-4c2c-a4a0-f9be211b0e9e admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:06.306099 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f669962-be33-41f2-a660-de8a8ee4d2f7 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:06.319233 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 803/1593] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:03:06 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:03:06.319662 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 791/1594] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:03:06 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:03:06.320689 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f669962-be33-41f2-a660-de8a8ee4d2f7 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:06.320902 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366d2294-9d52-4c2c-a4a0-f9be211b0e9e admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:06.328999 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:06.334155 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f669962-be33-41f2-a660-de8a8ee4d2f7 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:06.338132 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366d2294-9d52-4c2c-a4a0-f9be211b0e9e admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:06.340658 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382b85e9-b258-4efa-9629-0e1bb9866c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:06.341644 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382b85e9-b258-4efa-9629-0e1bb9866c29 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:06.342088 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382b85e9-b258-4efa-9629-0e1bb9866c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:06.342527 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382b85e9-b258-4efa-9629-0e1bb9866c29 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:06.343908 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382b85e9-b258-4efa-9629-0e1bb9866c29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:06.344159 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdef9c5-dd6d-4919-a42e-2d502cbd07c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:06.344867 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdef9c5-dd6d-4919-a42e-2d502cbd07c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:06.345320 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdef9c5-dd6d-4919-a42e-2d502cbd07c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:06.345784 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdef9c5-dd6d-4919-a42e-2d502cbd07c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:06.346454 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382b85e9-b258-4efa-9629-0e1bb9866c29 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:06.346622 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdef9c5-dd6d-4919-a42e-2d502cbd07c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:06.348606 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdef9c5-dd6d-4919-a42e-2d502cbd07c2 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:06.360343 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 792/1595] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:03:06 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:03:06.361505 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdef9c5-dd6d-4919-a42e-2d502cbd07c2 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:06.362627 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 804/1596] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:03:06 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:03:06.363751 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382b85e9-b258-4efa-9629-0e1bb9866c29 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:06.372257 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdef9c5-dd6d-4919-a42e-2d502cbd07c2 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:06.377732 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382b85e9-b258-4efa-9629-0e1bb9866c29 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:06.379560 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8101672e-3dc9-4fbf-a50c-d75ac569d898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:06.380210 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8101672e-3dc9-4fbf-a50c-d75ac569d898 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:06.380587 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8101672e-3dc9-4fbf-a50c-d75ac569d898 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:06.381037 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8101672e-3dc9-4fbf-a50c-d75ac569d898 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:06.382235 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8101672e-3dc9-4fbf-a50c-d75ac569d898 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:06.383922 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8101672e-3dc9-4fbf-a50c-d75ac569d898 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:06.386772 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a767e0-64bc-4981-a01a-f7d33e3b777b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:06.388347 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a767e0-64bc-4981-a01a-f7d33e3b777b admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:06.388799 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a767e0-64bc-4981-a01a-f7d33e3b777b admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:06.389415 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a767e0-64bc-4981-a01a-f7d33e3b777b admin admin] PATH_INFO: `/v3/projects/fd52b7be13dc455baa5581f05d8dbb72/users/63fa6ba87a7a4827af4c5fbd4629b1c0/roles/8daabcb6b7394e39b06a3453e33e32db` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:06.401441 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 793/1597] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:03:06 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:03:06.402517 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8101672e-3dc9-4fbf-a50c-d75ac569d898 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:06.409112 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a767e0-64bc-4981-a01a-f7d33e3b777b admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd52b7be13dc455baa5581f05d8dbb72, user_id=63fa6ba87a7a4827af4c5fbd4629b1c0, role_id=8daabcb6b7394e39b06a3453e33e32db)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:06.412354 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a767e0-64bc-4981-a01a-f7d33e3b777b admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:06.414922 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8101672e-3dc9-4fbf-a50c-d75ac569d898 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:06.421502 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398ce739-5da5-45be-bf4b-94d5a0b05deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:06.422137 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398ce739-5da5-45be-bf4b-94d5a0b05deb admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:06.422531 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398ce739-5da5-45be-bf4b-94d5a0b05deb admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:06.422913 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398ce739-5da5-45be-bf4b-94d5a0b05deb admin admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:06.423653 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398ce739-5da5-45be-bf4b-94d5a0b05deb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:06.425873 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398ce739-5da5-45be-bf4b-94d5a0b05deb admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:06.436091 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 805/1598] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:03:06 2022] PUT /identity/v3/projects/fd52b7be13dc455baa5581f05d8dbb72/users/63fa6ba87a7a4827af4c5fbd4629b1c0/roles/8daabcb6b7394e39b06a3453e33e32db => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:03:06.436091 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a767e0-64bc-4981-a01a-f7d33e3b777b admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:06.459554 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 794/1599] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 10 10:03:06 2022] POST /identity/v3/projects => generated 379 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:03:06.460671 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398ce739-5da5-45be-bf4b-94d5a0b05deb admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:06.516912 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a767e0-64bc-4981-a01a-f7d33e3b777b admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:06.583140 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398ce739-5da5-45be-bf4b-94d5a0b05deb admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:06.592150 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c04b8f-ab5f-4b21-b186-c96a201f8379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:06.592780 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c04b8f-ab5f-4b21-b186-c96a201f8379 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:06.593090 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c04b8f-ab5f-4b21-b186-c96a201f8379 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:06.593443 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c04b8f-ab5f-4b21-b186-c96a201f8379 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:06.594114 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c04b8f-ab5f-4b21-b186-c96a201f8379 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:06.595755 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c04b8f-ab5f-4b21-b186-c96a201f8379 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:06.609368 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de038b4-8dbe-4760-a012-516a291e0231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:06.610474 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de038b4-8dbe-4760-a012-516a291e0231 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:06.610474 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de038b4-8dbe-4760-a012-516a291e0231 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:06.610714 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de038b4-8dbe-4760-a012-516a291e0231 admin admin] PATH_INFO: `/v3/projects/d06c35c130404b169a8260298860d478/users/677093fbd96e48a29fcabf7d07ce2354/roles/8daabcb6b7394e39b06a3453e33e32db` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:06.611186 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 795/1600] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:03:06 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:03:06.615672 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c04b8f-ab5f-4b21-b186-c96a201f8379 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:06.626764 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c04b8f-ab5f-4b21-b186-c96a201f8379 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:06.632605 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d8d6dc-6ac6-492f-aa5b-26ef0093c951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:06.633451 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d8d6dc-6ac6-492f-aa5b-26ef0093c951 admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:06.633747 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d8d6dc-6ac6-492f-aa5b-26ef0093c951 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:06.634032 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d8d6dc-6ac6-492f-aa5b-26ef0093c951 admin admin] PATH_INFO: `/v3/projects/a23a65853a7f427c923d0ee40079b9ec/users/ec9393db1a3841098f79ff5a6a493dc4/roles/8daabcb6b7394e39b06a3453e33e32db` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:06.638405 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de038b4-8dbe-4760-a012-516a291e0231 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d06c35c130404b169a8260298860d478, user_id=677093fbd96e48a29fcabf7d07ce2354, role_id=8daabcb6b7394e39b06a3453e33e32db)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:06.641511 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de038b4-8dbe-4760-a012-516a291e0231 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:06.661441 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d8d6dc-6ac6-492f-aa5b-26ef0093c951 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a23a65853a7f427c923d0ee40079b9ec, user_id=ec9393db1a3841098f79ff5a6a493dc4, role_id=8daabcb6b7394e39b06a3453e33e32db)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:06.662761 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 806/1601] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:03:06 2022] PUT /identity/v3/projects/d06c35c130404b169a8260298860d478/users/677093fbd96e48a29fcabf7d07ce2354/roles/8daabcb6b7394e39b06a3453e33e32db => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:03:06.663752 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de038b4-8dbe-4760-a012-516a291e0231 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:06.671514 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d8d6dc-6ac6-492f-aa5b-26ef0093c951 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:06.691561 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 796/1602] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:03:06 2022] PUT /identity/v3/projects/a23a65853a7f427c923d0ee40079b9ec/users/ec9393db1a3841098f79ff5a6a493dc4/roles/8daabcb6b7394e39b06a3453e33e32db => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:03:06.692427 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d8d6dc-6ac6-492f-aa5b-26ef0093c951 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:06.724590 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:06.823303 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de038b4-8dbe-4760-a012-516a291e0231 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:06.825619 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d8d6dc-6ac6-492f-aa5b-26ef0093c951 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:06.825619 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ee04b0-99b3-4296-ad15-657132173230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:06.825619 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ee04b0-99b3-4296-ad15-657132173230 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:06.825619 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ee04b0-99b3-4296-ad15-657132173230 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:06.826181 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ee04b0-99b3-4296-ad15-657132173230 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:06.826181 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ee04b0-99b3-4296-ad15-657132173230 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:06.826181 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ee04b0-99b3-4296-ad15-657132173230 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:06.837841 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 797/1603] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:03:06 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:03:06.839923 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c31f32-65d6-4baf-a84e-c89837fb1945 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:06.843142 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c31f32-65d6-4baf-a84e-c89837fb1945 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:06.843675 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c31f32-65d6-4baf-a84e-c89837fb1945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:06.879135 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-17c31f32-65d6-4baf-a84e-c89837fb1945 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:03:06.880963 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-17c31f32-65d6-4baf-a84e-c89837fb1945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:06.881135 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac83ef2-2f02-4804-974d-d181887362e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:06.881734 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac83ef2-2f02-4804-974d-d181887362e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:06.882013 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac83ef2-2f02-4804-974d-d181887362e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:06.882282 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac83ef2-2f02-4804-974d-d181887362e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:06.882935 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac83ef2-2f02-4804-974d-d181887362e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:06.884548 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac83ef2-2f02-4804-974d-d181887362e3 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:06.892163 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 798/1604] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:03:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:03:06.893563 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c31f32-65d6-4baf-a84e-c89837fb1945 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:06.899509 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 807/1605] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:03:06 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:03:06.900447 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac83ef2-2f02-4804-974d-d181887362e3 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:06.912927 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c31f32-65d6-4baf-a84e-c89837fb1945 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:06.913333 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac83ef2-2f02-4804-974d-d181887362e3 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:06.918276 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01423460-cbfb-4daa-b81c-ebda0df29f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:06.918910 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01423460-cbfb-4daa-b81c-ebda0df29f67 admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:06.919183 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01423460-cbfb-4daa-b81c-ebda0df29f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:06.919380 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9649d454-14bb-49d3-a14c-8ee988a3bca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:06.919515 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01423460-cbfb-4daa-b81c-ebda0df29f67 admin admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:06.920079 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01423460-cbfb-4daa-b81c-ebda0df29f67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:06.920602 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9649d454-14bb-49d3-a14c-8ee988a3bca9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:06.921036 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9649d454-14bb-49d3-a14c-8ee988a3bca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:06.921493 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9649d454-14bb-49d3-a14c-8ee988a3bca9 admin admin] PATH_INFO: `/v3/projects/280beb1b4fa14c4fa1bcd004d2636f9f/users/12ab797c80e347d6931c4d7294a14f7b/roles/8daabcb6b7394e39b06a3453e33e32db` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:06.922095 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01423460-cbfb-4daa-b81c-ebda0df29f67 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:06.947951 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9649d454-14bb-49d3-a14c-8ee988a3bca9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=280beb1b4fa14c4fa1bcd004d2636f9f, user_id=12ab797c80e347d6931c4d7294a14f7b, role_id=8daabcb6b7394e39b06a3453e33e32db)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:06.953722 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9649d454-14bb-49d3-a14c-8ee988a3bca9 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:06.953947 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 799/1606] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 10 10:03:06 2022] POST /identity/v3/users => generated 296 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:03:06.953947 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2b7d52-cb03-48b4-a084-722e83b64469 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:06.953947 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2b7d52-cb03-48b4-a084-722e83b64469 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:06.953947 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2b7d52-cb03-48b4-a084-722e83b64469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:06.966013 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:06.969299 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 808/1607] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:03:06 2022] PUT /identity/v3/projects/280beb1b4fa14c4fa1bcd004d2636f9f/users/12ab797c80e347d6931c4d7294a14f7b/roles/8daabcb6b7394e39b06a3453e33e32db => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:03:06.981022 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1ed86a-1de4-4c56-b4cf-db239bfc50e5 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:06.981022 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1ed86a-1de4-4c56-b4cf-db239bfc50e5 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:06.981022 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1ed86a-1de4-4c56-b4cf-db239bfc50e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:06.996659 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-fd2b7d52-cb03-48b4-a084-722e83b64469 None None] MFA Rules not processed for user `677093fbd96e48a29fcabf7d07ce2354`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:03:06.998148 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-fd2b7d52-cb03-48b4-a084-722e83b64469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:07.001256 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-8b1ed86a-1de4-4c56-b4cf-db239bfc50e5 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:03:07.002457 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-8b1ed86a-1de4-4c56-b4cf-db239bfc50e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:07.068975 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 809/1608] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:03:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:03:07.069975 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1ed86a-1de4-4c56-b4cf-db239bfc50e5 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:07.080295 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1ed86a-1de4-4c56-b4cf-db239bfc50e5 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:07.085412 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a9ccdc-643a-4aa1-9479-723fb30333e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:07.086010 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a9ccdc-643a-4aa1-9479-723fb30333e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:07.086285 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a9ccdc-643a-4aa1-9479-723fb30333e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:07.086556 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a9ccdc-643a-4aa1-9479-723fb30333e3 admin admin] PATH_INFO: `/v3/projects/99e9eaf6df5c43b4940b5170bf4df807/users/b31867851fa74de5a57a6ea1ef4b79bc/roles/8daabcb6b7394e39b06a3453e33e32db` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:07.091021 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 800/1609] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:03:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:03:07.092320 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2b7d52-cb03-48b4-a084-722e83b64469 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:07.093860 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-fd2b7d52-cb03-48b4-a084-722e83b64469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:07.103600 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a9ccdc-643a-4aa1-9479-723fb30333e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99e9eaf6df5c43b4940b5170bf4df807, user_id=b31867851fa74de5a57a6ea1ef4b79bc, role_id=8daabcb6b7394e39b06a3453e33e32db)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:07.106479 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a9ccdc-643a-4aa1-9479-723fb30333e3 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:07.124931 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 810/1610] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:03:07 2022] PUT /identity/v3/projects/99e9eaf6df5c43b4940b5170bf4df807/users/b31867851fa74de5a57a6ea1ef4b79bc/roles/8daabcb6b7394e39b06a3453e33e32db => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:03:07.125888 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a9ccdc-643a-4aa1-9479-723fb30333e3 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:07.173126 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:07.176051 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2b7d52-cb03-48b4-a084-722e83b64469 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:07.216894 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a9ccdc-643a-4aa1-9479-723fb30333e3 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:07.223411 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dcf5c3-2451-4bb5-a1d1-ae9eded520f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:07.224122 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dcf5c3-2451-4bb5-a1d1-ae9eded520f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:07.224398 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dcf5c3-2451-4bb5-a1d1-ae9eded520f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:07.224671 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dcf5c3-2451-4bb5-a1d1-ae9eded520f2 admin admin] PATH_INFO: `/v3/projects/395bed1440b44404bbc7e0ef11836f12/users/05de322f3f174bc195a58a108c9387da/roles/8daabcb6b7394e39b06a3453e33e32db` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:07.240856 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bfad5a-d854-4310-8a82-9dc95f4579df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4294c170df354fe892831281acd4ea7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:07.241523 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bfad5a-d854-4310-8a82-9dc95f4579df service neutron] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:07.241810 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bfad5a-d854-4310-8a82-9dc95f4579df service neutron] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:07.242087 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bfad5a-d854-4310-8a82-9dc95f4579df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:07.242963 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dcf5c3-2451-4bb5-a1d1-ae9eded520f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=395bed1440b44404bbc7e0ef11836f12, user_id=05de322f3f174bc195a58a108c9387da, role_id=8daabcb6b7394e39b06a3453e33e32db)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:07.245767 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dcf5c3-2451-4bb5-a1d1-ae9eded520f2 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:07.253511 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bfad5a-d854-4310-8a82-9dc95f4579df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:07.255002 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bfad5a-d854-4310-8a82-9dc95f4579df service neutron] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:07.263546 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 811/1611] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:03:07 2022] PUT /identity/v3/projects/395bed1440b44404bbc7e0ef11836f12/users/05de322f3f174bc195a58a108c9387da/roles/8daabcb6b7394e39b06a3453e33e32db => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:03:07.264625 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dcf5c3-2451-4bb5-a1d1-ae9eded520f2 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:07.265337 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 801/1612] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:03:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:03:07.274928 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b8b3b9-f48f-4b66-ad40-13358a119162 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:07.275392 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b8b3b9-f48f-4b66-ad40-13358a119162 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:07.277298 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b8b3b9-f48f-4b66-ad40-13358a119162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:07.324168 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-b9b8b3b9-f48f-4b66-ad40-13358a119162 None None] MFA Rules not processed for user `12ab797c80e347d6931c4d7294a14f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:03:07.325526 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-b9b8b3b9-f48f-4b66-ad40-13358a119162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:07.379456 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dcf5c3-2451-4bb5-a1d1-ae9eded520f2 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:07.395547 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bcca81-7c1f-45e2-be53-59b00fd75882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:07.396213 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bcca81-7c1f-45e2-be53-59b00fd75882 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:07.396612 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bcca81-7c1f-45e2-be53-59b00fd75882 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:07.396846 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bcca81-7c1f-45e2-be53-59b00fd75882 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:07.397455 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bcca81-7c1f-45e2-be53-59b00fd75882 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:07.405280 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bcca81-7c1f-45e2-be53-59b00fd75882 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:07.439627 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 812/1613] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:03:07 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:03:07.440765 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bcca81-7c1f-45e2-be53-59b00fd75882 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:07.448239 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:07.504560 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 802/1614] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:03:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:03:07.514324 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bcca81-7c1f-45e2-be53-59b00fd75882 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:07.519665 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d10346c-e5fc-454a-96b4-3570de756e0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4294c170df354fe892831281acd4ea7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:07.520618 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d10346c-e5fc-454a-96b4-3570de756e0f service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:07.520817 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a0afb-8516-4308-9d02-8f92e7fe8a55 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:07.521133 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a0afb-8516-4308-9d02-8f92e7fe8a55 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:07.521467 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d10346c-e5fc-454a-96b4-3570de756e0f service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:07.521906 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d10346c-e5fc-454a-96b4-3570de756e0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:07.522481 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a0afb-8516-4308-9d02-8f92e7fe8a55 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:07.530973 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 803/1615] 10.222.0.27 () {54 vars in 962 bytes} [Wed Aug 10 10:03:07 2022] GET /identity => generated 270 bytes in 26 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:03:07.532387 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2618d9-1d82-46d3-ad5a-ee55eb06545b None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:07.535473 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2618d9-1d82-46d3-ad5a-ee55eb06545b None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:07.535975 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2618d9-1d82-46d3-ad5a-ee55eb06545b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:07.536693 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d10346c-e5fc-454a-96b4-3570de756e0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:07.538349 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d10346c-e5fc-454a-96b4-3570de756e0f service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:07.568735 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 813/1616] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:03:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:03:07.570224 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6756e17a-bb3c-4450-a67d-5f74fc5f458a None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:07.570928 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6756e17a-bb3c-4450-a67d-5f74fc5f458a None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:07.571369 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6756e17a-bb3c-4450-a67d-5f74fc5f458a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:07.592858 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-6756e17a-bb3c-4450-a67d-5f74fc5f458a None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:03:07.594042 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-6756e17a-bb3c-4450-a67d-5f74fc5f458a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:07.595818 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-3e2618d9-1d82-46d3-ad5a-ee55eb06545b None None] MFA Rules not processed for user `b31867851fa74de5a57a6ea1ef4b79bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:03:07.597253 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-3e2618d9-1d82-46d3-ad5a-ee55eb06545b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:07.602978 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 814/1617] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:03:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:03:07.603962 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6756e17a-bb3c-4450-a67d-5f74fc5f458a None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:07.619857 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6756e17a-bb3c-4450-a67d-5f74fc5f458a None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:07.631987 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c33d1f-de37-420b-aa23-e0add44b87a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:07.632878 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c33d1f-de37-420b-aa23-e0add44b87a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:07.633186 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c33d1f-de37-420b-aa23-e0add44b87a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:07.633466 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c33d1f-de37-420b-aa23-e0add44b87a3 admin admin] PATH_INFO: `/v3/projects/25b9cf09383f40469d04f8ebb88adf58/users/3d4b0ba6420749a394ead08906c89a72/roles/eb04edc46b3742d7a0f0ead26f68bc22` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:07.651036 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c33d1f-de37-420b-aa23-e0add44b87a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25b9cf09383f40469d04f8ebb88adf58, user_id=3d4b0ba6420749a394ead08906c89a72, role_id=eb04edc46b3742d7a0f0ead26f68bc22)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:07.654132 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c33d1f-de37-420b-aa23-e0add44b87a3 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:07.700991 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 815/1618] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:03:07 2022] PUT /identity/v3/projects/25b9cf09383f40469d04f8ebb88adf58/users/3d4b0ba6420749a394ead08906c89a72/roles/eb04edc46b3742d7a0f0ead26f68bc22 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:03:07.702430 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570525aa-a98e-4773-9123-17b7a8537d04 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:07.702722 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570525aa-a98e-4773-9123-17b7a8537d04 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:07.705518 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 804/1619] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:03:07 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:03:07.707471 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de377f0-bc3a-4069-915f-ebb88440a5b9 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:07.708377 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de377f0-bc3a-4069-915f-ebb88440a5b9 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:07.708891 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de377f0-bc3a-4069-915f-ebb88440a5b9 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:07.716524 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570525aa-a98e-4773-9123-17b7a8537d04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:07.718118 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 805/1620] 10.222.0.27 () {54 vars in 962 bytes} [Wed Aug 10 10:03:07 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:03:07.719344 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de377f0-bc3a-4069-915f-ebb88440a5b9 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:07.779922 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:07.787916 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-570525aa-a98e-4773-9123-17b7a8537d04 None None] MFA Rules not processed for user `dd8580888cba41a88566da4540b1130c`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:03:07.793826 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-570525aa-a98e-4773-9123-17b7a8537d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:07.858179 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de377f0-bc3a-4069-915f-ebb88440a5b9 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:07.868850 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddcd1e7-b9b2-48e3-9da0-b41f80c2f216 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4294c170df354fe892831281acd4ea7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:07.871223 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddcd1e7-b9b2-48e3-9da0-b41f80c2f216 service neutron] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:07.872015 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddcd1e7-b9b2-48e3-9da0-b41f80c2f216 service neutron] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:07.872932 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddcd1e7-b9b2-48e3-9da0-b41f80c2f216 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:07.925316 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 816/1621] 10.222.0.27 () {58 vars in 1059 bytes} [Wed Aug 10 10:03:07 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:03:07.928241 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570525aa-a98e-4773-9123-17b7a8537d04 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:08.015325 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddcd1e7-b9b2-48e3-9da0-b41f80c2f216 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:08.019121 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddcd1e7-b9b2-48e3-9da0-b41f80c2f216 service neutron] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:08.042244 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 806/1622] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:03:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:03:08.044179 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddcd1e7-b9b2-48e3-9da0-b41f80c2f216 service neutron] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:08.065811 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddcd1e7-b9b2-48e3-9da0-b41f80c2f216 service neutron] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:08.070186 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570525aa-a98e-4773-9123-17b7a8537d04 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:08.078258 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9613c05-54e0-4354-a45b-7b1119d83c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:08.080395 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9613c05-54e0-4354-a45b-7b1119d83c3b admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:08.080681 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9613c05-54e0-4354-a45b-7b1119d83c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:08.080959 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9613c05-54e0-4354-a45b-7b1119d83c3b admin admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:08.082538 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9613c05-54e0-4354-a45b-7b1119d83c3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:08.084908 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8238d657-b5e5-4753-8b0e-3d6b9e192fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:08.085728 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8238d657-b5e5-4753-8b0e-3d6b9e192fb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:08.086016 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8238d657-b5e5-4753-8b0e-3d6b9e192fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:08.086290 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8238d657-b5e5-4753-8b0e-3d6b9e192fb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:08.088299 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9613c05-54e0-4354-a45b-7b1119d83c3b admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:08.089381 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8238d657-b5e5-4753-8b0e-3d6b9e192fb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:08.092214 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8238d657-b5e5-4753-8b0e-3d6b9e192fb4 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:08.116445 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 817/1623] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:03:07 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:03:08.120107 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5750bb37-43c5-40a2-a016-73cbcacb3dc2 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:08.120107 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5750bb37-43c5-40a2-a016-73cbcacb3dc2 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:08.120107 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5750bb37-43c5-40a2-a016-73cbcacb3dc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:08.139705 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:08.153835 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 807/1624] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 10 10:03:08 2022] POST /identity/v3/projects => generated 357 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:03:08.154982 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9613c05-54e0-4354-a45b-7b1119d83c3b admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:08.187966 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-5750bb37-43c5-40a2-a016-73cbcacb3dc2 None None] MFA Rules not processed for user `dd8580888cba41a88566da4540b1130c`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:03:08.192650 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-5750bb37-43c5-40a2-a016-73cbcacb3dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:08.349043 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9613c05-54e0-4354-a45b-7b1119d83c3b admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:08.370235 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 818/1625] 10.222.0.27 () {58 vars in 1059 bytes} [Wed Aug 10 10:03:08 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:03:08.371821 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5750bb37-43c5-40a2-a016-73cbcacb3dc2 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:08.372317 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac5edca-3e9d-4d8c-9fab-ad26e3ff4388 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd8580888cba41a88566da4540b1130c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:08.373007 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac5edca-3e9d-4d8c-9fab-ad26e3ff4388 service nova] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:08.373412 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac5edca-3e9d-4d8c-9fab-ad26e3ff4388 service nova] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:08.373783 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac5edca-3e9d-4d8c-9fab-ad26e3ff4388 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:08.443429 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:08.472904 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac5edca-3e9d-4d8c-9fab-ad26e3ff4388 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:08.474595 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac5edca-3e9d-4d8c-9fab-ad26e3ff4388 service nova] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:08.518872 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 808/1626] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:03:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:03:08.519994 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac5edca-3e9d-4d8c-9fab-ad26e3ff4388 service nova] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:08.537650 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5750bb37-43c5-40a2-a016-73cbcacb3dc2 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:08.543795 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac5edca-3e9d-4d8c-9fab-ad26e3ff4388 service nova] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:08.562008 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693c64f7-085f-4feb-9758-18f7962210ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:08.562710 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693c64f7-085f-4feb-9758-18f7962210ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:08.562990 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693c64f7-085f-4feb-9758-18f7962210ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:08.563259 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693c64f7-085f-4feb-9758-18f7962210ed admin admin] PATH_INFO: `/v3/projects/25b9cf09383f40469d04f8ebb88adf58/users/3d4b0ba6420749a394ead08906c89a72/roles/eb04edc46b3742d7a0f0ead26f68bc22` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:08.566332 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29383a7a-e094-40bf-99b6-57769e92c1a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:08.568000 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29383a7a-e094-40bf-99b6-57769e92c1a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:08.575354 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693c64f7-085f-4feb-9758-18f7962210ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=25b9cf09383f40469d04f8ebb88adf58, user_id=3d4b0ba6420749a394ead08906c89a72, role_id=eb04edc46b3742d7a0f0ead26f68bc22)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:08.576914 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29383a7a-e094-40bf-99b6-57769e92c1a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:08.578063 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693c64f7-085f-4feb-9758-18f7962210ed admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:08.578467 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29383a7a-e094-40bf-99b6-57769e92c1a7 admin admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:08.583142 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29383a7a-e094-40bf-99b6-57769e92c1a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:08.588708 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29383a7a-e094-40bf-99b6-57769e92c1a7 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:08.616729 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 819/1627] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:03:08 2022] PUT /identity/v3/projects/25b9cf09383f40469d04f8ebb88adf58/users/3d4b0ba6420749a394ead08906c89a72/roles/eb04edc46b3742d7a0f0ead26f68bc22 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:03:08.618296 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693c64f7-085f-4feb-9758-18f7962210ed admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:08.636617 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 809/1628] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 10 10:03:08 2022] POST /identity/v3/users => generated 285 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:03:08.641595 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a79f821-120a-4fc3-a954-7d9642ffadbe None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:08.644822 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a79f821-120a-4fc3-a954-7d9642ffadbe None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:08.646177 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a79f821-120a-4fc3-a954-7d9642ffadbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:08.718885 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-1a79f821-120a-4fc3-a954-7d9642ffadbe None None] MFA Rules not processed for user `3d4b0ba6420749a394ead08906c89a72`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:03:08.720609 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-1a79f821-120a-4fc3-a954-7d9642ffadbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:08.782232 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693c64f7-085f-4feb-9758-18f7962210ed admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:08.790028 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ae8543-7b74-44c2-9ada-7801ce6e0b8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd8580888cba41a88566da4540b1130c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:08.790642 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ae8543-7b74-44c2-9ada-7801ce6e0b8c service nova] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:08.790921 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ae8543-7b74-44c2-9ada-7801ce6e0b8c service nova] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:08.791205 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ae8543-7b74-44c2-9ada-7801ce6e0b8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:08.889913 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 810/1629] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:03:08 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:03:08.890971 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a79f821-120a-4fc3-a954-7d9642ffadbe None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:08.899526 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:08.928753 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ae8543-7b74-44c2-9ada-7801ce6e0b8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:08.930703 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ae8543-7b74-44c2-9ada-7801ce6e0b8c service nova] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:08.947131 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 820/1630] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:03:08 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:03:08.947838 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ae8543-7b74-44c2-9ada-7801ce6e0b8c service nova] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:09.007473 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a79f821-120a-4fc3-a954-7d9642ffadbe None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:09.016798 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72534767-3d41-4d5c-8586-cd82f41df91c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:09.018627 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72534767-3d41-4d5c-8586-cd82f41df91c admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:09.020230 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72534767-3d41-4d5c-8586-cd82f41df91c admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:09.020718 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72534767-3d41-4d5c-8586-cd82f41df91c admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:09.023094 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72534767-3d41-4d5c-8586-cd82f41df91c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:09.027295 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72534767-3d41-4d5c-8586-cd82f41df91c admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:09.065006 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ae8543-7b74-44c2-9ada-7801ce6e0b8c service nova] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:09.065596 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 811/1631] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:03:08 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:03:09.066840 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72534767-3d41-4d5c-8586-cd82f41df91c admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:09.075977 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebce7636-07ad-4126-81ad-8c9f579502de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf8e725cbe0403d943b136235eac057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:09.076631 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebce7636-07ad-4126-81ad-8c9f579502de service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:09.076888 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebce7636-07ad-4126-81ad-8c9f579502de service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:09.077188 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebce7636-07ad-4126-81ad-8c9f579502de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:09.093221 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72534767-3d41-4d5c-8586-cd82f41df91c admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:09.095387 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebce7636-07ad-4126-81ad-8c9f579502de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:09.096869 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebce7636-07ad-4126-81ad-8c9f579502de service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:09.106221 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:09.110850 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860d28d6-20ab-4b1c-84b8-4d810500e025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:09.113468 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d28d6-20ab-4b1c-84b8-4d810500e025 admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:09.113969 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d28d6-20ab-4b1c-84b8-4d810500e025 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:09.116565 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d28d6-20ab-4b1c-84b8-4d810500e025 admin admin] PATH_INFO: `/v3/projects/4c61853d79104ce2a296ca45b2f80ee7/users/b3a274c8380a481baed98092a789c9d0/roles/eb04edc46b3742d7a0f0ead26f68bc22` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:09.134312 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 821/1632] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:03:08 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:03:09.157240 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860d28d6-20ab-4b1c-84b8-4d810500e025 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c61853d79104ce2a296ca45b2f80ee7, user_id=b3a274c8380a481baed98092a789c9d0, role_id=eb04edc46b3742d7a0f0ead26f68bc22)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:09.165171 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860d28d6-20ab-4b1c-84b8-4d810500e025 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:09.184192 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5b8488-4bb0-4b64-b295-f21b93b5b5a0 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:09.184706 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5b8488-4bb0-4b64-b295-f21b93b5b5a0 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:09.185156 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5b8488-4bb0-4b64-b295-f21b93b5b5a0 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:09.186975 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 822/1633] 10.222.0.27 () {54 vars in 912 bytes} [Wed Aug 10 10:03:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:03:09.193446 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4facdc-f031-424b-a688-b6afba81f63b None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:09.194044 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4facdc-f031-424b-a688-b6afba81f63b None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:09.194469 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4facdc-f031-424b-a688-b6afba81f63b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:09.200840 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 812/1634] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:03:09 2022] PUT /identity/v3/projects/4c61853d79104ce2a296ca45b2f80ee7/users/b3a274c8380a481baed98092a789c9d0/roles/eb04edc46b3742d7a0f0ead26f68bc22 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:03:09.202036 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860d28d6-20ab-4b1c-84b8-4d810500e025 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:09.229961 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-1f4facdc-f031-424b-a688-b6afba81f63b None None] MFA Rules not processed for user `dd8580888cba41a88566da4540b1130c`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:03:09.233108 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-1f4facdc-f031-424b-a688-b6afba81f63b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:09.392449 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860d28d6-20ab-4b1c-84b8-4d810500e025 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:09.407680 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 823/1635] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Aug 10 10:03:09 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:03:09.407881 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63507bb-6ac0-4613-8aeb-0bd727d4fc39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:09.408596 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63507bb-6ac0-4613-8aeb-0bd727d4fc39 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:09.409234 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4facdc-f031-424b-a688-b6afba81f63b None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:09.411408 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63507bb-6ac0-4613-8aeb-0bd727d4fc39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:09.411760 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63507bb-6ac0-4613-8aeb-0bd727d4fc39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:09.412577 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63507bb-6ac0-4613-8aeb-0bd727d4fc39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:09.415292 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63507bb-6ac0-4613-8aeb-0bd727d4fc39 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:09.465043 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 813/1636] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:03:09 2022] GET /identity/v3/roles => generated 1420 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:03:09.466242 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63507bb-6ac0-4613-8aeb-0bd727d4fc39 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:09.509045 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4facdc-f031-424b-a688-b6afba81f63b None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:09.516079 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9f7e67-a925-4ca5-9e41-bdfa1cc8751f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf8e725cbe0403d943b136235eac057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:09.517017 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f7e67-a925-4ca5-9e41-bdfa1cc8751f service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:09.517679 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f7e67-a925-4ca5-9e41-bdfa1cc8751f service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:09.518168 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f7e67-a925-4ca5-9e41-bdfa1cc8751f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:09.620339 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9f7e67-a925-4ca5-9e41-bdfa1cc8751f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:09.622259 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9f7e67-a925-4ca5-9e41-bdfa1cc8751f service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:09.641886 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63507bb-6ac0-4613-8aeb-0bd727d4fc39 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:09.657500 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda68894-8b97-48a3-8f5d-fe33e3edd47a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf8e725cbe0403d943b136235eac057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:09.658227 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda68894-8b97-48a3-8f5d-fe33e3edd47a service cinder] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:09.658513 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda68894-8b97-48a3-8f5d-fe33e3edd47a service cinder] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:09.658862 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda68894-8b97-48a3-8f5d-fe33e3edd47a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:09.659163 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 824/1637] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:03:09 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:03:09.660836 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9f7e67-a925-4ca5-9e41-bdfa1cc8751f service cinder] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:09.684465 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda68894-8b97-48a3-8f5d-fe33e3edd47a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:09.691982 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda68894-8b97-48a3-8f5d-fe33e3edd47a service cinder] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:09.699460 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9f7e67-a925-4ca5-9e41-bdfa1cc8751f service cinder] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:09.716435 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 814/1638] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:03:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:03:09.734423 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870566e7-1357-44ca-8994-684476f223d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:09.736685 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870566e7-1357-44ca-8994-684476f223d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:09.739392 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870566e7-1357-44ca-8994-684476f223d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:09.740796 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870566e7-1357-44ca-8994-684476f223d0 admin admin] PATH_INFO: `/v3/projects/4c61853d79104ce2a296ca45b2f80ee7/users/b3a274c8380a481baed98092a789c9d0/roles/eb04edc46b3742d7a0f0ead26f68bc22` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:09.753233 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870566e7-1357-44ca-8994-684476f223d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c61853d79104ce2a296ca45b2f80ee7, user_id=b3a274c8380a481baed98092a789c9d0, role_id=eb04edc46b3742d7a0f0ead26f68bc22)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:09.770226 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870566e7-1357-44ca-8994-684476f223d0 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:09.771221 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca6b02-3c04-4a88-bef5-c2632fc137a1 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:09.771612 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca6b02-3c04-4a88-bef5-c2632fc137a1 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:09.771896 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca6b02-3c04-4a88-bef5-c2632fc137a1 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:09.773907 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 815/1639] 10.222.0.27 () {54 vars in 912 bytes} [Wed Aug 10 10:03:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:03:09.786988 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bb653e-b1b4-4e95-9792-31bf4d369ece None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:09.787343 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bb653e-b1b4-4e95-9792-31bf4d369ece None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:09.787684 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bb653e-b1b4-4e95-9792-31bf4d369ece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:09.817435 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 825/1640] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:03:09 2022] PUT /identity/v3/projects/4c61853d79104ce2a296ca45b2f80ee7/users/b3a274c8380a481baed98092a789c9d0/roles/eb04edc46b3742d7a0f0ead26f68bc22 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:03:09.827963 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5c0833-e2ad-4505-91f5-06753841a449 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:09.828245 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5c0833-e2ad-4505-91f5-06753841a449 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:09.828567 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5c0833-e2ad-4505-91f5-06753841a449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:09.841997 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-b5bb653e-b1b4-4e95-9792-31bf4d369ece None None] MFA Rules not processed for user `dd8580888cba41a88566da4540b1130c`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:03:09.843349 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-b5bb653e-b1b4-4e95-9792-31bf4d369ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:09.869815 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:09.889221 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-7a5c0833-e2ad-4505-91f5-06753841a449 None None] MFA Rules not processed for user `b3a274c8380a481baed98092a789c9d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:03:09.894837 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-7a5c0833-e2ad-4505-91f5-06753841a449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:09.944768 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:10.003900 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 816/1641] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Aug 10 10:03:09 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:03:10.061883 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 826/1642] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:03:09 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 10:03:10.120508 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bb653e-b1b4-4e95-9792-31bf4d369ece None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:10.271658 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bb653e-b1b4-4e95-9792-31bf4d369ece None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:10.288454 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0310c47-76d3-4702-95c5-56223f3c16fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf8e725cbe0403d943b136235eac057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:10.289663 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0310c47-76d3-4702-95c5-56223f3c16fb service cinder] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:10.289663 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0310c47-76d3-4702-95c5-56223f3c16fb service cinder] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:10.289905 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0310c47-76d3-4702-95c5-56223f3c16fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:10.320556 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0310c47-76d3-4702-95c5-56223f3c16fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:10.321923 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0310c47-76d3-4702-95c5-56223f3c16fb service cinder] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:10.353050 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 817/1643] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:03:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:03:10.560102 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5c0833-e2ad-4505-91f5-06753841a449 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:10.573813 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5c0833-e2ad-4505-91f5-06753841a449 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:10.582646 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c6ca57-d386-45df-bac5-1e282b57e1d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf8e725cbe0403d943b136235eac057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:10.583272 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c6ca57-d386-45df-bac5-1e282b57e1d1 service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:10.583640 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c6ca57-d386-45df-bac5-1e282b57e1d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:10.583933 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c6ca57-d386-45df-bac5-1e282b57e1d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:10.597600 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c6ca57-d386-45df-bac5-1e282b57e1d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:10.598935 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c6ca57-d386-45df-bac5-1e282b57e1d1 service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:10.613161 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 827/1644] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:03:10 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:03:11.011403 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0310c47-76d3-4702-95c5-56223f3c16fb service cinder] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:11.032378 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0310c47-76d3-4702-95c5-56223f3c16fb service cinder] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:11.043038 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0982461-c375-4a80-9699-18c497ca533f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf8e725cbe0403d943b136235eac057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:11.044029 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0982461-c375-4a80-9699-18c497ca533f service cinder] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:11.044467 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0982461-c375-4a80-9699-18c497ca533f service cinder] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:11.046039 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0982461-c375-4a80-9699-18c497ca533f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:11.144772 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0982461-c375-4a80-9699-18c497ca533f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:11.146337 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0982461-c375-4a80-9699-18c497ca533f service cinder] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:11.160993 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 818/1645] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:03:11 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:03:11.498069 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c6ca57-d386-45df-bac5-1e282b57e1d1 service cinder] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:11.698680 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c6ca57-d386-45df-bac5-1e282b57e1d1 service cinder] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:11.713509 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3225794f-9f33-4baf-a7ec-50d06cb4bfe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:11.714200 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3225794f-9f33-4baf-a7ec-50d06cb4bfe7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:11.714475 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3225794f-9f33-4baf-a7ec-50d06cb4bfe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:11.715713 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3225794f-9f33-4baf-a7ec-50d06cb4bfe7 admin admin] PATH_INFO: `/v3/users/12ab797c80e347d6931c4d7294a14f7b` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:11.719292 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3225794f-9f33-4baf-a7ec-50d06cb4bfe7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12ab797c80e347d6931c4d7294a14f7b)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:11.721461 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3225794f-9f33-4baf-a7ec-50d06cb4bfe7 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:11.867067 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-3225794f-9f33-4baf-a7ec-50d06cb4bfe7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12ab797c80e347d6931c4d7294a14f7b'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:11.905596 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-3225794f-9f33-4baf-a7ec-50d06cb4bfe7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12ab797c80e347d6931c4d7294a14f7b'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:11.926735 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-3225794f-9f33-4baf-a7ec-50d06cb4bfe7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12ab797c80e347d6931c4d7294a14f7b'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:11.929318 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-3225794f-9f33-4baf-a7ec-50d06cb4bfe7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12ab797c80e347d6931c4d7294a14f7b'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:11.970990 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-3225794f-9f33-4baf-a7ec-50d06cb4bfe7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12ab797c80e347d6931c4d7294a14f7b'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:12.003569 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af97c5b6-b15f-4183-821f-6fbb60684f48 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:12.004850 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af97c5b6-b15f-4183-821f-6fbb60684f48 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:12.005585 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af97c5b6-b15f-4183-821f-6fbb60684f48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:12.008004 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 828/1646] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 10 10:03:11 2022] DELETE /identity/v3/users/12ab797c80e347d6931c4d7294a14f7b => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:03:12.042229 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-af97c5b6-b15f-4183-821f-6fbb60684f48 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:03:12.043722 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-af97c5b6-b15f-4183-821f-6fbb60684f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:12.173480 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:12.217330 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 819/1647] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:03:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:03:12.297974 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3225794f-9f33-4baf-a7ec-50d06cb4bfe7 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:12.300076 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-3225794f-9f33-4baf-a7ec-50d06cb4bfe7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:12.370111 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:12.487042 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3225794f-9f33-4baf-a7ec-50d06cb4bfe7 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:12.496980 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d3ac91-fe57-41ab-bb99-98ed34d6b5d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4294c170df354fe892831281acd4ea7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:12.498281 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d3ac91-fe57-41ab-bb99-98ed34d6b5d4 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:12.498778 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d3ac91-fe57-41ab-bb99-98ed34d6b5d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:12.499512 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d3ac91-fe57-41ab-bb99-98ed34d6b5d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:12.516567 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d3ac91-fe57-41ab-bb99-98ed34d6b5d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:12.518870 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d3ac91-fe57-41ab-bb99-98ed34d6b5d4 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:12.546489 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 829/1648] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:03:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:03:14.606522 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af97c5b6-b15f-4183-821f-6fbb60684f48 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:14.608568 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-af97c5b6-b15f-4183-821f-6fbb60684f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:14.636292 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af97c5b6-b15f-4183-821f-6fbb60684f48 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:14.650991 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ff7247-f5aa-4f7b-9bd1-7cfcce279634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:14.653229 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ff7247-f5aa-4f7b-9bd1-7cfcce279634 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:14.653591 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ff7247-f5aa-4f7b-9bd1-7cfcce279634 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:14.657182 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ff7247-f5aa-4f7b-9bd1-7cfcce279634 admin admin] PATH_INFO: `/v3/users/677093fbd96e48a29fcabf7d07ce2354` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:14.672152 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ff7247-f5aa-4f7b-9bd1-7cfcce279634 admin admin] RBAC: Authorizing `identity:delete_user(user_id=677093fbd96e48a29fcabf7d07ce2354)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:14.673803 dv-cinder-850836-5-smb devstack@keystone.service[80232]: WARNING py.warnings [None req-39ff7247-f5aa-4f7b-9bd1-7cfcce279634 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 10:03:14.673803 dv-cinder-850836-5-smb devstack@keystone.service[80232]: warnings.warn(msg) Aug 10 10:03:14.673803 dv-cinder-850836-5-smb devstack@keystone.service[80232]: Aug 10 10:03:14.682283 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ff7247-f5aa-4f7b-9bd1-7cfcce279634 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:14.722794 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d29356-3c18-4561-98ae-b45c23bda5f8 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:14.723690 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d29356-3c18-4561-98ae-b45c23bda5f8 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:14.724087 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d29356-3c18-4561-98ae-b45c23bda5f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:14.810854 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-91d29356-3c18-4561-98ae-b45c23bda5f8 None None] MFA Rules not processed for user `3027050c9e124590971f3930146522d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:03:14.812117 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-91d29356-3c18-4561-98ae-b45c23bda5f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:14.905630 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-39ff7247-f5aa-4f7b-9bd1-7cfcce279634 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '677093fbd96e48a29fcabf7d07ce2354'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:14.959137 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-39ff7247-f5aa-4f7b-9bd1-7cfcce279634 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '677093fbd96e48a29fcabf7d07ce2354'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:14.993389 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-39ff7247-f5aa-4f7b-9bd1-7cfcce279634 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '677093fbd96e48a29fcabf7d07ce2354'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:14.994092 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-39ff7247-f5aa-4f7b-9bd1-7cfcce279634 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '677093fbd96e48a29fcabf7d07ce2354'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:14.994885 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-39ff7247-f5aa-4f7b-9bd1-7cfcce279634 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '677093fbd96e48a29fcabf7d07ce2354'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:15.040520 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 830/1649] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:03:14 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 10:03:15.043044 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d29356-3c18-4561-98ae-b45c23bda5f8 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:15.052102 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-91d29356-3c18-4561-98ae-b45c23bda5f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:15.066379 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 820/1650] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 10 10:03:14 2022] DELETE /identity/v3/users/677093fbd96e48a29fcabf7d07ce2354 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:03:15.067445 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ff7247-f5aa-4f7b-9bd1-7cfcce279634 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:15.068778 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-39ff7247-f5aa-4f7b-9bd1-7cfcce279634 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:15.114822 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d29356-3c18-4561-98ae-b45c23bda5f8 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:15.302413 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7717593-c66e-40ec-a017-9d32fda216ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:15.306371 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7717593-c66e-40ec-a017-9d32fda216ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:15.308752 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7717593-c66e-40ec-a017-9d32fda216ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:15.311245 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7717593-c66e-40ec-a017-9d32fda216ae admin admin] PATH_INFO: `/v3/projects/280beb1b4fa14c4fa1bcd004d2636f9f` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:15.313279 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ff7247-f5aa-4f7b-9bd1-7cfcce279634 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:15.314146 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7717593-c66e-40ec-a017-9d32fda216ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=280beb1b4fa14c4fa1bcd004d2636f9f)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:15.318998 dv-cinder-850836-5-smb devstack@keystone.service[80231]: WARNING py.warnings [None req-a7717593-c66e-40ec-a017-9d32fda216ae admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 10:03:15.318998 dv-cinder-850836-5-smb devstack@keystone.service[80231]: warnings.warn(msg) Aug 10 10:03:15.318998 dv-cinder-850836-5-smb devstack@keystone.service[80231]: Aug 10 10:03:15.324283 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7717593-c66e-40ec-a017-9d32fda216ae admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:15.338477 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f11163-24cd-4a93-8f73-1877366597b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd8580888cba41a88566da4540b1130c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:15.358422 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f11163-24cd-4a93-8f73-1877366597b4 service nova] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:15.359041 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f11163-24cd-4a93-8f73-1877366597b4 service nova] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:15.360020 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f11163-24cd-4a93-8f73-1877366597b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:15.507378 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:15.513364 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f11163-24cd-4a93-8f73-1877366597b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:15.518173 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f11163-24cd-4a93-8f73-1877366597b4 service nova] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:15.520117 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-a7717593-c66e-40ec-a017-9d32fda216ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '280beb1b4fa14c4fa1bcd004d2636f9f', 'request_id': 'req-a7717593-c66e-40ec-a017-9d32fda216ae'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:15.537040 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-a7717593-c66e-40ec-a017-9d32fda216ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '280beb1b4fa14c4fa1bcd004d2636f9f', 'request_id': 'req-a7717593-c66e-40ec-a017-9d32fda216ae'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:15.540205 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:15.545835 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 821/1651] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:03:15 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:03:15.550528 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d0891b-2012-42a4-800d-99bba9db0fd3 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:15.550837 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d0891b-2012-42a4-800d-99bba9db0fd3 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:15.551080 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d0891b-2012-42a4-800d-99bba9db0fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:15.562385 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-a7717593-c66e-40ec-a017-9d32fda216ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '280beb1b4fa14c4fa1bcd004d2636f9f', 'request_id': 'req-a7717593-c66e-40ec-a017-9d32fda216ae'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:15.604116 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-a7717593-c66e-40ec-a017-9d32fda216ae admin admin] The token cache is being invalidate because project 280beb1b4fa14c4fa1bcd004d2636f9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 10:03:15.604842 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-a7717593-c66e-40ec-a017-9d32fda216ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:15.607966 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-a7717593-c66e-40ec-a017-9d32fda216ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:15.609930 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-f3d0891b-2012-42a4-800d-99bba9db0fd3 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:03:15.611524 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-f3d0891b-2012-42a4-800d-99bba9db0fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:15.614046 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 831/1652] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 10 10:03:15 2022] DELETE /identity/v3/projects/280beb1b4fa14c4fa1bcd004d2636f9f => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:03:15.621232 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54339f6-2408-429c-bc07-090d2c9ec7e2 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:15.621930 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54339f6-2408-429c-bc07-090d2c9ec7e2 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:15.622405 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54339f6-2408-429c-bc07-090d2c9ec7e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:15.679472 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-c54339f6-2408-429c-bc07-090d2c9ec7e2 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:03:15.680910 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-c54339f6-2408-429c-bc07-090d2c9ec7e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:15.825730 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 832/1653] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:03:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 10:03:15.834025 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f59f712-457d-42be-a9af-621f4d2ee6d2 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:15.834435 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f59f712-457d-42be-a9af-621f4d2ee6d2 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:15.836481 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f59f712-457d-42be-a9af-621f4d2ee6d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:15.844149 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 822/1654] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:03:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:03:15.878656 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-4f59f712-457d-42be-a9af-621f4d2ee6d2 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:03:15.880721 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-4f59f712-457d-42be-a9af-621f4d2ee6d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:15.887557 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d0891b-2012-42a4-800d-99bba9db0fd3 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:15.889020 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-f3d0891b-2012-42a4-800d-99bba9db0fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:15.891266 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 833/1655] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:03:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:03:15.897481 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f59f712-457d-42be-a9af-621f4d2ee6d2 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:15.923719 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f59f712-457d-42be-a9af-621f4d2ee6d2 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:15.931721 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69722058-a763-4f52-b8c0-5e8b404f9232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:15.932854 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69722058-a763-4f52-b8c0-5e8b404f9232 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:15.933681 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69722058-a763-4f52-b8c0-5e8b404f9232 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:15.934215 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69722058-a763-4f52-b8c0-5e8b404f9232 admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:15.935006 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69722058-a763-4f52-b8c0-5e8b404f9232 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:03:15.935418 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69722058-a763-4f52-b8c0-5e8b404f9232 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:15.937377 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69722058-a763-4f52-b8c0-5e8b404f9232 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:15.957206 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 834/1656] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 10 10:03:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:03:15.958643 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69722058-a763-4f52-b8c0-5e8b404f9232 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:15.975900 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69722058-a763-4f52-b8c0-5e8b404f9232 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:15.988244 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031afd9b-2afc-468b-8b89-a67838922a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:15.990259 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031afd9b-2afc-468b-8b89-a67838922a82 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:15.990632 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031afd9b-2afc-468b-8b89-a67838922a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:15.991017 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031afd9b-2afc-468b-8b89-a67838922a82 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:15.992252 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031afd9b-2afc-468b-8b89-a67838922a82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:15.996829 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031afd9b-2afc-468b-8b89-a67838922a82 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:16.059919 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d0891b-2012-42a4-800d-99bba9db0fd3 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:16.069049 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810e1f4b-6771-42d3-8c32-137233ac657a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4294c170df354fe892831281acd4ea7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:16.070846 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810e1f4b-6771-42d3-8c32-137233ac657a service neutron] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:16.071461 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810e1f4b-6771-42d3-8c32-137233ac657a service neutron] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:16.071891 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810e1f4b-6771-42d3-8c32-137233ac657a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:16.095935 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 835/1657] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 10 10:03:15 2022] POST /identity/v3/projects => generated 405 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:03:16.100337 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031afd9b-2afc-468b-8b89-a67838922a82 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:16.109918 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810e1f4b-6771-42d3-8c32-137233ac657a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:16.117397 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810e1f4b-6771-42d3-8c32-137233ac657a service neutron] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:16.143495 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 823/1658] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:03:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 10:03:16.283497 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031afd9b-2afc-468b-8b89-a67838922a82 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:16.314169 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e83279-5b56-4ecc-a67d-e342d3c54624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:16.314814 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e83279-5b56-4ecc-a67d-e342d3c54624 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:16.315490 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e83279-5b56-4ecc-a67d-e342d3c54624 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:16.315490 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e83279-5b56-4ecc-a67d-e342d3c54624 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:16.316104 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e83279-5b56-4ecc-a67d-e342d3c54624 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:16.319963 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e83279-5b56-4ecc-a67d-e342d3c54624 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:16.373110 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 836/1659] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 10 10:03:16 2022] POST /identity/v3/users => generated 303 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 10:03:16.378691 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810e1f4b-6771-42d3-8c32-137233ac657a service neutron] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:16.403196 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810e1f4b-6771-42d3-8c32-137233ac657a service neutron] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:16.409229 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af89d31e-fb80-4ac4-9c6e-85e653da213e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:16.409854 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af89d31e-fb80-4ac4-9c6e-85e653da213e admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:16.410212 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af89d31e-fb80-4ac4-9c6e-85e653da213e admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:16.410451 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af89d31e-fb80-4ac4-9c6e-85e653da213e admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:16.411448 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af89d31e-fb80-4ac4-9c6e-85e653da213e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:16.413342 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af89d31e-fb80-4ac4-9c6e-85e653da213e admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:16.434719 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 824/1660] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:03:16 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:03:16.439378 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e83279-5b56-4ecc-a67d-e342d3c54624 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:16.460997 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e83279-5b56-4ecc-a67d-e342d3c54624 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:16.480791 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df7c484-90ee-441d-b58b-bf70c0b6867a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:16.482041 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df7c484-90ee-441d-b58b-bf70c0b6867a admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:16.482332 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df7c484-90ee-441d-b58b-bf70c0b6867a admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:16.483214 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df7c484-90ee-441d-b58b-bf70c0b6867a admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:16.484230 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df7c484-90ee-441d-b58b-bf70c0b6867a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:16.486440 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df7c484-90ee-441d-b58b-bf70c0b6867a admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:16.500419 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 837/1661] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:03:16 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:03:16.505962 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af89d31e-fb80-4ac4-9c6e-85e653da213e admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:16.520320 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af89d31e-fb80-4ac4-9c6e-85e653da213e admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:16.528085 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf6035e-b419-4c88-8ad1-0a6c0fd74d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:16.528991 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf6035e-b419-4c88-8ad1-0a6c0fd74d16 admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:16.529525 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf6035e-b419-4c88-8ad1-0a6c0fd74d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:16.529990 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf6035e-b419-4c88-8ad1-0a6c0fd74d16 admin admin] PATH_INFO: `/v3/projects/7cccccffecde4c328f26be1ddca727f2/users/dabb52b36023498e90aede89e1910383/roles/8daabcb6b7394e39b06a3453e33e32db` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:16.574083 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf6035e-b419-4c88-8ad1-0a6c0fd74d16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cccccffecde4c328f26be1ddca727f2, user_id=dabb52b36023498e90aede89e1910383, role_id=8daabcb6b7394e39b06a3453e33e32db)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:16.579547 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf6035e-b419-4c88-8ad1-0a6c0fd74d16 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:16.614675 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 825/1662] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:03:16 2022] PUT /identity/v3/projects/7cccccffecde4c328f26be1ddca727f2/users/dabb52b36023498e90aede89e1910383/roles/8daabcb6b7394e39b06a3453e33e32db => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 10:03:16.620450 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f076f69-5d82-42b1-8ce4-a6f60fb5d09a None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:16.621001 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f076f69-5d82-42b1-8ce4-a6f60fb5d09a None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:16.623101 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f076f69-5d82-42b1-8ce4-a6f60fb5d09a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:16.650951 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-6f076f69-5d82-42b1-8ce4-a6f60fb5d09a None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:03:16.653023 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-6f076f69-5d82-42b1-8ce4-a6f60fb5d09a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:16.691642 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:INSERT=5,keystone:DELETE=1,keystone:SELECT=94 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:16.764812 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 838/1663] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:03:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:03:16.833271 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf6035e-b419-4c88-8ad1-0a6c0fd74d16 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:16.994517 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf6035e-b419-4c88-8ad1-0a6c0fd74d16 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:16.999567 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734965ee-97e9-4d57-a760-de996e8739f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4294c170df354fe892831281acd4ea7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:17.000434 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734965ee-97e9-4d57-a760-de996e8739f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:17.000925 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734965ee-97e9-4d57-a760-de996e8739f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:17.001377 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734965ee-97e9-4d57-a760-de996e8739f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:17.016322 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734965ee-97e9-4d57-a760-de996e8739f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:17.019360 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734965ee-97e9-4d57-a760-de996e8739f9 service neutron] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:17.049305 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 826/1664] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:03:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:03:17.534857 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f076f69-5d82-42b1-8ce4-a6f60fb5d09a None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:17.536532 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-6f076f69-5d82-42b1-8ce4-a6f60fb5d09a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:17.560700 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f076f69-5d82-42b1-8ce4-a6f60fb5d09a None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:17.570981 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2de7a4-b770-4b51-8011-be463c69d813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:17.572157 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2de7a4-b770-4b51-8011-be463c69d813 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:17.572458 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2de7a4-b770-4b51-8011-be463c69d813 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:17.572793 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2de7a4-b770-4b51-8011-be463c69d813 admin admin] PATH_INFO: `/v3/projects/d06c35c130404b169a8260298860d478` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:17.574973 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2de7a4-b770-4b51-8011-be463c69d813 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d06c35c130404b169a8260298860d478)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:17.580405 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2de7a4-b770-4b51-8011-be463c69d813 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:17.714691 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-6d2de7a4-b770-4b51-8011-be463c69d813 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd06c35c130404b169a8260298860d478', 'request_id': 'req-6d2de7a4-b770-4b51-8011-be463c69d813'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:17.726543 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-6d2de7a4-b770-4b51-8011-be463c69d813 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd06c35c130404b169a8260298860d478', 'request_id': 'req-6d2de7a4-b770-4b51-8011-be463c69d813'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:17.748054 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-6d2de7a4-b770-4b51-8011-be463c69d813 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd06c35c130404b169a8260298860d478', 'request_id': 'req-6d2de7a4-b770-4b51-8011-be463c69d813'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:17.786917 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-6d2de7a4-b770-4b51-8011-be463c69d813 admin admin] The token cache is being invalidate because project d06c35c130404b169a8260298860d478 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 10:03:17.789666 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-6d2de7a4-b770-4b51-8011-be463c69d813 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:17.791047 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-6d2de7a4-b770-4b51-8011-be463c69d813 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:17.798964 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 839/1665] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 10 10:03:17 2022] DELETE /identity/v3/projects/d06c35c130404b169a8260298860d478 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:03:17.803142 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164bc35f-a890-4652-8e4b-fd80484b89d4 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:17.803656 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164bc35f-a890-4652-8e4b-fd80484b89d4 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:17.803751 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164bc35f-a890-4652-8e4b-fd80484b89d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:17.853024 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:17.866823 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-164bc35f-a890-4652-8e4b-fd80484b89d4 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:03:17.869675 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-164bc35f-a890-4652-8e4b-fd80484b89d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:18.007038 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 827/1666] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:03:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:03:18.015649 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477a7fb2-79d4-40b6-ba0d-e0650124b50e None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:18.015940 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477a7fb2-79d4-40b6-ba0d-e0650124b50e None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:18.016226 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477a7fb2-79d4-40b6-ba0d-e0650124b50e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:18.106566 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-477a7fb2-79d4-40b6-ba0d-e0650124b50e None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:03:18.114054 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-477a7fb2-79d4-40b6-ba0d-e0650124b50e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:18.138854 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 840/1667] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:03:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:03:18.143509 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164bc35f-a890-4652-8e4b-fd80484b89d4 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:18.160927 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164bc35f-a890-4652-8e4b-fd80484b89d4 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:18.170814 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0719263a-237b-4fdc-8d1e-477f206330c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:18.171505 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0719263a-237b-4fdc-8d1e-477f206330c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:18.171790 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0719263a-237b-4fdc-8d1e-477f206330c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:18.172063 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0719263a-237b-4fdc-8d1e-477f206330c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:18.172711 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0719263a-237b-4fdc-8d1e-477f206330c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:03:18.173016 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0719263a-237b-4fdc-8d1e-477f206330c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:18.179722 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0719263a-237b-4fdc-8d1e-477f206330c9 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:18.212204 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 828/1668] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 10 10:03:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:03:18.215908 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477a7fb2-79d4-40b6-ba0d-e0650124b50e None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:18.227393 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477a7fb2-79d4-40b6-ba0d-e0650124b50e None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:18.241302 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6bcf2e-ac92-474c-9f61-f95323c22000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:18.242043 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6bcf2e-ac92-474c-9f61-f95323c22000 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:18.248013 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6bcf2e-ac92-474c-9f61-f95323c22000 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:18.248424 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6bcf2e-ac92-474c-9f61-f95323c22000 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:18.250443 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6bcf2e-ac92-474c-9f61-f95323c22000 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:18.252515 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6bcf2e-ac92-474c-9f61-f95323c22000 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:18.349116 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 841/1669] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 10 10:03:18 2022] POST /identity/v3/projects => generated 405 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:03:18.349878 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0719263a-237b-4fdc-8d1e-477f206330c9 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:18.377187 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0719263a-237b-4fdc-8d1e-477f206330c9 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:18.551965 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dec573-97ea-4ab5-9c41-a10d6d74a892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:18.560321 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dec573-97ea-4ab5-9c41-a10d6d74a892 admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:18.560594 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dec573-97ea-4ab5-9c41-a10d6d74a892 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:18.560869 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dec573-97ea-4ab5-9c41-a10d6d74a892 admin admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:18.563129 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dec573-97ea-4ab5-9c41-a10d6d74a892 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:18.565706 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dec573-97ea-4ab5-9c41-a10d6d74a892 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:18.615034 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 829/1670] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 10 10:03:18 2022] POST /identity/v3/users => generated 303 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 10:03:18.619559 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6bcf2e-ac92-474c-9f61-f95323c22000 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:18.635786 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6bcf2e-ac92-474c-9f61-f95323c22000 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:18.657735 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eac23bd-9930-46b0-835f-acfcb358aa3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:18.658812 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eac23bd-9930-46b0-835f-acfcb358aa3e admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:18.659426 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eac23bd-9930-46b0-835f-acfcb358aa3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:18.660265 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eac23bd-9930-46b0-835f-acfcb358aa3e admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:18.661265 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eac23bd-9930-46b0-835f-acfcb358aa3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:18.663371 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eac23bd-9930-46b0-835f-acfcb358aa3e admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:18.699722 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 842/1671] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:03:18 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:03:18.700867 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dec573-97ea-4ab5-9c41-a10d6d74a892 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:18.717884 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dec573-97ea-4ab5-9c41-a10d6d74a892 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:18.730500 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d90d85-8cc8-4a65-af8d-c449ed17bfc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:18.731575 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d90d85-8cc8-4a65-af8d-c449ed17bfc2 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:18.731914 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d90d85-8cc8-4a65-af8d-c449ed17bfc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:18.736287 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d90d85-8cc8-4a65-af8d-c449ed17bfc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:18.737058 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d90d85-8cc8-4a65-af8d-c449ed17bfc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:18.738793 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d90d85-8cc8-4a65-af8d-c449ed17bfc2 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:18.771125 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 830/1672] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:03:18 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:03:18.773128 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eac23bd-9930-46b0-835f-acfcb358aa3e admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:18.789598 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eac23bd-9930-46b0-835f-acfcb358aa3e admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:18.800364 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34174c7a-9176-43a4-8239-212684abad54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:18.802747 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34174c7a-9176-43a4-8239-212684abad54 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:18.803760 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34174c7a-9176-43a4-8239-212684abad54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:18.815216 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34174c7a-9176-43a4-8239-212684abad54 admin admin] PATH_INFO: `/v3/projects/48bc79bbd838419383e04aabb3602804/users/ac11511a1ed14e3d841477ac3c09d47f/roles/8daabcb6b7394e39b06a3453e33e32db` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:18.866478 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34174c7a-9176-43a4-8239-212684abad54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48bc79bbd838419383e04aabb3602804, user_id=ac11511a1ed14e3d841477ac3c09d47f, role_id=8daabcb6b7394e39b06a3453e33e32db)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:18.877328 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34174c7a-9176-43a4-8239-212684abad54 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:18.925418 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 843/1673] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:03:18 2022] PUT /identity/v3/projects/48bc79bbd838419383e04aabb3602804/users/ac11511a1ed14e3d841477ac3c09d47f/roles/8daabcb6b7394e39b06a3453e33e32db => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:03:18.926839 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40340c1-1692-4b37-8193-aea0ce5e59d0 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:18.927344 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40340c1-1692-4b37-8193-aea0ce5e59d0 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:18.927431 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40340c1-1692-4b37-8193-aea0ce5e59d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:19.016051 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-a40340c1-1692-4b37-8193-aea0ce5e59d0 None None] MFA Rules not processed for user `ac11511a1ed14e3d841477ac3c09d47f`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:03:19.017348 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-a40340c1-1692-4b37-8193-aea0ce5e59d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:19.176236 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 831/1674] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:03:18 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:03:19.181451 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34174c7a-9176-43a4-8239-212684abad54 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:19.320249 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:19.385490 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34174c7a-9176-43a4-8239-212684abad54 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:19.406785 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367ff8f3-6960-4dc9-bdf7-1ac48b3ef144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:19.407405 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367ff8f3-6960-4dc9-bdf7-1ac48b3ef144 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:19.407694 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367ff8f3-6960-4dc9-bdf7-1ac48b3ef144 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:19.407966 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367ff8f3-6960-4dc9-bdf7-1ac48b3ef144 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:19.408717 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367ff8f3-6960-4dc9-bdf7-1ac48b3ef144 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:19.411686 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367ff8f3-6960-4dc9-bdf7-1ac48b3ef144 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:19.510435 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 844/1675] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 10 10:03:19 2022] POST /identity/v3/projects => generated 405 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:03:19.514345 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40340c1-1692-4b37-8193-aea0ce5e59d0 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:19.520138 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:19.532535 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40340c1-1692-4b37-8193-aea0ce5e59d0 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:19.756994 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c8a6f6-bb29-4f2d-a6ea-4e0a9b28fbf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:19.757997 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c8a6f6-bb29-4f2d-a6ea-4e0a9b28fbf6 admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:19.758417 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c8a6f6-bb29-4f2d-a6ea-4e0a9b28fbf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:19.759819 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c8a6f6-bb29-4f2d-a6ea-4e0a9b28fbf6 admin admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:19.762175 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c8a6f6-bb29-4f2d-a6ea-4e0a9b28fbf6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:19.776453 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c8a6f6-bb29-4f2d-a6ea-4e0a9b28fbf6 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:19.847375 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367ff8f3-6960-4dc9-bdf7-1ac48b3ef144 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:19.862025 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-367ff8f3-6960-4dc9-bdf7-1ac48b3ef144 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:19.875418 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 832/1676] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 10 10:03:19 2022] POST /identity/v3/users => generated 309 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:03:19.883225 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c8a6f6-bb29-4f2d-a6ea-4e0a9b28fbf6 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:19.909616 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367ff8f3-6960-4dc9-bdf7-1ac48b3ef144 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:19.918369 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f191fa44-6c2f-4868-9173-ef41c529541b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:19.919300 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f191fa44-6c2f-4868-9173-ef41c529541b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:19.919718 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f191fa44-6c2f-4868-9173-ef41c529541b admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:19.920235 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f191fa44-6c2f-4868-9173-ef41c529541b admin admin] PATH_INFO: `/v3/users/148f1d89db51465eafc951f62ee6c95e` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:19.922434 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f191fa44-6c2f-4868-9173-ef41c529541b admin admin] RBAC: Authorizing `identity:delete_user(user_id=148f1d89db51465eafc951f62ee6c95e)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:19.923789 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c8a6f6-bb29-4f2d-a6ea-4e0a9b28fbf6 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:19.926703 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f191fa44-6c2f-4868-9173-ef41c529541b admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:19.942238 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530aa682-9f07-4d23-8f6f-f6935b10a19b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:19.943603 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530aa682-9f07-4d23-8f6f-f6935b10a19b admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:19.944041 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530aa682-9f07-4d23-8f6f-f6935b10a19b admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:19.944672 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530aa682-9f07-4d23-8f6f-f6935b10a19b admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:19.945630 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530aa682-9f07-4d23-8f6f-f6935b10a19b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:19.952599 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530aa682-9f07-4d23-8f6f-f6935b10a19b admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:19.997263 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 833/1677] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:03:19 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:03:20.009054 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2a7e1e-33d6-4fa7-a5d1-4781c33254e6 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:20.009670 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2a7e1e-33d6-4fa7-a5d1-4781c33254e6 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:20.010137 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2a7e1e-33d6-4fa7-a5d1-4781c33254e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:20.097333 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-f191fa44-6c2f-4868-9173-ef41c529541b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '148f1d89db51465eafc951f62ee6c95e'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:20.104384 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-fc2a7e1e-33d6-4fa7-a5d1-4781c33254e6 None None] MFA Rules not processed for user `dabb52b36023498e90aede89e1910383`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:03:20.107411 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-fc2a7e1e-33d6-4fa7-a5d1-4781c33254e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:20.124773 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-f191fa44-6c2f-4868-9173-ef41c529541b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '148f1d89db51465eafc951f62ee6c95e'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:20.125683 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-f191fa44-6c2f-4868-9173-ef41c529541b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '148f1d89db51465eafc951f62ee6c95e'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:20.127046 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-f191fa44-6c2f-4868-9173-ef41c529541b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '148f1d89db51465eafc951f62ee6c95e'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:20.144260 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-f191fa44-6c2f-4868-9173-ef41c529541b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '148f1d89db51465eafc951f62ee6c95e'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:20.204231 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 845/1678] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 10 10:03:19 2022] DELETE /identity/v3/users/148f1d89db51465eafc951f62ee6c95e => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:03:20.205269 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f191fa44-6c2f-4868-9173-ef41c529541b admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:20.211426 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-f191fa44-6c2f-4868-9173-ef41c529541b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:20.333007 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 834/1679] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:03:20 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:03:20.335063 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f191fa44-6c2f-4868-9173-ef41c529541b admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:20.338934 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fcfa04-c7f7-4e2c-8a4c-8bf675a45144 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:20.346210 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fcfa04-c7f7-4e2c-8a4c-8bf675a45144 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:20.346858 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fcfa04-c7f7-4e2c-8a4c-8bf675a45144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:20.350656 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b6cf08-75f6-4274-9967-64883c075c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:20.351357 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b6cf08-75f6-4274-9967-64883c075c30 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:20.351644 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b6cf08-75f6-4274-9967-64883c075c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:20.351918 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b6cf08-75f6-4274-9967-64883c075c30 admin admin] PATH_INFO: `/v3/projects/6af98aa6249242339506c9d9041a6517/users/0a8f86c2d42949fa800aa7ab11bab037/roles/eb04edc46b3742d7a0f0ead26f68bc22` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:20.379809 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b6cf08-75f6-4274-9967-64883c075c30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6af98aa6249242339506c9d9041a6517, user_id=0a8f86c2d42949fa800aa7ab11bab037, role_id=eb04edc46b3742d7a0f0ead26f68bc22)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:20.384683 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b6cf08-75f6-4274-9967-64883c075c30 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:20.418328 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 846/1680] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:03:20 2022] PUT /identity/v3/projects/6af98aa6249242339506c9d9041a6517/users/0a8f86c2d42949fa800aa7ab11bab037/roles/eb04edc46b3742d7a0f0ead26f68bc22 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:03:20.419592 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b6cf08-75f6-4274-9967-64883c075c30 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:20.422749 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-a4fcfa04-c7f7-4e2c-8a4c-8bf675a45144 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:03:20.425139 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-e6b6cf08-75f6-4274-9967-64883c075c30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:20.425804 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-a4fcfa04-c7f7-4e2c-8a4c-8bf675a45144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:20.477840 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:20.604514 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 835/1681] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:03:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:03:20.604514 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fcfa04-c7f7-4e2c-8a4c-8bf675a45144 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:20.620740 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fcfa04-c7f7-4e2c-8a4c-8bf675a45144 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:20.630388 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b6cf08-75f6-4274-9967-64883c075c30 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:20.640583 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863507d9-a907-44dc-83b9-3a983596b8cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:20.641643 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863507d9-a907-44dc-83b9-3a983596b8cd admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:20.642101 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863507d9-a907-44dc-83b9-3a983596b8cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:20.642511 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863507d9-a907-44dc-83b9-3a983596b8cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:20.643275 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c06deb-bb46-4fd2-a286-3efaf62c7c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:20.643501 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863507d9-a907-44dc-83b9-3a983596b8cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:20.644307 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c06deb-bb46-4fd2-a286-3efaf62c7c22 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:20.645514 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863507d9-a907-44dc-83b9-3a983596b8cd admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:20.646105 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c06deb-bb46-4fd2-a286-3efaf62c7c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:20.648391 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c06deb-bb46-4fd2-a286-3efaf62c7c22 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:20.649930 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c06deb-bb46-4fd2-a286-3efaf62c7c22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:20.656369 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c06deb-bb46-4fd2-a286-3efaf62c7c22 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:20.673672 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:20.697995 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 836/1682] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:03:20 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:03:20.699625 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863507d9-a907-44dc-83b9-3a983596b8cd admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:20.703377 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-863507d9-a907-44dc-83b9-3a983596b8cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:20.750654 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 847/1683] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 10 10:03:20 2022] POST /identity/v3/projects => generated 403 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:03:20.754494 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c06deb-bb46-4fd2-a286-3efaf62c7c22 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:20.899371 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863507d9-a907-44dc-83b9-3a983596b8cd admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:20.921081 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c06deb-bb46-4fd2-a286-3efaf62c7c22 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:20.935785 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a6599b-1cf7-413a-9cb6-0bcfbceffbe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:20.936476 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a6599b-1cf7-413a-9cb6-0bcfbceffbe5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:20.936751 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a6599b-1cf7-413a-9cb6-0bcfbceffbe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:20.937028 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a6599b-1cf7-413a-9cb6-0bcfbceffbe5 admin admin] PATH_INFO: `/v3/projects/6af98aa6249242339506c9d9041a6517/users/0a8f86c2d42949fa800aa7ab11bab037/roles/eb04edc46b3742d7a0f0ead26f68bc22` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:20.944108 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a6599b-1cf7-413a-9cb6-0bcfbceffbe5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6af98aa6249242339506c9d9041a6517, user_id=0a8f86c2d42949fa800aa7ab11bab037, role_id=eb04edc46b3742d7a0f0ead26f68bc22)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:20.952302 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a6599b-1cf7-413a-9cb6-0bcfbceffbe5 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:20.979604 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 848/1684] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:03:20 2022] PUT /identity/v3/projects/6af98aa6249242339506c9d9041a6517/users/0a8f86c2d42949fa800aa7ab11bab037/roles/eb04edc46b3742d7a0f0ead26f68bc22 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:03:20.985726 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c90199-b64d-4d34-9c2a-0ae9989201f4 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:20.986025 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c90199-b64d-4d34-9c2a-0ae9989201f4 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:20.986576 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c90199-b64d-4d34-9c2a-0ae9989201f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:21.018811 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822099ad-dba4-4dc9-8913-e88b8df9a3dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4294c170df354fe892831281acd4ea7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:21.020000 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822099ad-dba4-4dc9-8913-e88b8df9a3dc service neutron] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:21.020000 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822099ad-dba4-4dc9-8913-e88b8df9a3dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:21.020179 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822099ad-dba4-4dc9-8913-e88b8df9a3dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:21.041451 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822099ad-dba4-4dc9-8913-e88b8df9a3dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:21.045676 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822099ad-dba4-4dc9-8913-e88b8df9a3dc service neutron] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:21.051164 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-f6c90199-b64d-4d34-9c2a-0ae9989201f4 None None] MFA Rules not processed for user `ec9393db1a3841098f79ff5a6a493dc4`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:03:21.053331 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-f6c90199-b64d-4d34-9c2a-0ae9989201f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:21.061384 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 837/1685] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:03:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:03:21.062523 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822099ad-dba4-4dc9-8913-e88b8df9a3dc service neutron] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:21.074364 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822099ad-dba4-4dc9-8913-e88b8df9a3dc service neutron] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:21.189935 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b9c93f-d91f-42f6-8a4b-949d50a2698c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:21.190619 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b9c93f-d91f-42f6-8a4b-949d50a2698c admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:21.190949 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b9c93f-d91f-42f6-8a4b-949d50a2698c admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:21.191223 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b9c93f-d91f-42f6-8a4b-949d50a2698c admin admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:21.191891 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b9c93f-d91f-42f6-8a4b-949d50a2698c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:21.193948 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b9c93f-d91f-42f6-8a4b-949d50a2698c admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:21.240872 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 838/1686] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 10 10:03:21 2022] POST /identity/v3/users => generated 308 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:03:21.244317 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08177e4d-4747-4813-9e04-fe6309095d82 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:21.244651 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08177e4d-4747-4813-9e04-fe6309095d82 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:21.244970 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08177e4d-4747-4813-9e04-fe6309095d82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:21.310013 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 849/1687] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:03:20 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:03:21.311145 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c90199-b64d-4d34-9c2a-0ae9989201f4 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:21.332948 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-08177e4d-4747-4813-9e04-fe6309095d82 None None] MFA Rules not processed for user `0a8f86c2d42949fa800aa7ab11bab037`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:03:21.338219 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-08177e4d-4747-4813-9e04-fe6309095d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:21.352597 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c90199-b64d-4d34-9c2a-0ae9989201f4 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:21.366960 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33940945-5e45-453e-92dc-f52cb9316295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:21.367597 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33940945-5e45-453e-92dc-f52cb9316295 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:21.367880 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33940945-5e45-453e-92dc-f52cb9316295 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:21.368327 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33940945-5e45-453e-92dc-f52cb9316295 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:21.368807 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33940945-5e45-453e-92dc-f52cb9316295 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:21.370513 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33940945-5e45-453e-92dc-f52cb9316295 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:21.414934 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 850/1688] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:03:21 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:03:21.416186 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dba18c-90cf-4de5-b581-eb6b16c77c5f None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:21.416478 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dba18c-90cf-4de5-b581-eb6b16c77c5f None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:21.416757 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dba18c-90cf-4de5-b581-eb6b16c77c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:21.431504 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:21.473898 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-d3dba18c-90cf-4de5-b581-eb6b16c77c5f None None] MFA Rules not processed for user `ec9393db1a3841098f79ff5a6a493dc4`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:03:21.475204 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-d3dba18c-90cf-4de5-b581-eb6b16c77c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:21.497259 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 851/1689] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:03:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:03:21.509357 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dba18c-90cf-4de5-b581-eb6b16c77c5f None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:21.522876 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dba18c-90cf-4de5-b581-eb6b16c77c5f None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:21.541872 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 839/1690] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:03:21 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:03:21.543472 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08177e4d-4747-4813-9e04-fe6309095d82 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:21.545129 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226929d6-9404-4365-b955-5a06d2b409a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:21.545954 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-08177e4d-4747-4813-9e04-fe6309095d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:21.546677 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226929d6-9404-4365-b955-5a06d2b409a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:21.546899 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226929d6-9404-4365-b955-5a06d2b409a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:21.547181 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226929d6-9404-4365-b955-5a06d2b409a6 admin admin] PATH_INFO: `/v3/projects/bd7ffb6546a24006be2407bb04c744f5/users/15a0177baf4d41e8ad2891b6d5480578/roles/eb04edc46b3742d7a0f0ead26f68bc22` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:21.579656 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:21.592675 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226929d6-9404-4365-b955-5a06d2b409a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd7ffb6546a24006be2407bb04c744f5, user_id=15a0177baf4d41e8ad2891b6d5480578, role_id=eb04edc46b3742d7a0f0ead26f68bc22)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:21.596346 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226929d6-9404-4365-b955-5a06d2b409a6 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:21.633761 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 852/1691] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:03:21 2022] PUT /identity/v3/projects/bd7ffb6546a24006be2407bb04c744f5/users/15a0177baf4d41e8ad2891b6d5480578/roles/eb04edc46b3742d7a0f0ead26f68bc22 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:03:21.635126 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226929d6-9404-4365-b955-5a06d2b409a6 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:21.637609 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-226929d6-9404-4365-b955-5a06d2b409a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:21.672095 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08177e4d-4747-4813-9e04-fe6309095d82 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:21.792041 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226929d6-9404-4365-b955-5a06d2b409a6 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:21.801196 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9210e6e3-13ef-428c-9797-f63edef091be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf8e725cbe0403d943b136235eac057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:21.802030 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9210e6e3-13ef-428c-9797-f63edef091be service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:21.802403 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9210e6e3-13ef-428c-9797-f63edef091be service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:21.802774 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9210e6e3-13ef-428c-9797-f63edef091be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:21.824876 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920adbee-9516-4848-a47f-9d7b7b5e3d38 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd8580888cba41a88566da4540b1130c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:21.825561 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920adbee-9516-4848-a47f-9d7b7b5e3d38 service nova] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:21.825846 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920adbee-9516-4848-a47f-9d7b7b5e3d38 service nova] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:21.826125 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920adbee-9516-4848-a47f-9d7b7b5e3d38 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:21.995921 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920adbee-9516-4848-a47f-9d7b7b5e3d38 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:21.998111 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920adbee-9516-4848-a47f-9d7b7b5e3d38 service nova] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:22.004329 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9210e6e3-13ef-428c-9797-f63edef091be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:22.007077 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9210e6e3-13ef-428c-9797-f63edef091be service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:22.020766 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 840/1692] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:03:21 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:03:22.021686 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920adbee-9516-4848-a47f-9d7b7b5e3d38 service nova] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:22.032582 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 853/1693] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:03:21 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:03:22.033525 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9210e6e3-13ef-428c-9797-f63edef091be service cinder] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:22.036773 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-9210e6e3-13ef-428c-9797-f63edef091be service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:22.071359 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:22.221569 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9210e6e3-13ef-428c-9797-f63edef091be service cinder] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:22.245513 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877c5ac1-873f-4586-8200-5b48ba3e30e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:22.246060 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877c5ac1-873f-4586-8200-5b48ba3e30e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:22.246345 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877c5ac1-873f-4586-8200-5b48ba3e30e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:22.246622 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877c5ac1-873f-4586-8200-5b48ba3e30e1 admin admin] PATH_INFO: `/v3/projects/9d74c724bf2e45aba270f9eb6b76382b` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:22.248722 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877c5ac1-873f-4586-8200-5b48ba3e30e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d74c724bf2e45aba270f9eb6b76382b)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:22.260558 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877c5ac1-873f-4586-8200-5b48ba3e30e1 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:22.322106 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920adbee-9516-4848-a47f-9d7b7b5e3d38 service nova] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:22.346462 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a65e4b-c7b7-4cf5-8c32-74f281ad1a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:22.347590 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a65e4b-c7b7-4cf5-8c32-74f281ad1a45 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:22.347590 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a65e4b-c7b7-4cf5-8c32-74f281ad1a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:22.347789 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a65e4b-c7b7-4cf5-8c32-74f281ad1a45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:22.348437 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a65e4b-c7b7-4cf5-8c32-74f281ad1a45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:22.350104 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a65e4b-c7b7-4cf5-8c32-74f281ad1a45 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:22.392352 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 841/1694] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:03:22 2022] GET /identity/v3/roles => generated 1420 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:03:22.393497 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a65e4b-c7b7-4cf5-8c32-74f281ad1a45 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:22.421256 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a65e4b-c7b7-4cf5-8c32-74f281ad1a45 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:22.434379 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:22.442168 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-877c5ac1-873f-4586-8200-5b48ba3e30e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d74c724bf2e45aba270f9eb6b76382b', 'request_id': 'req-877c5ac1-873f-4586-8200-5b48ba3e30e1'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:22.456786 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-877c5ac1-873f-4586-8200-5b48ba3e30e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d74c724bf2e45aba270f9eb6b76382b', 'request_id': 'req-877c5ac1-873f-4586-8200-5b48ba3e30e1'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:22.471101 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-877c5ac1-873f-4586-8200-5b48ba3e30e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d74c724bf2e45aba270f9eb6b76382b', 'request_id': 'req-877c5ac1-873f-4586-8200-5b48ba3e30e1'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:22.490131 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-877c5ac1-873f-4586-8200-5b48ba3e30e1 admin admin] The token cache is being invalidate because project 9d74c724bf2e45aba270f9eb6b76382b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 10:03:22.491377 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-877c5ac1-873f-4586-8200-5b48ba3e30e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:22.492345 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-877c5ac1-873f-4586-8200-5b48ba3e30e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:22.494066 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 854/1695] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 10 10:03:22 2022] DELETE /identity/v3/projects/9d74c724bf2e45aba270f9eb6b76382b => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:03:22.497209 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877c5ac1-873f-4586-8200-5b48ba3e30e1 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:22.501549 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-877c5ac1-873f-4586-8200-5b48ba3e30e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:22.594801 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9113f26-f5de-4452-90da-4322615b4565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:22.595745 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9113f26-f5de-4452-90da-4322615b4565 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:22.596124 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9113f26-f5de-4452-90da-4322615b4565 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:22.596591 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9113f26-f5de-4452-90da-4322615b4565 admin admin] PATH_INFO: `/v3/users/ac11511a1ed14e3d841477ac3c09d47f` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:22.606543 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9113f26-f5de-4452-90da-4322615b4565 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac11511a1ed14e3d841477ac3c09d47f)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:22.626436 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9113f26-f5de-4452-90da-4322615b4565 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:22.666000 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877c5ac1-873f-4586-8200-5b48ba3e30e1 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:22.691646 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52710cc2-32c8-4785-81e4-ee5005e9da51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:22.692338 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52710cc2-32c8-4785-81e4-ee5005e9da51 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:22.692618 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52710cc2-32c8-4785-81e4-ee5005e9da51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:22.692936 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52710cc2-32c8-4785-81e4-ee5005e9da51 admin admin] PATH_INFO: `/v3/projects/bd7ffb6546a24006be2407bb04c744f5/users/15a0177baf4d41e8ad2891b6d5480578/roles/eb04edc46b3742d7a0f0ead26f68bc22` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:22.694941 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52710cc2-32c8-4785-81e4-ee5005e9da51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd7ffb6546a24006be2407bb04c744f5, user_id=15a0177baf4d41e8ad2891b6d5480578, role_id=eb04edc46b3742d7a0f0ead26f68bc22)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:22.697673 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52710cc2-32c8-4785-81e4-ee5005e9da51 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:22.732121 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 855/1696] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:03:22 2022] PUT /identity/v3/projects/bd7ffb6546a24006be2407bb04c744f5/users/15a0177baf4d41e8ad2891b6d5480578/roles/eb04edc46b3742d7a0f0ead26f68bc22 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:03:22.732121 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52710cc2-32c8-4785-81e4-ee5005e9da51 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:22.736147 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-52710cc2-32c8-4785-81e4-ee5005e9da51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:22.753606 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-c9113f26-f5de-4452-90da-4322615b4565 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac11511a1ed14e3d841477ac3c09d47f'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:22.768388 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-c9113f26-f5de-4452-90da-4322615b4565 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac11511a1ed14e3d841477ac3c09d47f'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:22.791363 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-c9113f26-f5de-4452-90da-4322615b4565 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac11511a1ed14e3d841477ac3c09d47f'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:22.792128 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-c9113f26-f5de-4452-90da-4322615b4565 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac11511a1ed14e3d841477ac3c09d47f'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:22.792836 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-c9113f26-f5de-4452-90da-4322615b4565 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac11511a1ed14e3d841477ac3c09d47f'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:22.826140 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 842/1697] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 10 10:03:22 2022] DELETE /identity/v3/users/ac11511a1ed14e3d841477ac3c09d47f => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:03:22.830952 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4073da7-2c67-4ae5-a354-7191ac758adc None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:22.831245 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4073da7-2c67-4ae5-a354-7191ac758adc None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:22.831523 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4073da7-2c67-4ae5-a354-7191ac758adc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:22.869815 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-a4073da7-2c67-4ae5-a354-7191ac758adc None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:03:22.873660 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-a4073da7-2c67-4ae5-a354-7191ac758adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:22.909814 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52710cc2-32c8-4785-81e4-ee5005e9da51 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:22.925907 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:22.984464 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 843/1698] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:03:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:03:23.012776 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4073da7-2c67-4ae5-a354-7191ac758adc None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:23.015542 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-a4073da7-2c67-4ae5-a354-7191ac758adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:23.042400 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df182cc3-7b44-4bc5-b0e7-5b8ea4cb98a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:23.045423 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df182cc3-7b44-4bc5-b0e7-5b8ea4cb98a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:23.045910 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df182cc3-7b44-4bc5-b0e7-5b8ea4cb98a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:23.047140 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df182cc3-7b44-4bc5-b0e7-5b8ea4cb98a2 admin admin] PATH_INFO: `/v3/users/3d4b0ba6420749a394ead08906c89a72` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:23.049857 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df182cc3-7b44-4bc5-b0e7-5b8ea4cb98a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d4b0ba6420749a394ead08906c89a72)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:23.053989 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df182cc3-7b44-4bc5-b0e7-5b8ea4cb98a2 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:23.092453 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:23.179785 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-df182cc3-7b44-4bc5-b0e7-5b8ea4cb98a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d4b0ba6420749a394ead08906c89a72'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:23.188999 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4073da7-2c67-4ae5-a354-7191ac758adc None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:23.194615 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-df182cc3-7b44-4bc5-b0e7-5b8ea4cb98a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d4b0ba6420749a394ead08906c89a72'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:23.195463 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-df182cc3-7b44-4bc5-b0e7-5b8ea4cb98a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d4b0ba6420749a394ead08906c89a72'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:23.197675 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-df182cc3-7b44-4bc5-b0e7-5b8ea4cb98a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d4b0ba6420749a394ead08906c89a72'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:23.198740 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0cb510-9129-4a0e-9c7c-df03415647b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4294c170df354fe892831281acd4ea7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:23.200566 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0cb510-9129-4a0e-9c7c-df03415647b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:23.200916 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0cb510-9129-4a0e-9c7c-df03415647b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:23.201431 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0cb510-9129-4a0e-9c7c-df03415647b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:23.208869 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-4d0cb510-9129-4a0e-9c7c-df03415647b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:23.211922 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-df182cc3-7b44-4bc5-b0e7-5b8ea4cb98a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d4b0ba6420749a394ead08906c89a72'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:23.234244 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0cb510-9129-4a0e-9c7c-df03415647b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:23.236919 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0cb510-9129-4a0e-9c7c-df03415647b3 service neutron] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:23.251391 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 856/1699] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 10 10:03:22 2022] DELETE /identity/v3/users/3d4b0ba6420749a394ead08906c89a72 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:03:23.254628 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df19af3-7f61-44dd-8c38-971eeffe31ab None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:23.255752 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df19af3-7f61-44dd-8c38-971eeffe31ab None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:23.256260 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 844/1700] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:03:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:03:23.256412 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df19af3-7f61-44dd-8c38-971eeffe31ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:23.257983 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb73e6-3de0-4c7d-9da4-5e49fcfe44de None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:23.258463 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb73e6-3de0-4c7d-9da4-5e49fcfe44de None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:23.258811 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb73e6-3de0-4c7d-9da4-5e49fcfe44de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:23.284285 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-4df19af3-7f61-44dd-8c38-971eeffe31ab None None] MFA Rules not processed for user `3027050c9e124590971f3930146522d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:03:23.285689 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-4df19af3-7f61-44dd-8c38-971eeffe31ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:23.311298 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-acbb73e6-3de0-4c7d-9da4-5e49fcfe44de None None] MFA Rules not processed for user `63fa6ba87a7a4827af4c5fbd4629b1c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:03:23.313896 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-acbb73e6-3de0-4c7d-9da4-5e49fcfe44de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:23.369739 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 857/1701] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:03:23 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:03:23.371450 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595dc583-fe90-4f00-89df-d935af899d61 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:23.371962 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595dc583-fe90-4f00-89df-d935af899d61 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:23.372557 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595dc583-fe90-4f00-89df-d935af899d61 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:23.374310 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 858/1702] 10.222.0.27 () {54 vars in 912 bytes} [Wed Aug 10 10:03:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:03:23.380855 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc057e10-0f8a-44a4-ac15-926973832346 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:23.382292 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc057e10-0f8a-44a4-ac15-926973832346 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:23.383093 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc057e10-0f8a-44a4-ac15-926973832346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:23.418017 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 845/1703] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:03:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:03:23.474124 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-bc057e10-0f8a-44a4-ac15-926973832346 None None] MFA Rules not processed for user `4294c170df354fe892831281acd4ea7d`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:03:23.476717 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-bc057e10-0f8a-44a4-ac15-926973832346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:23.573477 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 859/1704] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Aug 10 10:03:23 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:03:23.639382 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbb73e6-3de0-4c7d-9da4-5e49fcfe44de None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:23.640838 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-acbb73e6-3de0-4c7d-9da4-5e49fcfe44de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:23.669993 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbb73e6-3de0-4c7d-9da4-5e49fcfe44de None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:23.677011 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470acb44-ebc6-4219-84a0-6dec8b69e692 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4294c170df354fe892831281acd4ea7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:23.677668 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470acb44-ebc6-4219-84a0-6dec8b69e692 service neutron] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:23.677943 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470acb44-ebc6-4219-84a0-6dec8b69e692 service neutron] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:23.678284 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470acb44-ebc6-4219-84a0-6dec8b69e692 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:23.695806 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470acb44-ebc6-4219-84a0-6dec8b69e692 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:23.697320 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470acb44-ebc6-4219-84a0-6dec8b69e692 service neutron] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:23.718520 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 846/1705] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:03:23 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:03:24.061957 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97406879-421c-432c-a3bf-399661aadac9 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:24.062413 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97406879-421c-432c-a3bf-399661aadac9 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:24.062588 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97406879-421c-432c-a3bf-399661aadac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:24.114630 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-97406879-421c-432c-a3bf-399661aadac9 None None] MFA Rules not processed for user `05de322f3f174bc195a58a108c9387da`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:03:24.115929 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-97406879-421c-432c-a3bf-399661aadac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:24.161760 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:24.168948 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cea7818-1c5d-447b-a8c7-29579ee04d58 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:24.169266 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cea7818-1c5d-447b-a8c7-29579ee04d58 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:24.169530 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cea7818-1c5d-447b-a8c7-29579ee04d58 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:24.171902 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 847/1706] 10.222.0.27 () {54 vars in 912 bytes} [Wed Aug 10 10:03:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:03:24.187673 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e51af0-dd19-4877-bd51-1308ec3f2a0a None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:24.187975 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e51af0-dd19-4877-bd51-1308ec3f2a0a None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:24.188233 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e51af0-dd19-4877-bd51-1308ec3f2a0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:24.245157 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-c0e51af0-dd19-4877-bd51-1308ec3f2a0a None None] MFA Rules not processed for user `4294c170df354fe892831281acd4ea7d`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:03:24.246608 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-c0e51af0-dd19-4877-bd51-1308ec3f2a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:24.272625 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 848/1707] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Aug 10 10:03:24 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:03:24.273627 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e51af0-dd19-4877-bd51-1308ec3f2a0a None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:24.275641 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-c0e51af0-dd19-4877-bd51-1308ec3f2a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:24.292536 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 860/1708] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:03:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:03:24.321646 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97406879-421c-432c-a3bf-399661aadac9 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:24.334572 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97406879-421c-432c-a3bf-399661aadac9 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:24.344004 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:24.348440 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059dfe10-81ba-459f-9990-0db63bd74042 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4294c170df354fe892831281acd4ea7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:24.350678 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059dfe10-81ba-459f-9990-0db63bd74042 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:24.350962 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059dfe10-81ba-459f-9990-0db63bd74042 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:24.351258 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059dfe10-81ba-459f-9990-0db63bd74042 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:24.376528 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059dfe10-81ba-459f-9990-0db63bd74042 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:24.380817 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e51af0-dd19-4877-bd51-1308ec3f2a0a None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:24.381052 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059dfe10-81ba-459f-9990-0db63bd74042 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:24.388229 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2d3fec-d6fb-4a93-9771-91b0aa788244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:24.389645 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2d3fec-d6fb-4a93-9771-91b0aa788244 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:24.391542 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2d3fec-d6fb-4a93-9771-91b0aa788244 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:24.392029 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2d3fec-d6fb-4a93-9771-91b0aa788244 admin admin] PATH_INFO: `/v3/projects/48bc79bbd838419383e04aabb3602804` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:24.393770 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2d3fec-d6fb-4a93-9771-91b0aa788244 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48bc79bbd838419383e04aabb3602804)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:24.396924 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2d3fec-d6fb-4a93-9771-91b0aa788244 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:24.407789 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 861/1709] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:03:24 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:03:24.490194 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-5b2d3fec-d6fb-4a93-9771-91b0aa788244 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48bc79bbd838419383e04aabb3602804', 'request_id': 'req-5b2d3fec-d6fb-4a93-9771-91b0aa788244'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:24.506274 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-5b2d3fec-d6fb-4a93-9771-91b0aa788244 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48bc79bbd838419383e04aabb3602804', 'request_id': 'req-5b2d3fec-d6fb-4a93-9771-91b0aa788244'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:24.537635 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-5b2d3fec-d6fb-4a93-9771-91b0aa788244 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48bc79bbd838419383e04aabb3602804', 'request_id': 'req-5b2d3fec-d6fb-4a93-9771-91b0aa788244'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:24.565001 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-5b2d3fec-d6fb-4a93-9771-91b0aa788244 admin admin] The token cache is being invalidate because project 48bc79bbd838419383e04aabb3602804 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 10:03:24.565489 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-5b2d3fec-d6fb-4a93-9771-91b0aa788244 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:24.568957 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-5b2d3fec-d6fb-4a93-9771-91b0aa788244 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:24.572057 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 849/1710] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 10 10:03:24 2022] DELETE /identity/v3/projects/48bc79bbd838419383e04aabb3602804 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:03:24.576682 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059dfe10-81ba-459f-9990-0db63bd74042 service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:24.594841 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059dfe10-81ba-459f-9990-0db63bd74042 service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:24.726813 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd65ff0-5524-4dbc-b87f-4eab63478d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:24.727748 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd65ff0-5524-4dbc-b87f-4eab63478d30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:24.729242 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd65ff0-5524-4dbc-b87f-4eab63478d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:24.729564 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd65ff0-5524-4dbc-b87f-4eab63478d30 admin admin] PATH_INFO: `/v3/users/0a8f86c2d42949fa800aa7ab11bab037` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:24.731728 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd65ff0-5524-4dbc-b87f-4eab63478d30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a8f86c2d42949fa800aa7ab11bab037)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:24.734835 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd65ff0-5524-4dbc-b87f-4eab63478d30 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:24.840350 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-9cd65ff0-5524-4dbc-b87f-4eab63478d30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a8f86c2d42949fa800aa7ab11bab037'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:24.875847 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-9cd65ff0-5524-4dbc-b87f-4eab63478d30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a8f86c2d42949fa800aa7ab11bab037'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:24.877018 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-9cd65ff0-5524-4dbc-b87f-4eab63478d30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a8f86c2d42949fa800aa7ab11bab037'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:24.881113 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-9cd65ff0-5524-4dbc-b87f-4eab63478d30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a8f86c2d42949fa800aa7ab11bab037'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:24.898192 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-9cd65ff0-5524-4dbc-b87f-4eab63478d30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a8f86c2d42949fa800aa7ab11bab037'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:24.920332 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2d3fec-d6fb-4a93-9771-91b0aa788244 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:24.922252 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-5b2d3fec-d6fb-4a93-9771-91b0aa788244 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:24.945540 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2d3fec-d6fb-4a93-9771-91b0aa788244 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:24.947188 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 862/1711] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 10 10:03:24 2022] DELETE /identity/v3/users/0a8f86c2d42949fa800aa7ab11bab037 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:03:25.007538 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd65ff0-5524-4dbc-b87f-4eab63478d30 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:25.009821 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-9cd65ff0-5524-4dbc-b87f-4eab63478d30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:25.132233 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:25.170985 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b4032d-d5fc-4057-8193-360b2f00b200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:25.171836 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b4032d-d5fc-4057-8193-360b2f00b200 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:25.174843 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b4032d-d5fc-4057-8193-360b2f00b200 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:25.176986 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b4032d-d5fc-4057-8193-360b2f00b200 admin admin] PATH_INFO: `/v3/projects/25b9cf09383f40469d04f8ebb88adf58` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:25.180308 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b4032d-d5fc-4057-8193-360b2f00b200 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25b9cf09383f40469d04f8ebb88adf58)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:25.188308 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b4032d-d5fc-4057-8193-360b2f00b200 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:25.211517 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd65ff0-5524-4dbc-b87f-4eab63478d30 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:25.220981 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18248f58-f65c-4e4e-9175-d5b546e326d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd8580888cba41a88566da4540b1130c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:25.221924 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18248f58-f65c-4e4e-9175-d5b546e326d3 service nova] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:25.222455 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18248f58-f65c-4e4e-9175-d5b546e326d3 service nova] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:25.222926 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18248f58-f65c-4e4e-9175-d5b546e326d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:25.225345 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-18248f58-f65c-4e4e-9175-d5b546e326d3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:25.296732 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-c7b4032d-d5fc-4057-8193-360b2f00b200 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25b9cf09383f40469d04f8ebb88adf58', 'request_id': 'req-c7b4032d-d5fc-4057-8193-360b2f00b200'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:25.314896 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-c7b4032d-d5fc-4057-8193-360b2f00b200 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25b9cf09383f40469d04f8ebb88adf58', 'request_id': 'req-c7b4032d-d5fc-4057-8193-360b2f00b200'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:25.338890 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-c7b4032d-d5fc-4057-8193-360b2f00b200 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25b9cf09383f40469d04f8ebb88adf58', 'request_id': 'req-c7b4032d-d5fc-4057-8193-360b2f00b200'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:25.358629 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:25.369688 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-c7b4032d-d5fc-4057-8193-360b2f00b200 admin admin] The token cache is being invalidate because project 25b9cf09383f40469d04f8ebb88adf58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 10:03:25.371117 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-c7b4032d-d5fc-4057-8193-360b2f00b200 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:25.374006 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-c7b4032d-d5fc-4057-8193-360b2f00b200 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:25.379198 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 850/1712] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 10 10:03:24 2022] DELETE /identity/v3/projects/25b9cf09383f40469d04f8ebb88adf58 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 10:03:25.380370 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18248f58-f65c-4e4e-9175-d5b546e326d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:25.382080 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef7334-0bd1-48e6-93b0-29376505cadc None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:25.383404 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef7334-0bd1-48e6-93b0-29376505cadc None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:25.384106 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef7334-0bd1-48e6-93b0-29376505cadc None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:25.386700 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18248f58-f65c-4e4e-9175-d5b546e326d3 service nova] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:25.389849 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 851/1713] 10.222.0.27 () {54 vars in 961 bytes} [Wed Aug 10 10:03:25 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:03:25.392307 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb6c450-ff06-4c55-b57d-448e73b1fe69 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:25.392957 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb6c450-ff06-4c55-b57d-448e73b1fe69 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:25.395527 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb6c450-ff06-4c55-b57d-448e73b1fe69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:25.421362 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 863/1714] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:03:25 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 10:03:25.430239 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f700c552-d8dd-4610-95ae-9bf533933418 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:25.430590 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f700c552-d8dd-4610-95ae-9bf533933418 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:25.431286 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f700c552-d8dd-4610-95ae-9bf533933418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:25.456000 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-afb6c450-ff06-4c55-b57d-448e73b1fe69 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:03:25.458175 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-afb6c450-ff06-4c55-b57d-448e73b1fe69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:25.478188 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-f700c552-d8dd-4610-95ae-9bf533933418 None None] MFA Rules not processed for user `a6b658f1e27b4dfb96de71dc6a7e9496`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:03:25.479434 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-f700c552-d8dd-4610-95ae-9bf533933418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:25.594650 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 852/1715] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:03:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:03:25.596233 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8476650-b805-4ffb-992e-d056c8ec03b9 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:25.596747 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8476650-b805-4ffb-992e-d056c8ec03b9 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:25.597714 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8476650-b805-4ffb-992e-d056c8ec03b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:25.645474 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 864/1716] 10.222.0.27 () {58 vars in 1058 bytes} [Wed Aug 10 10:03:25 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:03:25.675786 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f700c552-d8dd-4610-95ae-9bf533933418 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:25.689057 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-f700c552-d8dd-4610-95ae-9bf533933418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:25.704525 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-a8476650-b805-4ffb-992e-d056c8ec03b9 None None] MFA Rules not processed for user `15a0177baf4d41e8ad2891b6d5480578`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:03:25.705966 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-a8476650-b805-4ffb-992e-d056c8ec03b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:25.728598 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f700c552-d8dd-4610-95ae-9bf533933418 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:25.742100 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986ac14b-b095-4b1b-b45f-0ad498098f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:25.747221 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ac14b-b095-4b1b-b45f-0ad498098f35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:25.747645 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ac14b-b095-4b1b-b45f-0ad498098f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:25.750472 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ac14b-b095-4b1b-b45f-0ad498098f35 admin admin] PATH_INFO: `/v3/projects/6af98aa6249242339506c9d9041a6517` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:25.773287 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986ac14b-b095-4b1b-b45f-0ad498098f35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6af98aa6249242339506c9d9041a6517)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:25.777810 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986ac14b-b095-4b1b-b45f-0ad498098f35 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:25.923806 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-986ac14b-b095-4b1b-b45f-0ad498098f35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6af98aa6249242339506c9d9041a6517', 'request_id': 'req-986ac14b-b095-4b1b-b45f-0ad498098f35'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:25.936665 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:25.938455 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-986ac14b-b095-4b1b-b45f-0ad498098f35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6af98aa6249242339506c9d9041a6517', 'request_id': 'req-986ac14b-b095-4b1b-b45f-0ad498098f35'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:25.946360 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 853/1717] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:03:25 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:03:25.953895 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8476650-b805-4ffb-992e-d056c8ec03b9 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:25.954557 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-986ac14b-b095-4b1b-b45f-0ad498098f35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6af98aa6249242339506c9d9041a6517', 'request_id': 'req-986ac14b-b095-4b1b-b45f-0ad498098f35'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:25.959134 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-a8476650-b805-4ffb-992e-d056c8ec03b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:26.006204 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-986ac14b-b095-4b1b-b45f-0ad498098f35 admin admin] The token cache is being invalidate because project 6af98aa6249242339506c9d9041a6517 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 10:03:26.007606 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-986ac14b-b095-4b1b-b45f-0ad498098f35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:26.009034 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-986ac14b-b095-4b1b-b45f-0ad498098f35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:26.014921 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 865/1718] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 10 10:03:25 2022] DELETE /identity/v3/projects/6af98aa6249242339506c9d9041a6517 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:03:26.020570 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56194dc-4f9c-4120-bcb0-afdd5e87605f None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:26.021309 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56194dc-4f9c-4120-bcb0-afdd5e87605f None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:26.021309 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56194dc-4f9c-4120-bcb0-afdd5e87605f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:26.074873 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-c56194dc-4f9c-4120-bcb0-afdd5e87605f None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:03:26.077879 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-c56194dc-4f9c-4120-bcb0-afdd5e87605f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:26.138837 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8476650-b805-4ffb-992e-d056c8ec03b9 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:26.173818 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:26.213051 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 866/1719] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:03:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:03:26.213813 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56194dc-4f9c-4120-bcb0-afdd5e87605f None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:26.217524 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-c56194dc-4f9c-4120-bcb0-afdd5e87605f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:26.266562 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07f33a7-d573-4af5-b341-585588a00aca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd8580888cba41a88566da4540b1130c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:26.267336 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07f33a7-d573-4af5-b341-585588a00aca service nova] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:26.267616 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07f33a7-d573-4af5-b341-585588a00aca service nova] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:26.267885 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07f33a7-d573-4af5-b341-585588a00aca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:26.270090 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-f07f33a7-d573-4af5-b341-585588a00aca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:26.339722 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07f33a7-d573-4af5-b341-585588a00aca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:26.341691 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07f33a7-d573-4af5-b341-585588a00aca service nova] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:26.352946 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 854/1720] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:03:25 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:03:26.354297 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07f33a7-d573-4af5-b341-585588a00aca service nova] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:26.355831 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-f07f33a7-d573-4af5-b341-585588a00aca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:26.421280 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56194dc-4f9c-4120-bcb0-afdd5e87605f None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:26.437289 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bddc639-4eb3-4093-96b3-8499481a7eb3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6b658f1e27b4dfb96de71dc6a7e9496', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:26.442113 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bddc639-4eb3-4093-96b3-8499481a7eb3 service placement] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:26.443445 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bddc639-4eb3-4093-96b3-8499481a7eb3 service placement] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:26.443932 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bddc639-4eb3-4093-96b3-8499481a7eb3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:26.449259 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-0bddc639-4eb3-4093-96b3-8499481a7eb3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:26.454363 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07f33a7-d573-4af5-b341-585588a00aca service nova] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:26.459820 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781593f5-8cb4-45a8-b212-71f4cc4ecf8f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6b658f1e27b4dfb96de71dc6a7e9496', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:26.460552 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781593f5-8cb4-45a8-b212-71f4cc4ecf8f service placement] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:26.460831 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781593f5-8cb4-45a8-b212-71f4cc4ecf8f service placement] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:26.461320 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781593f5-8cb4-45a8-b212-71f4cc4ecf8f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:26.472469 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781593f5-8cb4-45a8-b212-71f4cc4ecf8f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:26.474565 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781593f5-8cb4-45a8-b212-71f4cc4ecf8f service placement] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:26.482922 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bddc639-4eb3-4093-96b3-8499481a7eb3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:26.487752 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 855/1721] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:03:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:03:26.489259 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae32b694-f5ea-4a86-8dd9-2eec7aecd492 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:26.489547 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae32b694-f5ea-4a86-8dd9-2eec7aecd492 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:26.489820 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae32b694-f5ea-4a86-8dd9-2eec7aecd492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:26.492553 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bddc639-4eb3-4093-96b3-8499481a7eb3 service placement] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:26.513491 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-ae32b694-f5ea-4a86-8dd9-2eec7aecd492 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:03:26.515142 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-ae32b694-f5ea-4a86-8dd9-2eec7aecd492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:26.517243 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 867/1722] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:03:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:03:26.518168 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bddc639-4eb3-4093-96b3-8499481a7eb3 service placement] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:26.545677 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bddc639-4eb3-4093-96b3-8499481a7eb3 service placement] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:26.553841 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 856/1723] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:03:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:03:26.557951 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafb103c-917a-486e-b5de-de71b171bbbb None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:26.558384 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafb103c-917a-486e-b5de-de71b171bbbb None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:26.558808 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafb103c-917a-486e-b5de-de71b171bbbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:26.559893 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eb6af9-fb22-4c55-a921-dd426943e202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:26.560523 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb6af9-fb22-4c55-a921-dd426943e202 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:26.560801 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb6af9-fb22-4c55-a921-dd426943e202 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:26.561100 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb6af9-fb22-4c55-a921-dd426943e202 admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:26.561743 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eb6af9-fb22-4c55-a921-dd426943e202 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:03:26.562045 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eb6af9-fb22-4c55-a921-dd426943e202 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:26.563690 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eb6af9-fb22-4c55-a921-dd426943e202 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:26.594997 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 868/1724] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 10 10:03:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:03:26.596165 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eb6af9-fb22-4c55-a921-dd426943e202 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:26.603958 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-dafb103c-917a-486e-b5de-de71b171bbbb None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:03:26.608139 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-dafb103c-917a-486e-b5de-de71b171bbbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:26.615951 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eb6af9-fb22-4c55-a921-dd426943e202 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:26.624419 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d214cc9-d19a-4bec-9f88-c8a2601a0184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:26.625045 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d214cc9-d19a-4bec-9f88-c8a2601a0184 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:26.625345 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d214cc9-d19a-4bec-9f88-c8a2601a0184 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:26.625619 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d214cc9-d19a-4bec-9f88-c8a2601a0184 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:26.626428 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d214cc9-d19a-4bec-9f88-c8a2601a0184 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:26.628361 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d214cc9-d19a-4bec-9f88-c8a2601a0184 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:26.629252 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 857/1725] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:03:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:03:26.630600 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafb103c-917a-486e-b5de-de71b171bbbb None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:26.654082 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafb103c-917a-486e-b5de-de71b171bbbb None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:26.666785 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd8d7c9-90cf-4ad0-b2b2-eb6e088578fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:26.668405 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd8d7c9-90cf-4ad0-b2b2-eb6e088578fc admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:26.669599 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd8d7c9-90cf-4ad0-b2b2-eb6e088578fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:26.669599 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd8d7c9-90cf-4ad0-b2b2-eb6e088578fc admin admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:26.674426 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd8d7c9-90cf-4ad0-b2b2-eb6e088578fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:03:26.675040 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd8d7c9-90cf-4ad0-b2b2-eb6e088578fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:26.676969 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd8d7c9-90cf-4ad0-b2b2-eb6e088578fc admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:26.711826 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 858/1726] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 10 10:03:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:03:26.714427 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd8d7c9-90cf-4ad0-b2b2-eb6e088578fc admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:26.723036 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 869/1727] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 10 10:03:26 2022] POST /identity/v3/projects => generated 371 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 10:03:26.747658 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d214cc9-d19a-4bec-9f88-c8a2601a0184 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:26.769776 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd8d7c9-90cf-4ad0-b2b2-eb6e088578fc admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:26.873448 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:26.876826 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:26.910066 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d214cc9-d19a-4bec-9f88-c8a2601a0184 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:26.915842 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc890574-2447-44a5-a92a-d32c70bf7b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:26.917845 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc890574-2447-44a5-a92a-d32c70bf7b81 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:26.917962 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc890574-2447-44a5-a92a-d32c70bf7b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:26.918150 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc890574-2447-44a5-a92a-d32c70bf7b81 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:26.918820 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc890574-2447-44a5-a92a-d32c70bf7b81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:26.922456 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc890574-2447-44a5-a92a-d32c70bf7b81 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:26.996225 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 870/1728] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 10 10:03:26 2022] POST /identity/v3/users => generated 286 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:03:26.997968 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc890574-2447-44a5-a92a-d32c70bf7b81 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:27.032759 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc890574-2447-44a5-a92a-d32c70bf7b81 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:27.062063 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a814ac6-801b-48e0-b6b9-08cea9e484ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:27.062720 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a814ac6-801b-48e0-b6b9-08cea9e484ff admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:27.062989 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a814ac6-801b-48e0-b6b9-08cea9e484ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:27.063259 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a814ac6-801b-48e0-b6b9-08cea9e484ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:27.063921 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a814ac6-801b-48e0-b6b9-08cea9e484ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:27.072071 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a814ac6-801b-48e0-b6b9-08cea9e484ff admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:27.078934 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713ba5d0-2dda-4a69-96e6-71371b747004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:27.079768 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713ba5d0-2dda-4a69-96e6-71371b747004 admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:27.085575 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713ba5d0-2dda-4a69-96e6-71371b747004 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:27.086338 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713ba5d0-2dda-4a69-96e6-71371b747004 admin admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:27.087265 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713ba5d0-2dda-4a69-96e6-71371b747004 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:27.089947 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713ba5d0-2dda-4a69-96e6-71371b747004 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:27.100234 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 871/1729] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:03:26 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:03:27.101149 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a814ac6-801b-48e0-b6b9-08cea9e484ff admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:27.158369 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a814ac6-801b-48e0-b6b9-08cea9e484ff admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:27.181790 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391f36a8-8eaf-4cea-bdd9-b6c97ca40bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:27.182371 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391f36a8-8eaf-4cea-bdd9-b6c97ca40bb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:27.182659 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391f36a8-8eaf-4cea-bdd9-b6c97ca40bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:27.183008 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391f36a8-8eaf-4cea-bdd9-b6c97ca40bb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:27.183678 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391f36a8-8eaf-4cea-bdd9-b6c97ca40bb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:27.193407 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391f36a8-8eaf-4cea-bdd9-b6c97ca40bb4 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:27.194566 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 859/1730] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 10 10:03:26 2022] POST /identity/v3/projects => generated 367 bytes in 482 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:03:27.204659 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713ba5d0-2dda-4a69-96e6-71371b747004 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:27.238058 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 872/1731] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:03:27 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:03:27.243801 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391f36a8-8eaf-4cea-bdd9-b6c97ca40bb4 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:27.273598 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391f36a8-8eaf-4cea-bdd9-b6c97ca40bb4 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:27.408876 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713ba5d0-2dda-4a69-96e6-71371b747004 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:27.423077 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1d093c-2a11-4706-a4c2-a30b8af5e755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:27.425423 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1d093c-2a11-4706-a4c2-a30b8af5e755 admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:27.427373 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1d093c-2a11-4706-a4c2-a30b8af5e755 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:27.428268 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1d093c-2a11-4706-a4c2-a30b8af5e755 admin admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:27.429542 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1d093c-2a11-4706-a4c2-a30b8af5e755 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:27.434116 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1d093c-2a11-4706-a4c2-a30b8af5e755 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:27.487329 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 860/1732] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 10 10:03:27 2022] POST /identity/v3/users => generated 284 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:03:27.488319 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1d093c-2a11-4706-a4c2-a30b8af5e755 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:27.515249 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1d093c-2a11-4706-a4c2-a30b8af5e755 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:27.524287 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b38288-0c98-4394-8677-adff5d792613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:27.525202 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b38288-0c98-4394-8677-adff5d792613 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:27.525640 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b38288-0c98-4394-8677-adff5d792613 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:27.525919 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b38288-0c98-4394-8677-adff5d792613 admin admin] PATH_INFO: `/v3/projects/6b402035bbee4a94aa782964e3a06083/users/c9fe9e594a3f4f4daa1ad2e968e57054/roles/8daabcb6b7394e39b06a3453e33e32db` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:27.532638 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72cd349-8e7f-466f-9723-cc85f1712f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:27.533329 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72cd349-8e7f-466f-9723-cc85f1712f50 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:27.533611 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72cd349-8e7f-466f-9723-cc85f1712f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:27.533887 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72cd349-8e7f-466f-9723-cc85f1712f50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:27.550902 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72cd349-8e7f-466f-9723-cc85f1712f50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:27.552601 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72cd349-8e7f-466f-9723-cc85f1712f50 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:27.572945 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b38288-0c98-4394-8677-adff5d792613 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b402035bbee4a94aa782964e3a06083, user_id=c9fe9e594a3f4f4daa1ad2e968e57054, role_id=8daabcb6b7394e39b06a3453e33e32db)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:27.575545 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b38288-0c98-4394-8677-adff5d792613 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:27.581110 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 861/1733] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:03:27 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:03:27.586533 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72cd349-8e7f-466f-9723-cc85f1712f50 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:27.608185 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72cd349-8e7f-466f-9723-cc85f1712f50 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:27.621533 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 873/1734] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:03:27 2022] PUT /identity/v3/projects/6b402035bbee4a94aa782964e3a06083/users/c9fe9e594a3f4f4daa1ad2e968e57054/roles/8daabcb6b7394e39b06a3453e33e32db => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:03:27.623809 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14b70af-24ec-41f7-8aa7-33792553ff55 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:27.623809 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14b70af-24ec-41f7-8aa7-33792553ff55 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:27.624009 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14b70af-24ec-41f7-8aa7-33792553ff55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:27.779084 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-c14b70af-24ec-41f7-8aa7-33792553ff55 None None] MFA Rules not processed for user `c9fe9e594a3f4f4daa1ad2e968e57054`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:03:27.786212 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-c14b70af-24ec-41f7-8aa7-33792553ff55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:27.837343 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad6a54c-51ea-4002-a096-84b0f6712f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:27.837964 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad6a54c-51ea-4002-a096-84b0f6712f1d admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:27.838264 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad6a54c-51ea-4002-a096-84b0f6712f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:27.838545 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad6a54c-51ea-4002-a096-84b0f6712f1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:27.839166 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad6a54c-51ea-4002-a096-84b0f6712f1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:27.840854 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad6a54c-51ea-4002-a096-84b0f6712f1d admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:27.874573 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 862/1735] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:03:27 2022] GET /identity/v3/roles => generated 1420 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:03:27.875547 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad6a54c-51ea-4002-a096-84b0f6712f1d admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:27.903664 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad6a54c-51ea-4002-a096-84b0f6712f1d admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:27.917486 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08829824-2d05-4fb2-a0d9-107c76e0a15d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:27.918690 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08829824-2d05-4fb2-a0d9-107c76e0a15d admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:27.926092 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08829824-2d05-4fb2-a0d9-107c76e0a15d admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:27.929835 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08829824-2d05-4fb2-a0d9-107c76e0a15d admin admin] PATH_INFO: `/v3/projects/fbf4fdaff9114c3ea7d2f455e292edb7/users/c860028cfd194ac6b050ef0063138a14/roles/8daabcb6b7394e39b06a3453e33e32db` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:27.956987 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08829824-2d05-4fb2-a0d9-107c76e0a15d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbf4fdaff9114c3ea7d2f455e292edb7, user_id=c860028cfd194ac6b050ef0063138a14, role_id=8daabcb6b7394e39b06a3453e33e32db)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:27.960465 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08829824-2d05-4fb2-a0d9-107c76e0a15d admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:27.980347 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:27.990714 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 863/1736] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:03:27 2022] PUT /identity/v3/projects/fbf4fdaff9114c3ea7d2f455e292edb7/users/c860028cfd194ac6b050ef0063138a14/roles/8daabcb6b7394e39b06a3453e33e32db => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:03:28.002312 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55f5308-6c53-43c1-8824-8894b4e1e98c None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:28.003167 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55f5308-6c53-43c1-8824-8894b4e1e98c None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:28.004054 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55f5308-6c53-43c1-8824-8894b4e1e98c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:28.122604 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-e55f5308-6c53-43c1-8824-8894b4e1e98c None None] MFA Rules not processed for user `c860028cfd194ac6b050ef0063138a14`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:03:28.131762 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-e55f5308-6c53-43c1-8824-8894b4e1e98c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:28.187807 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 874/1737] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:03:27 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 565 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:03:28.196825 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14b70af-24ec-41f7-8aa7-33792553ff55 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:28.230764 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14b70af-24ec-41f7-8aa7-33792553ff55 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:28.298975 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:28.417299 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 864/1738] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:03:28 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 416 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:03:28.426212 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb79ea-b01f-4f76-aa16-406e5e803508 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:28.426946 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb79ea-b01f-4f76-aa16-406e5e803508 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:28.432608 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb79ea-b01f-4f76-aa16-406e5e803508 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:28.434345 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 865/1739] 10.222.0.27 () {54 vars in 921 bytes} [Wed Aug 10 10:03:28 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:03:28.435388 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bb79ea-b01f-4f76-aa16-406e5e803508 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:28.569252 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5619a755-c0fa-405d-a104-f24d955d7df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:28.572416 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5619a755-c0fa-405d-a104-f24d955d7df4 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:28.578626 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5619a755-c0fa-405d-a104-f24d955d7df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:28.584168 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5619a755-c0fa-405d-a104-f24d955d7df4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:28.585108 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5619a755-c0fa-405d-a104-f24d955d7df4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:28.587190 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5619a755-c0fa-405d-a104-f24d955d7df4 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:28.723901 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 875/1740] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 10 10:03:28 2022] POST /identity/v3/projects => generated 371 bytes in 532 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:03:28.726845 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04c1967-02cf-410a-af7a-cfb543d6e92e None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:28.727432 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04c1967-02cf-410a-af7a-cfb543d6e92e None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:28.733390 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04c1967-02cf-410a-af7a-cfb543d6e92e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:28.741476 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bb79ea-b01f-4f76-aa16-406e5e803508 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:28.844802 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-b04c1967-02cf-410a-af7a-cfb543d6e92e None None] MFA Rules not processed for user `a6b658f1e27b4dfb96de71dc6a7e9496`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:03:28.847510 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5cdd00-004a-4c63-9955-bec93a074dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:28.848411 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5cdd00-004a-4c63-9955-bec93a074dc7 admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:28.848848 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5cdd00-004a-4c63-9955-bec93a074dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:28.849311 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5cdd00-004a-4c63-9955-bec93a074dc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:28.850243 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5cdd00-004a-4c63-9955-bec93a074dc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:28.852502 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5cdd00-004a-4c63-9955-bec93a074dc7 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:28.861501 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-b04c1967-02cf-410a-af7a-cfb543d6e92e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:28.925137 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 866/1741] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 10 10:03:28 2022] POST /identity/v3/projects => generated 369 bytes in 490 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:03:28.926146 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5cdd00-004a-4c63-9955-bec93a074dc7 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:28.997615 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:29.069115 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 876/1742] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Aug 10 10:03:28 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:03:29.069595 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04c1967-02cf-410a-af7a-cfb543d6e92e None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:29.103582 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5cdd00-004a-4c63-9955-bec93a074dc7 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:29.105950 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04c1967-02cf-410a-af7a-cfb543d6e92e None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:29.119612 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f6434c-9df0-468b-832c-c412633559c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:29.120582 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247ee4fe-6d59-47ee-aebc-d90f55d0ad0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:29.121258 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247ee4fe-6d59-47ee-aebc-d90f55d0ad0a admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:29.121535 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247ee4fe-6d59-47ee-aebc-d90f55d0ad0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:29.121804 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247ee4fe-6d59-47ee-aebc-d90f55d0ad0a admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:29.122448 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247ee4fe-6d59-47ee-aebc-d90f55d0ad0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:29.123560 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f6434c-9df0-468b-832c-c412633559c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:29.126143 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f6434c-9df0-468b-832c-c412633559c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:29.126143 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f6434c-9df0-468b-832c-c412633559c7 admin admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:29.126681 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f6434c-9df0-468b-832c-c412633559c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:29.131550 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f6434c-9df0-468b-832c-c412633559c7 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:29.144796 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247ee4fe-6d59-47ee-aebc-d90f55d0ad0a admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:29.175563 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 867/1743] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 10 10:03:28 2022] POST /identity/v3/users => generated 292 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:03:29.178710 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f6434c-9df0-468b-832c-c412633559c7 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:29.200071 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 877/1744] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 10 10:03:29 2022] POST /identity/v3/users => generated 291 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:03:29.202415 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247ee4fe-6d59-47ee-aebc-d90f55d0ad0a admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:29.202497 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f6434c-9df0-468b-832c-c412633559c7 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:29.211535 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aae6d9-1a9d-4b88-84f8-14983dcb8488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:29.212172 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aae6d9-1a9d-4b88-84f8-14983dcb8488 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:29.212454 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aae6d9-1a9d-4b88-84f8-14983dcb8488 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:29.212725 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aae6d9-1a9d-4b88-84f8-14983dcb8488 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:29.214229 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02aae6d9-1a9d-4b88-84f8-14983dcb8488 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:29.219160 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02aae6d9-1a9d-4b88-84f8-14983dcb8488 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:29.223889 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247ee4fe-6d59-47ee-aebc-d90f55d0ad0a admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:29.234789 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae70dabb-cce6-4351-a496-1f5604a76891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:29.235806 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae70dabb-cce6-4351-a496-1f5604a76891 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:29.236382 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae70dabb-cce6-4351-a496-1f5604a76891 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:29.236898 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae70dabb-cce6-4351-a496-1f5604a76891 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:29.237955 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae70dabb-cce6-4351-a496-1f5604a76891 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:29.240149 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae70dabb-cce6-4351-a496-1f5604a76891 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:29.261005 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 878/1745] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:03:29 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:03:29.262406 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae70dabb-cce6-4351-a496-1f5604a76891 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:29.263279 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 868/1746] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:03:29 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:03:29.267852 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aae6d9-1a9d-4b88-84f8-14983dcb8488 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:29.300348 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aae6d9-1a9d-4b88-84f8-14983dcb8488 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:29.310044 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffea29b-5f4a-4391-8634-34e65ac32c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:29.310791 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffea29b-5f4a-4391-8634-34e65ac32c56 admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:29.311218 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffea29b-5f4a-4391-8634-34e65ac32c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:29.311890 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffea29b-5f4a-4391-8634-34e65ac32c56 admin admin] PATH_INFO: `/v3/projects/81a6e617b4ec430597e6248fb1153755/users/51873a010413410484e68114cc4f1d8c/roles/eb04edc46b3742d7a0f0ead26f68bc22` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:29.319516 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae70dabb-cce6-4351-a496-1f5604a76891 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:29.350635 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954269b2-285a-46a3-a030-6a73d9f36605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:29.354071 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954269b2-285a-46a3-a030-6a73d9f36605 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:29.354489 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954269b2-285a-46a3-a030-6a73d9f36605 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:29.355830 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954269b2-285a-46a3-a030-6a73d9f36605 admin admin] PATH_INFO: `/v3/projects/5b681febfdec434bb21ff269dad2d9e0/users/5a26da402e0d44eb9882034a91665a16/roles/eb04edc46b3742d7a0f0ead26f68bc22` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:29.355945 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffea29b-5f4a-4391-8634-34e65ac32c56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81a6e617b4ec430597e6248fb1153755, user_id=51873a010413410484e68114cc4f1d8c, role_id=eb04edc46b3742d7a0f0ead26f68bc22)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:29.364596 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffea29b-5f4a-4391-8634-34e65ac32c56 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:29.399895 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 869/1747] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:03:29 2022] PUT /identity/v3/projects/81a6e617b4ec430597e6248fb1153755/users/51873a010413410484e68114cc4f1d8c/roles/eb04edc46b3742d7a0f0ead26f68bc22 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:03:29.404610 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffea29b-5f4a-4391-8634-34e65ac32c56 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:29.440429 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954269b2-285a-46a3-a030-6a73d9f36605 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b681febfdec434bb21ff269dad2d9e0, user_id=5a26da402e0d44eb9882034a91665a16, role_id=eb04edc46b3742d7a0f0ead26f68bc22)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:29.452948 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954269b2-285a-46a3-a030-6a73d9f36605 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:29.499059 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 879/1748] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:03:29 2022] PUT /identity/v3/projects/5b681febfdec434bb21ff269dad2d9e0/users/5a26da402e0d44eb9882034a91665a16/roles/eb04edc46b3742d7a0f0ead26f68bc22 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:03:29.501374 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954269b2-285a-46a3-a030-6a73d9f36605 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:29.608924 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffea29b-5f4a-4391-8634-34e65ac32c56 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:29.620689 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:29.656816 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954269b2-285a-46a3-a030-6a73d9f36605 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:29.663006 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0c85c0-ba50-44e8-85d5-75083b3393c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:29.664234 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0c85c0-ba50-44e8-85d5-75083b3393c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:29.664655 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0c85c0-ba50-44e8-85d5-75083b3393c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:29.665200 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0c85c0-ba50-44e8-85d5-75083b3393c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:29.666001 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0c85c0-ba50-44e8-85d5-75083b3393c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:29.667873 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0c85c0-ba50-44e8-85d5-75083b3393c5 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:29.731205 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 880/1749] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:03:29 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:03:29.733950 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0c85c0-ba50-44e8-85d5-75083b3393c5 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:29.761956 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0c85c0-ba50-44e8-85d5-75083b3393c5 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:29.774613 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67451d55-3f8b-4545-99cd-e9fd584682c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:29.777093 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67451d55-3f8b-4545-99cd-e9fd584682c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:29.778824 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67451d55-3f8b-4545-99cd-e9fd584682c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:29.779387 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67451d55-3f8b-4545-99cd-e9fd584682c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:29.782240 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67451d55-3f8b-4545-99cd-e9fd584682c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:29.789929 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67451d55-3f8b-4545-99cd-e9fd584682c0 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:29.805249 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c8c475-d655-450c-8249-8e7bacc37928 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6b658f1e27b4dfb96de71dc6a7e9496', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:29.808987 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c8c475-d655-450c-8249-8e7bacc37928 service placement] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:29.810678 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c8c475-d655-450c-8249-8e7bacc37928 service placement] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:29.810969 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c8c475-d655-450c-8249-8e7bacc37928 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:29.825409 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 881/1750] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:03:29 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:03:29.826284 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67451d55-3f8b-4545-99cd-e9fd584682c0 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:29.842363 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c8c475-d655-450c-8249-8e7bacc37928 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:29.846015 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c8c475-d655-450c-8249-8e7bacc37928 service placement] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:29.874092 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67451d55-3f8b-4545-99cd-e9fd584682c0 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:29.890563 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e963309-b79a-41b0-b864-1db5a7fdf7d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:29.893033 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e963309-b79a-41b0-b864-1db5a7fdf7d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:29.894672 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 870/1751] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:03:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:03:29.895598 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e963309-b79a-41b0-b864-1db5a7fdf7d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:29.897404 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e963309-b79a-41b0-b864-1db5a7fdf7d4 admin admin] PATH_INFO: `/v3/projects/81a6e617b4ec430597e6248fb1153755/users/51873a010413410484e68114cc4f1d8c/roles/eb04edc46b3742d7a0f0ead26f68bc22` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:29.898500 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c8c475-d655-450c-8249-8e7bacc37928 service placement] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:29.904485 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e963309-b79a-41b0-b864-1db5a7fdf7d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81a6e617b4ec430597e6248fb1153755, user_id=51873a010413410484e68114cc4f1d8c, role_id=eb04edc46b3742d7a0f0ead26f68bc22)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:29.917883 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e963309-b79a-41b0-b864-1db5a7fdf7d4 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:29.933643 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c8c475-d655-450c-8249-8e7bacc37928 service placement] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:29.953039 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:29.963330 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 882/1752] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:03:29 2022] PUT /identity/v3/projects/81a6e617b4ec430597e6248fb1153755/users/51873a010413410484e68114cc4f1d8c/roles/eb04edc46b3742d7a0f0ead26f68bc22 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:03:29.978671 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0112b152-cc34-46d1-b328-81887659243f None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:29.978982 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0112b152-cc34-46d1-b328-81887659243f None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:29.981829 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0112b152-cc34-46d1-b328-81887659243f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:30.098106 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-0112b152-cc34-46d1-b328-81887659243f None None] MFA Rules not processed for user `51873a010413410484e68114cc4f1d8c`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:03:30.102347 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-0112b152-cc34-46d1-b328-81887659243f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:30.147397 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fda360-4092-464a-92ef-f67de523c6b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:30.148354 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fda360-4092-464a-92ef-f67de523c6b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:30.149384 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fda360-4092-464a-92ef-f67de523c6b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:30.149694 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fda360-4092-464a-92ef-f67de523c6b9 admin admin] PATH_INFO: `/v3/projects/5b681febfdec434bb21ff269dad2d9e0/users/5a26da402e0d44eb9882034a91665a16/roles/eb04edc46b3742d7a0f0ead26f68bc22` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:30.161448 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fda360-4092-464a-92ef-f67de523c6b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b681febfdec434bb21ff269dad2d9e0, user_id=5a26da402e0d44eb9882034a91665a16, role_id=eb04edc46b3742d7a0f0ead26f68bc22)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:30.165341 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fda360-4092-464a-92ef-f67de523c6b9 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:30.197580 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 871/1753] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:03:29 2022] PUT /identity/v3/projects/5b681febfdec434bb21ff269dad2d9e0/users/5a26da402e0d44eb9882034a91665a16/roles/eb04edc46b3742d7a0f0ead26f68bc22 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:03:30.209977 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8275bbd6-63f8-4b96-84a7-987efd440c96 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:30.212295 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8275bbd6-63f8-4b96-84a7-987efd440c96 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:30.212607 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8275bbd6-63f8-4b96-84a7-987efd440c96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:30.281632 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-8275bbd6-63f8-4b96-84a7-987efd440c96 None None] MFA Rules not processed for user `5a26da402e0d44eb9882034a91665a16`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:03:30.283757 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-8275bbd6-63f8-4b96-84a7-987efd440c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:30.346897 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 883/1754] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:03:29 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:03:30.361498 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0112b152-cc34-46d1-b328-81887659243f None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:30.375032 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-0112b152-cc34-46d1-b328-81887659243f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:30.520728 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 872/1755] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:03:30 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:03:30.536518 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0112b152-cc34-46d1-b328-81887659243f None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:30.542494 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8275bbd6-63f8-4b96-84a7-987efd440c96 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:30.545398 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-8275bbd6-63f8-4b96-84a7-987efd440c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:30.708250 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75cd751-72e6-4d80-b35e-36a2029973a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf8e725cbe0403d943b136235eac057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:30.709804 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75cd751-72e6-4d80-b35e-36a2029973a5 service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:30.710087 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75cd751-72e6-4d80-b35e-36a2029973a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:30.710433 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75cd751-72e6-4d80-b35e-36a2029973a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:30.714486 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8275bbd6-63f8-4b96-84a7-987efd440c96 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:30.720944 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2060dace-7081-4198-8552-14a33601af55 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf8e725cbe0403d943b136235eac057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:30.721905 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2060dace-7081-4198-8552-14a33601af55 service cinder] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:30.722412 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2060dace-7081-4198-8552-14a33601af55 service cinder] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:30.722687 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2060dace-7081-4198-8552-14a33601af55 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:30.737845 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2060dace-7081-4198-8552-14a33601af55 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:30.739684 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2060dace-7081-4198-8552-14a33601af55 service cinder] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:30.752209 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:30.778728 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 873/1756] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:03:30 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 10:03:30.780297 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2060dace-7081-4198-8552-14a33601af55 service cinder] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:30.786707 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-2060dace-7081-4198-8552-14a33601af55 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:30.893199 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:30.918880 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75cd751-72e6-4d80-b35e-36a2029973a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:30.924713 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75cd751-72e6-4d80-b35e-36a2029973a5 service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:30.958854 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 884/1757] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:03:30 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 598 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:03:31.025445 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2060dace-7081-4198-8552-14a33601af55 service cinder] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:31.034567 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd853d4-1c19-4285-8671-0aa0c9a9cde8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:31.035249 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd853d4-1c19-4285-8671-0aa0c9a9cde8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:31.035537 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd853d4-1c19-4285-8671-0aa0c9a9cde8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:31.035813 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd853d4-1c19-4285-8671-0aa0c9a9cde8 admin admin] PATH_INFO: `/v3/users/dabb52b36023498e90aede89e1910383` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:31.040140 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd853d4-1c19-4285-8671-0aa0c9a9cde8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dabb52b36023498e90aede89e1910383)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:31.043621 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd853d4-1c19-4285-8671-0aa0c9a9cde8 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:31.212597 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-afd853d4-1c19-4285-8671-0aa0c9a9cde8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dabb52b36023498e90aede89e1910383'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:31.228056 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-afd853d4-1c19-4285-8671-0aa0c9a9cde8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dabb52b36023498e90aede89e1910383'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:31.241497 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-afd853d4-1c19-4285-8671-0aa0c9a9cde8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dabb52b36023498e90aede89e1910383'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:31.243020 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-afd853d4-1c19-4285-8671-0aa0c9a9cde8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dabb52b36023498e90aede89e1910383'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:31.244398 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-afd853d4-1c19-4285-8671-0aa0c9a9cde8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dabb52b36023498e90aede89e1910383'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:31.286697 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 874/1758] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 10 10:03:30 2022] DELETE /identity/v3/users/dabb52b36023498e90aede89e1910383 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:03:31.328870 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eb6e1e-362c-4dee-a943-0da60d6924d4 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:31.329340 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eb6e1e-362c-4dee-a943-0da60d6924d4 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:31.329741 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eb6e1e-362c-4dee-a943-0da60d6924d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:31.370209 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-39eb6e1e-362c-4dee-a943-0da60d6924d4 None None] MFA Rules not processed for user `63fa6ba87a7a4827af4c5fbd4629b1c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:03:31.372978 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-39eb6e1e-362c-4dee-a943-0da60d6924d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:31.534886 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 885/1759] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:03:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:03:31.595069 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8859450-cb46-4a79-bbda-ad39315b3711 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:31.595340 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8859450-cb46-4a79-bbda-ad39315b3711 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:31.595644 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8859450-cb46-4a79-bbda-ad39315b3711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:31.802180 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-f8859450-cb46-4a79-bbda-ad39315b3711 None None] MFA Rules not processed for user `179709fe7d8343689f096ac0d9a333b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:03:31.803542 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-f8859450-cb46-4a79-bbda-ad39315b3711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:31.999923 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 875/1760] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Aug 10 10:03:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 406 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:03:32.032393 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eb6e1e-362c-4dee-a943-0da60d6924d4 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:32.037642 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-39eb6e1e-362c-4dee-a943-0da60d6924d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:32.225166 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eb6e1e-362c-4dee-a943-0da60d6924d4 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:32.237685 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72245339-5257-4c2f-8e44-10ab2e1822d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:32.238574 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72245339-5257-4c2f-8e44-10ab2e1822d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:32.238999 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72245339-5257-4c2f-8e44-10ab2e1822d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:32.239404 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72245339-5257-4c2f-8e44-10ab2e1822d4 admin admin] PATH_INFO: `/v3/users/c9fe9e594a3f4f4daa1ad2e968e57054` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:32.242460 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72245339-5257-4c2f-8e44-10ab2e1822d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9fe9e594a3f4f4daa1ad2e968e57054)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:32.249732 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72245339-5257-4c2f-8e44-10ab2e1822d4 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:32.298248 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8859450-cb46-4a79-bbda-ad39315b3711 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:32.299769 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-f8859450-cb46-4a79-bbda-ad39315b3711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:32.389017 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-72245339-5257-4c2f-8e44-10ab2e1822d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9fe9e594a3f4f4daa1ad2e968e57054'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:32.393813 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:32.417962 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-72245339-5257-4c2f-8e44-10ab2e1822d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9fe9e594a3f4f4daa1ad2e968e57054'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:32.419714 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-72245339-5257-4c2f-8e44-10ab2e1822d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9fe9e594a3f4f4daa1ad2e968e57054'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:32.420808 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-72245339-5257-4c2f-8e44-10ab2e1822d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9fe9e594a3f4f4daa1ad2e968e57054'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:32.434153 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:32.441274 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-72245339-5257-4c2f-8e44-10ab2e1822d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9fe9e594a3f4f4daa1ad2e968e57054'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:32.527386 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 886/1761] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 10 10:03:32 2022] DELETE /identity/v3/users/c9fe9e594a3f4f4daa1ad2e968e57054 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:03:32.528505 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72245339-5257-4c2f-8e44-10ab2e1822d4 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:32.531712 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-72245339-5257-4c2f-8e44-10ab2e1822d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:32.625203 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8859450-cb46-4a79-bbda-ad39315b3711 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:32.734674 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72245339-5257-4c2f-8e44-10ab2e1822d4 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:32.748772 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cc0dec-54ae-4184-8e0f-186439b91474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:32.749615 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cc0dec-54ae-4184-8e0f-186439b91474 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:32.749900 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cc0dec-54ae-4184-8e0f-186439b91474 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:32.750240 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cc0dec-54ae-4184-8e0f-186439b91474 admin admin] PATH_INFO: `/v3/users/b31867851fa74de5a57a6ea1ef4b79bc` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:32.755236 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cc0dec-54ae-4184-8e0f-186439b91474 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b31867851fa74de5a57a6ea1ef4b79bc)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:32.761838 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cc0dec-54ae-4184-8e0f-186439b91474 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:32.829957 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38cb10e-7269-4251-9361-6f215a0ee105 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b801551d29ff4687ab8c1ce8cfa51614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:32.830593 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38cb10e-7269-4251-9361-6f215a0ee105 service swift] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:32.831015 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38cb10e-7269-4251-9361-6f215a0ee105 service swift] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:32.831588 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38cb10e-7269-4251-9361-6f215a0ee105 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:32.838917 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-a38cb10e-7269-4251-9361-6f215a0ee105 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:32.877557 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-07cc0dec-54ae-4184-8e0f-186439b91474 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b31867851fa74de5a57a6ea1ef4b79bc'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:32.900331 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-07cc0dec-54ae-4184-8e0f-186439b91474 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b31867851fa74de5a57a6ea1ef4b79bc'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:32.901429 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-07cc0dec-54ae-4184-8e0f-186439b91474 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b31867851fa74de5a57a6ea1ef4b79bc'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:32.902403 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-07cc0dec-54ae-4184-8e0f-186439b91474 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b31867851fa74de5a57a6ea1ef4b79bc'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:32.919592 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-07cc0dec-54ae-4184-8e0f-186439b91474 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b31867851fa74de5a57a6ea1ef4b79bc'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:32.943478 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 887/1762] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 10 10:03:32 2022] DELETE /identity/v3/users/b31867851fa74de5a57a6ea1ef4b79bc => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:03:32.945207 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68f2b22-a83c-4040-b3bc-be4009bfe53c None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:32.945662 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68f2b22-a83c-4040-b3bc-be4009bfe53c None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:32.946000 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68f2b22-a83c-4040-b3bc-be4009bfe53c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:32.970488 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-e68f2b22-a83c-4040-b3bc-be4009bfe53c None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:03:32.971861 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-e68f2b22-a83c-4040-b3bc-be4009bfe53c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:33.028064 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38cb10e-7269-4251-9361-6f215a0ee105 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:33.029801 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38cb10e-7269-4251-9361-6f215a0ee105 service swift] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:33.063895 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 876/1763] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Aug 10 10:03:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 766 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 10:03:33.065383 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616e39b3-7f27-4f7a-8209-8394137dbc03 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:33.066157 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616e39b3-7f27-4f7a-8209-8394137dbc03 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:33.066157 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616e39b3-7f27-4f7a-8209-8394137dbc03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:33.075245 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:33.113365 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 888/1764] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:03:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:03:33.129051 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-616e39b3-7f27-4f7a-8209-8394137dbc03 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:03:33.130392 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-616e39b3-7f27-4f7a-8209-8394137dbc03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:33.163696 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 877/1765] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:03:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:03:33.179636 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68f2b22-a83c-4040-b3bc-be4009bfe53c None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:33.181561 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-e68f2b22-a83c-4040-b3bc-be4009bfe53c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:33.313109 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616e39b3-7f27-4f7a-8209-8394137dbc03 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:33.314465 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-616e39b3-7f27-4f7a-8209-8394137dbc03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:33.427918 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68f2b22-a83c-4040-b3bc-be4009bfe53c None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:33.454152 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92124ea1-ab1a-4ed8-9575-4197b81ee661 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4294c170df354fe892831281acd4ea7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:33.454825 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92124ea1-ab1a-4ed8-9575-4197b81ee661 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:33.455204 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92124ea1-ab1a-4ed8-9575-4197b81ee661 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:33.461102 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92124ea1-ab1a-4ed8-9575-4197b81ee661 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:33.496807 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:33.506636 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92124ea1-ab1a-4ed8-9575-4197b81ee661 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:33.512821 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92124ea1-ab1a-4ed8-9575-4197b81ee661 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:33.568205 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616e39b3-7f27-4f7a-8209-8394137dbc03 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:33.570361 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 889/1766] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:03:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:03:33.581348 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eee7c7a-3200-4554-a884-1bfd77a5ab16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4294c170df354fe892831281acd4ea7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:33.582628 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee7c7a-3200-4554-a884-1bfd77a5ab16 service neutron] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:33.583457 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee7c7a-3200-4554-a884-1bfd77a5ab16 service neutron] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:33.584076 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee7c7a-3200-4554-a884-1bfd77a5ab16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:33.600713 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eee7c7a-3200-4554-a884-1bfd77a5ab16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:33.603626 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eee7c7a-3200-4554-a884-1bfd77a5ab16 service neutron] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:33.628342 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 878/1767] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:03:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:03:33.961646 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92124ea1-ab1a-4ed8-9575-4197b81ee661 service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:33.963160 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-92124ea1-ab1a-4ed8-9575-4197b81ee661 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:33.996150 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92124ea1-ab1a-4ed8-9575-4197b81ee661 service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:34.034103 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e4f3b5-34c3-4293-80d6-29f624420246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:34.034803 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e4f3b5-34c3-4293-80d6-29f624420246 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:34.035084 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e4f3b5-34c3-4293-80d6-29f624420246 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:34.035361 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e4f3b5-34c3-4293-80d6-29f624420246 admin admin] PATH_INFO: `/v3/users/c860028cfd194ac6b050ef0063138a14` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:34.042024 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e4f3b5-34c3-4293-80d6-29f624420246 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c860028cfd194ac6b050ef0063138a14)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:34.044115 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e4f3b5-34c3-4293-80d6-29f624420246 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:34.141743 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-10e4f3b5-34c3-4293-80d6-29f624420246 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c860028cfd194ac6b050ef0063138a14'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:34.166179 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-10e4f3b5-34c3-4293-80d6-29f624420246 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c860028cfd194ac6b050ef0063138a14'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:34.167889 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-10e4f3b5-34c3-4293-80d6-29f624420246 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c860028cfd194ac6b050ef0063138a14'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:34.168852 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-10e4f3b5-34c3-4293-80d6-29f624420246 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c860028cfd194ac6b050ef0063138a14'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:34.181324 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-10e4f3b5-34c3-4293-80d6-29f624420246 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c860028cfd194ac6b050ef0063138a14'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:34.218850 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 890/1768] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 10 10:03:33 2022] DELETE /identity/v3/users/c860028cfd194ac6b050ef0063138a14 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:03:34.225537 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb562f0-3378-4ec3-99c8-02361eea0635 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:34.226114 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb562f0-3378-4ec3-99c8-02361eea0635 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:34.226114 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb562f0-3378-4ec3-99c8-02361eea0635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:34.266027 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-7bb562f0-3378-4ec3-99c8-02361eea0635 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:03:34.269796 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-7bb562f0-3378-4ec3-99c8-02361eea0635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:34.424741 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 879/1769] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:03:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:03:34.508113 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e4f3b5-34c3-4293-80d6-29f624420246 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:34.511803 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-10e4f3b5-34c3-4293-80d6-29f624420246 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:34.708806 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e4f3b5-34c3-4293-80d6-29f624420246 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:34.716396 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033015da-a2d8-437b-be57-b25ac55c45d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4294c170df354fe892831281acd4ea7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:34.717185 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033015da-a2d8-437b-be57-b25ac55c45d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:34.717729 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033015da-a2d8-437b-be57-b25ac55c45d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:34.718155 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033015da-a2d8-437b-be57-b25ac55c45d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:34.744949 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033015da-a2d8-437b-be57-b25ac55c45d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:34.746639 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033015da-a2d8-437b-be57-b25ac55c45d3 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:34.768226 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 891/1770] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:03:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:03:35.128046 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb562f0-3378-4ec3-99c8-02361eea0635 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:35.129546 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-7bb562f0-3378-4ec3-99c8-02361eea0635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:35.161747 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb562f0-3378-4ec3-99c8-02361eea0635 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:35.191612 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331d1fe5-9026-42b7-90ea-e63ce0765428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:35.192519 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331d1fe5-9026-42b7-90ea-e63ce0765428 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:35.192809 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331d1fe5-9026-42b7-90ea-e63ce0765428 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:35.195667 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331d1fe5-9026-42b7-90ea-e63ce0765428 admin admin] PATH_INFO: `/v3/projects/7cccccffecde4c328f26be1ddca727f2` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:35.199723 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331d1fe5-9026-42b7-90ea-e63ce0765428 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cccccffecde4c328f26be1ddca727f2)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:35.206399 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331d1fe5-9026-42b7-90ea-e63ce0765428 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:35.218629 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033015da-a2d8-437b-be57-b25ac55c45d3 service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:35.220119 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-033015da-a2d8-437b-be57-b25ac55c45d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:35.246838 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033015da-a2d8-437b-be57-b25ac55c45d3 service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:35.274203 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b382a65-25e4-499d-9b18-8e16709f8cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:35.275175 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b382a65-25e4-499d-9b18-8e16709f8cbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:35.275458 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b382a65-25e4-499d-9b18-8e16709f8cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:35.275731 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b382a65-25e4-499d-9b18-8e16709f8cbb admin admin] PATH_INFO: `/v3/projects/99e9eaf6df5c43b4940b5170bf4df807` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:35.281935 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b382a65-25e4-499d-9b18-8e16709f8cbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=99e9eaf6df5c43b4940b5170bf4df807)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:35.283900 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b382a65-25e4-499d-9b18-8e16709f8cbb admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:35.312433 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:35.392745 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-331d1fe5-9026-42b7-90ea-e63ce0765428 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cccccffecde4c328f26be1ddca727f2', 'request_id': 'req-331d1fe5-9026-42b7-90ea-e63ce0765428'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:35.403276 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-1b382a65-25e4-499d-9b18-8e16709f8cbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99e9eaf6df5c43b4940b5170bf4df807', 'request_id': 'req-1b382a65-25e4-499d-9b18-8e16709f8cbb'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:35.416042 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-331d1fe5-9026-42b7-90ea-e63ce0765428 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cccccffecde4c328f26be1ddca727f2', 'request_id': 'req-331d1fe5-9026-42b7-90ea-e63ce0765428'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:35.419736 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-1b382a65-25e4-499d-9b18-8e16709f8cbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99e9eaf6df5c43b4940b5170bf4df807', 'request_id': 'req-1b382a65-25e4-499d-9b18-8e16709f8cbb'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:35.432007 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-331d1fe5-9026-42b7-90ea-e63ce0765428 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cccccffecde4c328f26be1ddca727f2', 'request_id': 'req-331d1fe5-9026-42b7-90ea-e63ce0765428'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:35.447626 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-1b382a65-25e4-499d-9b18-8e16709f8cbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99e9eaf6df5c43b4940b5170bf4df807', 'request_id': 'req-1b382a65-25e4-499d-9b18-8e16709f8cbb'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:35.464522 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-331d1fe5-9026-42b7-90ea-e63ce0765428 admin admin] The token cache is being invalidate because project 7cccccffecde4c328f26be1ddca727f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 10:03:35.464815 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-331d1fe5-9026-42b7-90ea-e63ce0765428 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:35.467336 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-331d1fe5-9026-42b7-90ea-e63ce0765428 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:35.468688 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-1b382a65-25e4-499d-9b18-8e16709f8cbb admin admin] The token cache is being invalidate because project 99e9eaf6df5c43b4940b5170bf4df807 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 10:03:35.468986 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-1b382a65-25e4-499d-9b18-8e16709f8cbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:35.470275 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-1b382a65-25e4-499d-9b18-8e16709f8cbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:35.473736 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 880/1772] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 10 10:03:35 2022] DELETE /identity/v3/projects/7cccccffecde4c328f26be1ddca727f2 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:03:35.475511 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59e0584-28dd-49fa-8147-918a46642d32 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:35.476040 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59e0584-28dd-49fa-8147-918a46642d32 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:35.477427 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59e0584-28dd-49fa-8147-918a46642d32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:35.477548 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 892/1772] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 10 10:03:35 2022] DELETE /identity/v3/projects/99e9eaf6df5c43b4940b5170bf4df807 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 10:03:35.478760 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b382a65-25e4-499d-9b18-8e16709f8cbb admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:35.481795 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-1b382a65-25e4-499d-9b18-8e16709f8cbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:35.526310 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-c59e0584-28dd-49fa-8147-918a46642d32 None None] MFA Rules not processed for user `4294c170df354fe892831281acd4ea7d`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:03:35.528294 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-c59e0584-28dd-49fa-8147-918a46642d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:35.627760 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 881/1773] 10.222.0.40 () {58 vars in 1015 bytes} [Wed Aug 10 10:03:35 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:03:35.631059 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59e0584-28dd-49fa-8147-918a46642d32 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:35.635324 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-c59e0584-28dd-49fa-8147-918a46642d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:35.663504 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59e0584-28dd-49fa-8147-918a46642d32 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:35.671579 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce954e9-5dfb-4b5f-beb5-5fb6317cdd24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:35.672066 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b382a65-25e4-499d-9b18-8e16709f8cbb admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:35.673218 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce954e9-5dfb-4b5f-beb5-5fb6317cdd24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:35.673218 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce954e9-5dfb-4b5f-beb5-5fb6317cdd24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:35.673472 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce954e9-5dfb-4b5f-beb5-5fb6317cdd24 admin admin] PATH_INFO: `/v3/users/15a0177baf4d41e8ad2891b6d5480578` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:35.675250 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce954e9-5dfb-4b5f-beb5-5fb6317cdd24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15a0177baf4d41e8ad2891b6d5480578)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:35.677445 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce954e9-5dfb-4b5f-beb5-5fb6317cdd24 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:35.687150 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:35.689422 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c200eba-63cd-4c53-90e1-2370109763ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:35.690434 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c200eba-63cd-4c53-90e1-2370109763ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:35.691786 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c200eba-63cd-4c53-90e1-2370109763ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:35.692773 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c200eba-63cd-4c53-90e1-2370109763ba admin admin] PATH_INFO: `/v3/users/b3a274c8380a481baed98092a789c9d0` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:35.696762 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c200eba-63cd-4c53-90e1-2370109763ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3a274c8380a481baed98092a789c9d0)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:35.703790 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c200eba-63cd-4c53-90e1-2370109763ba admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:35.805206 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-1ce954e9-5dfb-4b5f-beb5-5fb6317cdd24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15a0177baf4d41e8ad2891b6d5480578'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:35.840303 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-1ce954e9-5dfb-4b5f-beb5-5fb6317cdd24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15a0177baf4d41e8ad2891b6d5480578'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:35.853134 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-1c200eba-63cd-4c53-90e1-2370109763ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3a274c8380a481baed98092a789c9d0'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:35.862840 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-1c200eba-63cd-4c53-90e1-2370109763ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3a274c8380a481baed98092a789c9d0'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:35.863858 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-1c200eba-63cd-4c53-90e1-2370109763ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3a274c8380a481baed98092a789c9d0'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:35.864994 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-1c200eba-63cd-4c53-90e1-2370109763ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3a274c8380a481baed98092a789c9d0'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:35.871971 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-1ce954e9-5dfb-4b5f-beb5-5fb6317cdd24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15a0177baf4d41e8ad2891b6d5480578'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:35.872755 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-1ce954e9-5dfb-4b5f-beb5-5fb6317cdd24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15a0177baf4d41e8ad2891b6d5480578'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:35.873736 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-1ce954e9-5dfb-4b5f-beb5-5fb6317cdd24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15a0177baf4d41e8ad2891b6d5480578'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:35.906326 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-1c200eba-63cd-4c53-90e1-2370109763ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3a274c8380a481baed98092a789c9d0'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:35.931901 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 882/1774] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 10 10:03:35 2022] DELETE /identity/v3/users/15a0177baf4d41e8ad2891b6d5480578 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:03:35.933454 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce954e9-5dfb-4b5f-beb5-5fb6317cdd24 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:35.935043 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-1ce954e9-5dfb-4b5f-beb5-5fb6317cdd24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:35.960971 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 893/1775] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 10 10:03:35 2022] DELETE /identity/v3/users/b3a274c8380a481baed98092a789c9d0 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:03:35.961959 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c200eba-63cd-4c53-90e1-2370109763ba admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:35.965425 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-1c200eba-63cd-4c53-90e1-2370109763ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:36.006331 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:36.129998 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c200eba-63cd-4c53-90e1-2370109763ba admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:36.142667 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce954e9-5dfb-4b5f-beb5-5fb6317cdd24 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:36.142804 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fad6b9-1f33-4185-bd96-8bf4bf5c4bad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4294c170df354fe892831281acd4ea7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:36.143403 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fad6b9-1f33-4185-bd96-8bf4bf5c4bad service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:36.145935 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fad6b9-1f33-4185-bd96-8bf4bf5c4bad service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:36.147024 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fad6b9-1f33-4185-bd96-8bf4bf5c4bad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:36.152050 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-f8fad6b9-1f33-4185-bd96-8bf4bf5c4bad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:36.211110 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fad6b9-1f33-4185-bd96-8bf4bf5c4bad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:36.215275 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fad6b9-1f33-4185-bd96-8bf4bf5c4bad service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:36.240533 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 894/1776] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:03:35 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:03:36.247251 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fad6b9-1f33-4185-bd96-8bf4bf5c4bad service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:36.251052 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-f8fad6b9-1f33-4185-bd96-8bf4bf5c4bad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:36.284862 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fad6b9-1f33-4185-bd96-8bf4bf5c4bad service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:36.297287 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799d5223-ce14-44ab-8e40-d872accfa503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:36.299414 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799d5223-ce14-44ab-8e40-d872accfa503 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:36.299713 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799d5223-ce14-44ab-8e40-d872accfa503 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:36.301083 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799d5223-ce14-44ab-8e40-d872accfa503 admin admin] PATH_INFO: `/v3/projects/6b402035bbee4a94aa782964e3a06083` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:36.304883 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799d5223-ce14-44ab-8e40-d872accfa503 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b402035bbee4a94aa782964e3a06083)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:36.316455 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799d5223-ce14-44ab-8e40-d872accfa503 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:36.322585 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02db85c6-2088-48cf-b39e-5a6e49221a89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4294c170df354fe892831281acd4ea7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:36.326708 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02db85c6-2088-48cf-b39e-5a6e49221a89 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:36.326996 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02db85c6-2088-48cf-b39e-5a6e49221a89 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:36.327275 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02db85c6-2088-48cf-b39e-5a6e49221a89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:36.383605 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02db85c6-2088-48cf-b39e-5a6e49221a89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:36.385053 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02db85c6-2088-48cf-b39e-5a6e49221a89 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:36.454392 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:36.465583 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 895/1777] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:03:36 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:03:36.467373 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece12755-ad15-48d4-abd1-0e209c14d737 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:36.467799 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece12755-ad15-48d4-abd1-0e209c14d737 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:36.468481 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece12755-ad15-48d4-abd1-0e209c14d737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:36.479195 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-799d5223-ce14-44ab-8e40-d872accfa503 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b402035bbee4a94aa782964e3a06083', 'request_id': 'req-799d5223-ce14-44ab-8e40-d872accfa503'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:36.511388 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-799d5223-ce14-44ab-8e40-d872accfa503 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b402035bbee4a94aa782964e3a06083', 'request_id': 'req-799d5223-ce14-44ab-8e40-d872accfa503'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:36.536758 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-799d5223-ce14-44ab-8e40-d872accfa503 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b402035bbee4a94aa782964e3a06083', 'request_id': 'req-799d5223-ce14-44ab-8e40-d872accfa503'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:36.541277 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-ece12755-ad15-48d4-abd1-0e209c14d737 None None] MFA Rules not processed for user `05de322f3f174bc195a58a108c9387da`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:03:36.542596 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-ece12755-ad15-48d4-abd1-0e209c14d737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:36.560458 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-799d5223-ce14-44ab-8e40-d872accfa503 admin admin] The token cache is being invalidate because project 6b402035bbee4a94aa782964e3a06083 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 10:03:36.563738 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-799d5223-ce14-44ab-8e40-d872accfa503 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:36.564897 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-799d5223-ce14-44ab-8e40-d872accfa503 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:36.566608 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 883/1778] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 10 10:03:35 2022] DELETE /identity/v3/projects/6b402035bbee4a94aa782964e3a06083 => generated 0 bytes in 634 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:03:36.572351 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799d5223-ce14-44ab-8e40-d872accfa503 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:36.575220 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-799d5223-ce14-44ab-8e40-d872accfa503 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:36.748400 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799d5223-ce14-44ab-8e40-d872accfa503 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:36.757208 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7350af-9cce-464f-bf4b-4593ab93cd04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:36.758286 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7350af-9cce-464f-bf4b-4593ab93cd04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:36.758897 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7350af-9cce-464f-bf4b-4593ab93cd04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:36.759310 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7350af-9cce-464f-bf4b-4593ab93cd04 admin admin] PATH_INFO: `/v3/users/51873a010413410484e68114cc4f1d8c` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:36.764490 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7350af-9cce-464f-bf4b-4593ab93cd04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51873a010413410484e68114cc4f1d8c)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:36.766946 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7350af-9cce-464f-bf4b-4593ab93cd04 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:36.797920 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 896/1779] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:03:36 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:03:36.970277 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-8f7350af-9cce-464f-bf4b-4593ab93cd04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51873a010413410484e68114cc4f1d8c'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:36.992711 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-8f7350af-9cce-464f-bf4b-4593ab93cd04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51873a010413410484e68114cc4f1d8c'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:37.041902 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-8f7350af-9cce-464f-bf4b-4593ab93cd04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51873a010413410484e68114cc4f1d8c'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:37.043381 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-8f7350af-9cce-464f-bf4b-4593ab93cd04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51873a010413410484e68114cc4f1d8c'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:37.043825 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-8f7350af-9cce-464f-bf4b-4593ab93cd04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51873a010413410484e68114cc4f1d8c'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:37.084338 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 884/1780] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 10 10:03:36 2022] DELETE /identity/v3/users/51873a010413410484e68114cc4f1d8c => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:03:37.125927 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece12755-ad15-48d4-abd1-0e209c14d737 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:37.128525 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-ece12755-ad15-48d4-abd1-0e209c14d737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:37.146457 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece12755-ad15-48d4-abd1-0e209c14d737 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:37.315539 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b5d708-a2c4-4ce8-a1e8-f70e0beecc17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:37.317409 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b5d708-a2c4-4ce8-a1e8-f70e0beecc17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:37.317704 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b5d708-a2c4-4ce8-a1e8-f70e0beecc17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:37.320470 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b5d708-a2c4-4ce8-a1e8-f70e0beecc17 admin admin] PATH_INFO: `/v3/projects/bd7ffb6546a24006be2407bb04c744f5` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:37.323130 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b5d708-a2c4-4ce8-a1e8-f70e0beecc17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd7ffb6546a24006be2407bb04c744f5)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:37.327274 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b5d708-a2c4-4ce8-a1e8-f70e0beecc17 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:37.474457 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-86b5d708-a2c4-4ce8-a1e8-f70e0beecc17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd7ffb6546a24006be2407bb04c744f5', 'request_id': 'req-86b5d708-a2c4-4ce8-a1e8-f70e0beecc17'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:37.487536 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:37.500403 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-86b5d708-a2c4-4ce8-a1e8-f70e0beecc17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd7ffb6546a24006be2407bb04c744f5', 'request_id': 'req-86b5d708-a2c4-4ce8-a1e8-f70e0beecc17'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:37.534611 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-86b5d708-a2c4-4ce8-a1e8-f70e0beecc17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd7ffb6546a24006be2407bb04c744f5', 'request_id': 'req-86b5d708-a2c4-4ce8-a1e8-f70e0beecc17'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:37.560674 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-86b5d708-a2c4-4ce8-a1e8-f70e0beecc17 admin admin] The token cache is being invalidate because project bd7ffb6546a24006be2407bb04c744f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 10:03:37.561320 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-86b5d708-a2c4-4ce8-a1e8-f70e0beecc17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:37.562732 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7350af-9cce-464f-bf4b-4593ab93cd04 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:37.566047 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-86b5d708-a2c4-4ce8-a1e8-f70e0beecc17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:37.570457 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 897/1781] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 10 10:03:37 2022] DELETE /identity/v3/projects/bd7ffb6546a24006be2407bb04c744f5 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:03:37.571302 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-8f7350af-9cce-464f-bf4b-4593ab93cd04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:37.575768 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae59be-4c8b-46c5-a99e-2cff4e4e9520 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:37.576210 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae59be-4c8b-46c5-a99e-2cff4e4e9520 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:37.576540 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae59be-4c8b-46c5-a99e-2cff4e4e9520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:37.626552 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7350af-9cce-464f-bf4b-4593ab93cd04 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:37.663523 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-07ae59be-4c8b-46c5-a99e-2cff4e4e9520 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:03:37.664798 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-07ae59be-4c8b-46c5-a99e-2cff4e4e9520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:37.792987 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:37.832645 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 898/1782] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:03:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:03:37.835973 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1fca3f-240e-49fd-bdc3-ac525adc65fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:37.836729 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1fca3f-240e-49fd-bdc3-ac525adc65fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:37.837260 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1fca3f-240e-49fd-bdc3-ac525adc65fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:37.837501 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1fca3f-240e-49fd-bdc3-ac525adc65fe admin admin] PATH_INFO: `/v3/projects/fbf4fdaff9114c3ea7d2f455e292edb7` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:37.840399 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42bec44-a6de-46ea-858f-61d47f92037b None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:37.841996 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42bec44-a6de-46ea-858f-61d47f92037b None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:37.842359 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42bec44-a6de-46ea-858f-61d47f92037b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:37.850517 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1fca3f-240e-49fd-bdc3-ac525adc65fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbf4fdaff9114c3ea7d2f455e292edb7)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:37.856572 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1fca3f-240e-49fd-bdc3-ac525adc65fe admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:37.897693 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-a42bec44-a6de-46ea-858f-61d47f92037b None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:03:37.899199 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-a42bec44-a6de-46ea-858f-61d47f92037b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:37.940214 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 899/1783] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:03:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 10:03:37.946811 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42bec44-a6de-46ea-858f-61d47f92037b None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:37.969556 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-bf1fca3f-240e-49fd-bdc3-ac525adc65fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbf4fdaff9114c3ea7d2f455e292edb7', 'request_id': 'req-bf1fca3f-240e-49fd-bdc3-ac525adc65fe'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:37.979267 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42bec44-a6de-46ea-858f-61d47f92037b None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:37.980644 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-bf1fca3f-240e-49fd-bdc3-ac525adc65fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbf4fdaff9114c3ea7d2f455e292edb7', 'request_id': 'req-bf1fca3f-240e-49fd-bdc3-ac525adc65fe'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:37.998308 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-bf1fca3f-240e-49fd-bdc3-ac525adc65fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbf4fdaff9114c3ea7d2f455e292edb7', 'request_id': 'req-bf1fca3f-240e-49fd-bdc3-ac525adc65fe'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:38.015689 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-bf1fca3f-240e-49fd-bdc3-ac525adc65fe admin admin] The token cache is being invalidate because project fbf4fdaff9114c3ea7d2f455e292edb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 10:03:38.015840 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-bf1fca3f-240e-49fd-bdc3-ac525adc65fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:38.016536 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-bf1fca3f-240e-49fd-bdc3-ac525adc65fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:38.021459 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 885/1784] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 10 10:03:37 2022] DELETE /identity/v3/projects/fbf4fdaff9114c3ea7d2f455e292edb7 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 10:03:38.022183 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1fca3f-240e-49fd-bdc3-ac525adc65fe admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:38.030467 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-bf1fca3f-240e-49fd-bdc3-ac525adc65fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:38.229901 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1fca3f-240e-49fd-bdc3-ac525adc65fe admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:38.247588 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc758896-68a9-495a-a61e-c3fd0949d183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:38.248316 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc758896-68a9-495a-a61e-c3fd0949d183 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:38.248592 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc758896-68a9-495a-a61e-c3fd0949d183 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:38.248865 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc758896-68a9-495a-a61e-c3fd0949d183 admin admin] PATH_INFO: `/v3/users/5a26da402e0d44eb9882034a91665a16` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:38.257986 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc758896-68a9-495a-a61e-c3fd0949d183 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a26da402e0d44eb9882034a91665a16)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:38.263774 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc758896-68a9-495a-a61e-c3fd0949d183 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:38.293903 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f84d9a-f6fe-413c-8fa9-f16c04110c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:38.295221 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f84d9a-f6fe-413c-8fa9-f16c04110c1c admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:38.296063 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f84d9a-f6fe-413c-8fa9-f16c04110c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:38.300064 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f84d9a-f6fe-413c-8fa9-f16c04110c1c admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:38.300816 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f84d9a-f6fe-413c-8fa9-f16c04110c1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:03:38.302978 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f84d9a-f6fe-413c-8fa9-f16c04110c1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:38.317704 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f84d9a-f6fe-413c-8fa9-f16c04110c1c admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:38.349906 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 900/1785] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 10 10:03:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 407 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:03:38.351395 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f84d9a-f6fe-413c-8fa9-f16c04110c1c admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:38.354164 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-20f84d9a-f6fe-413c-8fa9-f16c04110c1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:38.383730 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f84d9a-f6fe-413c-8fa9-f16c04110c1c admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:38.395103 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-dc758896-68a9-495a-a61e-c3fd0949d183 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a26da402e0d44eb9882034a91665a16'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:38.402484 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c338e401-8f47-4cbc-8c35-808b5780ecfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:38.403171 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c338e401-8f47-4cbc-8c35-808b5780ecfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:38.403452 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c338e401-8f47-4cbc-8c35-808b5780ecfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:38.403724 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c338e401-8f47-4cbc-8c35-808b5780ecfe admin admin] PATH_INFO: `/v3/projects/4c61853d79104ce2a296ca45b2f80ee7` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:38.406089 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c338e401-8f47-4cbc-8c35-808b5780ecfe admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c61853d79104ce2a296ca45b2f80ee7)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:38.408010 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c338e401-8f47-4cbc-8c35-808b5780ecfe admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:38.415445 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-dc758896-68a9-495a-a61e-c3fd0949d183 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a26da402e0d44eb9882034a91665a16'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:38.442336 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-dc758896-68a9-495a-a61e-c3fd0949d183 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a26da402e0d44eb9882034a91665a16'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:38.443365 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-dc758896-68a9-495a-a61e-c3fd0949d183 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a26da402e0d44eb9882034a91665a16'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:38.444271 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-dc758896-68a9-495a-a61e-c3fd0949d183 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a26da402e0d44eb9882034a91665a16'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:38.461165 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:38.483273 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 886/1786] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 10 10:03:38 2022] DELETE /identity/v3/users/5a26da402e0d44eb9882034a91665a16 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:03:38.483273 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc758896-68a9-495a-a61e-c3fd0949d183 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:38.486060 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-dc758896-68a9-495a-a61e-c3fd0949d183 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:38.561199 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-c338e401-8f47-4cbc-8c35-808b5780ecfe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c61853d79104ce2a296ca45b2f80ee7', 'request_id': 'req-c338e401-8f47-4cbc-8c35-808b5780ecfe'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:38.570052 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-c338e401-8f47-4cbc-8c35-808b5780ecfe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c61853d79104ce2a296ca45b2f80ee7', 'request_id': 'req-c338e401-8f47-4cbc-8c35-808b5780ecfe'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:38.576059 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:38.592580 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-c338e401-8f47-4cbc-8c35-808b5780ecfe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c61853d79104ce2a296ca45b2f80ee7', 'request_id': 'req-c338e401-8f47-4cbc-8c35-808b5780ecfe'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:38.626102 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-c338e401-8f47-4cbc-8c35-808b5780ecfe admin admin] The token cache is being invalidate because project 4c61853d79104ce2a296ca45b2f80ee7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 10:03:38.627067 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-c338e401-8f47-4cbc-8c35-808b5780ecfe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:38.627969 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-c338e401-8f47-4cbc-8c35-808b5780ecfe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:38.636514 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 901/1787] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 10 10:03:38 2022] DELETE /identity/v3/projects/4c61853d79104ce2a296ca45b2f80ee7 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:03:38.641690 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dbbfdc-1de7-4213-93a5-95051ec2ef5b None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:38.642106 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dbbfdc-1de7-4213-93a5-95051ec2ef5b None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:38.642636 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dbbfdc-1de7-4213-93a5-95051ec2ef5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:38.654076 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc758896-68a9-495a-a61e-c3fd0949d183 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:38.767668 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-51dbbfdc-1de7-4213-93a5-95051ec2ef5b None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:03:38.775496 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-51dbbfdc-1de7-4213-93a5-95051ec2ef5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:38.836839 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43de28c9-6a4d-4322-a85e-ac6d8c6a72bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:38.837790 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de28c9-6a4d-4322-a85e-ac6d8c6a72bf admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:38.838234 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de28c9-6a4d-4322-a85e-ac6d8c6a72bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:38.838670 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de28c9-6a4d-4322-a85e-ac6d8c6a72bf admin admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:38.839567 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43de28c9-6a4d-4322-a85e-ac6d8c6a72bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:38.841798 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43de28c9-6a4d-4322-a85e-ac6d8c6a72bf admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:38.894621 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 887/1788] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 10 10:03:38 2022] POST /identity/v3/projects => generated 365 bytes in 408 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:03:38.901303 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43de28c9-6a4d-4322-a85e-ac6d8c6a72bf admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:38.907675 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-43de28c9-6a4d-4322-a85e-ac6d8c6a72bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:38.971136 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 902/1789] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:03:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:03:38.981126 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2193b481-ed92-4aa3-8e0a-60982c80443f None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:38.981660 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2193b481-ed92-4aa3-8e0a-60982c80443f None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:38.982034 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2193b481-ed92-4aa3-8e0a-60982c80443f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:39.008852 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-2193b481-ed92-4aa3-8e0a-60982c80443f None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:03:39.010649 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-2193b481-ed92-4aa3-8e0a-60982c80443f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:39.101434 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43de28c9-6a4d-4322-a85e-ac6d8c6a72bf admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:39.111136 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d844f7-34c0-4f56-8cbc-6195fa53b912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:39.112534 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d844f7-34c0-4f56-8cbc-6195fa53b912 admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:39.112820 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d844f7-34c0-4f56-8cbc-6195fa53b912 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:39.113131 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d844f7-34c0-4f56-8cbc-6195fa53b912 admin admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:39.113839 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d844f7-34c0-4f56-8cbc-6195fa53b912 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:39.116574 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d844f7-34c0-4f56-8cbc-6195fa53b912 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:39.161339 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 888/1790] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 10 10:03:38 2022] POST /identity/v3/users => generated 283 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:03:39.162432 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d844f7-34c0-4f56-8cbc-6195fa53b912 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:39.177366 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d844f7-34c0-4f56-8cbc-6195fa53b912 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:39.184721 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e895c086-3fc5-40c7-9de4-607b14ded7b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:39.185465 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e895c086-3fc5-40c7-9de4-607b14ded7b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:39.185749 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e895c086-3fc5-40c7-9de4-607b14ded7b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:39.192382 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e895c086-3fc5-40c7-9de4-607b14ded7b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:39.193536 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e895c086-3fc5-40c7-9de4-607b14ded7b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:39.196250 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e895c086-3fc5-40c7-9de4-607b14ded7b7 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:39.233784 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 889/1791] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:03:39 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:03:39.234808 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e895c086-3fc5-40c7-9de4-607b14ded7b7 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:39.242571 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=95,keystone:DELETE=1,keystone:INSERT=4 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:39.248345 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e895c086-3fc5-40c7-9de4-607b14ded7b7 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:39.258353 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399afba1-ba34-4d40-b4de-4ead1b904471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:39.258732 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 903/1792] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:03:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:03:39.259644 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399afba1-ba34-4d40-b4de-4ead1b904471 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:39.260350 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399afba1-ba34-4d40-b4de-4ead1b904471 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:39.260900 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399afba1-ba34-4d40-b4de-4ead1b904471 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:39.262117 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399afba1-ba34-4d40-b4de-4ead1b904471 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:39.264083 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399afba1-ba34-4d40-b4de-4ead1b904471 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:39.264277 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2193b481-ed92-4aa3-8e0a-60982c80443f None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:39.280187 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 890/1793] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:03:39 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:03:39.282973 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399afba1-ba34-4d40-b4de-4ead1b904471 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:39.298201 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2193b481-ed92-4aa3-8e0a-60982c80443f None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:39.306810 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399afba1-ba34-4d40-b4de-4ead1b904471 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:39.315550 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782e2cb3-d215-4b27-8cb1-30f0ba942dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:39.315550 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782e2cb3-d215-4b27-8cb1-30f0ba942dd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:39.316112 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782e2cb3-d215-4b27-8cb1-30f0ba942dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:39.316675 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782e2cb3-d215-4b27-8cb1-30f0ba942dd0 admin admin] PATH_INFO: `/v3/projects/1e706130ad894745b581de904f25d5f2/users/4db888ac9aad4813a5a6c7793afda81d/roles/8daabcb6b7394e39b06a3453e33e32db` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:39.322791 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8e75d1-2021-4e98-b405-388cb5a7c6e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:39.323546 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8e75d1-2021-4e98-b405-388cb5a7c6e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:39.323807 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8e75d1-2021-4e98-b405-388cb5a7c6e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:39.324075 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8e75d1-2021-4e98-b405-388cb5a7c6e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:39.324744 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8e75d1-2021-4e98-b405-388cb5a7c6e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:03:39.325052 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8e75d1-2021-4e98-b405-388cb5a7c6e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:39.326688 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8e75d1-2021-4e98-b405-388cb5a7c6e3 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:39.372479 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782e2cb3-d215-4b27-8cb1-30f0ba942dd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e706130ad894745b581de904f25d5f2, user_id=4db888ac9aad4813a5a6c7793afda81d, role_id=8daabcb6b7394e39b06a3453e33e32db)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:39.377868 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 904/1794] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 10 10:03:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:03:39.381606 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8e75d1-2021-4e98-b405-388cb5a7c6e3 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:39.388747 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782e2cb3-d215-4b27-8cb1-30f0ba942dd0 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:39.405012 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8e75d1-2021-4e98-b405-388cb5a7c6e3 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:39.438728 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 891/1795] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:03:39 2022] PUT /identity/v3/projects/1e706130ad894745b581de904f25d5f2/users/4db888ac9aad4813a5a6c7793afda81d/roles/8daabcb6b7394e39b06a3453e33e32db => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:03:39.454188 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dbaabb-0038-41a4-8806-e7a3362ec5bf None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:39.454637 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dbaabb-0038-41a4-8806-e7a3362ec5bf None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:39.455063 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dbaabb-0038-41a4-8806-e7a3362ec5bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:39.547063 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-d2dbaabb-0038-41a4-8806-e7a3362ec5bf None None] MFA Rules not processed for user `4db888ac9aad4813a5a6c7793afda81d`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:03:39.548002 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f65811d-a0d4-4461-b11c-8ba93f20be4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:39.548355 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-d2dbaabb-0038-41a4-8806-e7a3362ec5bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:39.550569 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f65811d-a0d4-4461-b11c-8ba93f20be4c admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:39.550914 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f65811d-a0d4-4461-b11c-8ba93f20be4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:39.551852 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f65811d-a0d4-4461-b11c-8ba93f20be4c admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:39.554441 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f65811d-a0d4-4461-b11c-8ba93f20be4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:39.569774 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f65811d-a0d4-4461-b11c-8ba93f20be4c admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:39.668322 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 905/1796] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 10 10:03:39 2022] POST /identity/v3/projects => generated 375 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:03:39.674942 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f65811d-a0d4-4461-b11c-8ba93f20be4c admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:39.701822 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:39.791055 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 892/1797] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:03:39 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 10:03:39.792669 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dbaabb-0038-41a4-8806-e7a3362ec5bf None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:39.799222 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-d2dbaabb-0038-41a4-8806-e7a3362ec5bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:39.845001 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dbaabb-0038-41a4-8806-e7a3362ec5bf None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:39.900453 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f65811d-a0d4-4461-b11c-8ba93f20be4c admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:39.912730 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd588e1-d1c3-4550-aec8-1c4936d20219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:39.913443 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd588e1-d1c3-4550-aec8-1c4936d20219 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:39.913732 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd588e1-d1c3-4550-aec8-1c4936d20219 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:39.913939 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd588e1-d1c3-4550-aec8-1c4936d20219 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:39.915425 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd588e1-d1c3-4550-aec8-1c4936d20219 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:39.919005 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd588e1-d1c3-4550-aec8-1c4936d20219 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:39.985495 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 906/1798] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 10 10:03:39 2022] POST /identity/v3/users => generated 288 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:03:39.987103 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd588e1-d1c3-4550-aec8-1c4936d20219 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:40.012796 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd588e1-d1c3-4550-aec8-1c4936d20219 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:40.024457 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29604c2f-157b-4a74-b87b-049cbcd4bacc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:40.025236 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29604c2f-157b-4a74-b87b-049cbcd4bacc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:40.025608 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29604c2f-157b-4a74-b87b-049cbcd4bacc admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:40.025955 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29604c2f-157b-4a74-b87b-049cbcd4bacc admin admin] PATH_INFO: `/v3/projects/81a6e617b4ec430597e6248fb1153755` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:40.026417 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7fde07-3384-4d75-9280-669951f0134b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:40.027532 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7fde07-3384-4d75-9280-669951f0134b admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:40.027862 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7fde07-3384-4d75-9280-669951f0134b admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:40.028137 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7fde07-3384-4d75-9280-669951f0134b admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:40.028853 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29604c2f-157b-4a74-b87b-049cbcd4bacc admin admin] RBAC: Authorizing `identity:delete_project(project_id=81a6e617b4ec430597e6248fb1153755)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:40.029430 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7fde07-3384-4d75-9280-669951f0134b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:40.033829 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29604c2f-157b-4a74-b87b-049cbcd4bacc admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:40.034355 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7fde07-3384-4d75-9280-669951f0134b admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:40.157125 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 907/1799] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 10 10:03:39 2022] POST /identity/v3/projects => generated 365 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:03:40.160821 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50dc5f9-9f2c-4ef5-827b-155f4addea0c None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:40.161122 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50dc5f9-9f2c-4ef5-827b-155f4addea0c None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:40.161399 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50dc5f9-9f2c-4ef5-827b-155f4addea0c None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:40.165440 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-29604c2f-157b-4a74-b87b-049cbcd4bacc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81a6e617b4ec430597e6248fb1153755', 'request_id': 'req-29604c2f-157b-4a74-b87b-049cbcd4bacc'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:40.172721 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 908/1800] 10.222.0.27 () {54 vars in 921 bytes} [Wed Aug 10 10:03:40 2022] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:03:40.173529 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-29604c2f-157b-4a74-b87b-049cbcd4bacc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81a6e617b4ec430597e6248fb1153755', 'request_id': 'req-29604c2f-157b-4a74-b87b-049cbcd4bacc'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:40.173662 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50dc5f9-9f2c-4ef5-827b-155f4addea0c None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:40.175844 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:40.187318 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-29604c2f-157b-4a74-b87b-049cbcd4bacc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81a6e617b4ec430597e6248fb1153755', 'request_id': 'req-29604c2f-157b-4a74-b87b-049cbcd4bacc'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:40.241795 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-29604c2f-157b-4a74-b87b-049cbcd4bacc admin admin] The token cache is being invalidate because project 81a6e617b4ec430597e6248fb1153755 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 10:03:40.242441 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-29604c2f-157b-4a74-b87b-049cbcd4bacc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:40.244651 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-29604c2f-157b-4a74-b87b-049cbcd4bacc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:40.248249 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 893/1801] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 10 10:03:39 2022] DELETE /identity/v3/projects/81a6e617b4ec430597e6248fb1153755 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:03:40.260297 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29604c2f-157b-4a74-b87b-049cbcd4bacc admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:40.263919 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-29604c2f-157b-4a74-b87b-049cbcd4bacc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:40.438106 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50dc5f9-9f2c-4ef5-827b-155f4addea0c None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:40.461049 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29604c2f-157b-4a74-b87b-049cbcd4bacc admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:40.462129 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f19b0d-bd28-46ab-b4c5-009069dbfb8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:40.465882 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f19b0d-bd28-46ab-b4c5-009069dbfb8a admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:40.466273 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f19b0d-bd28-46ab-b4c5-009069dbfb8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:40.466472 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f19b0d-bd28-46ab-b4c5-009069dbfb8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:40.467174 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f19b0d-bd28-46ab-b4c5-009069dbfb8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:40.473566 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5723ad0d-6c86-4cbf-a636-e572dbb2dc64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:40.474319 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5723ad0d-6c86-4cbf-a636-e572dbb2dc64 admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:40.474595 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5723ad0d-6c86-4cbf-a636-e572dbb2dc64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:40.474869 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5723ad0d-6c86-4cbf-a636-e572dbb2dc64 admin admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:40.475314 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f19b0d-bd28-46ab-b4c5-009069dbfb8a admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:40.475518 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5723ad0d-6c86-4cbf-a636-e572dbb2dc64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:40.480967 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5723ad0d-6c86-4cbf-a636-e572dbb2dc64 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:40.528702 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 909/1802] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:03:40 2022] GET /identity/v3/roles => generated 1420 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:03:40.531141 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778d798d-c85b-4caf-afdb-ba6e19e64cb5 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:40.538964 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 894/1803] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 10 10:03:40 2022] POST /identity/v3/users => generated 289 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:03:40.540399 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c9dc88-30a8-40b7-994e-e12f72aaa2c1 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:40.540681 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c9dc88-30a8-40b7-994e-e12f72aaa2c1 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:40.540957 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c9dc88-30a8-40b7-994e-e12f72aaa2c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:40.545252 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778d798d-c85b-4caf-afdb-ba6e19e64cb5 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:40.545770 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778d798d-c85b-4caf-afdb-ba6e19e64cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:40.582837 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-52c9dc88-30a8-40b7-994e-e12f72aaa2c1 None None] MFA Rules not processed for user `dd8580888cba41a88566da4540b1130c`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:03:40.584660 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-52c9dc88-30a8-40b7-994e-e12f72aaa2c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:40.616578 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-778d798d-c85b-4caf-afdb-ba6e19e64cb5 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:03:40.620329 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-778d798d-c85b-4caf-afdb-ba6e19e64cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:40.652718 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 910/1804] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:03:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:03:40.652718 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778d798d-c85b-4caf-afdb-ba6e19e64cb5 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:40.652718 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-778d798d-c85b-4caf-afdb-ba6e19e64cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:40.704994 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778d798d-c85b-4caf-afdb-ba6e19e64cb5 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:40.722294 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b90294-d6ac-4e5b-94d8-59441fea7707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:40.723249 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b90294-d6ac-4e5b-94d8-59441fea7707 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:40.723675 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b90294-d6ac-4e5b-94d8-59441fea7707 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:40.724079 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b90294-d6ac-4e5b-94d8-59441fea7707 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:40.724895 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b90294-d6ac-4e5b-94d8-59441fea7707 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:40.727175 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b90294-d6ac-4e5b-94d8-59441fea7707 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:40.767361 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 911/1805] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:03:40 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:03:40.780080 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b90294-d6ac-4e5b-94d8-59441fea7707 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:40.801912 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b90294-d6ac-4e5b-94d8-59441fea7707 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:40.817448 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93797a2-86be-4c41-8653-6cebd811a08e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:40.818341 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93797a2-86be-4c41-8653-6cebd811a08e admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:40.818771 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93797a2-86be-4c41-8653-6cebd811a08e admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:40.819191 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93797a2-86be-4c41-8653-6cebd811a08e admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:40.820009 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93797a2-86be-4c41-8653-6cebd811a08e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:40.821861 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93797a2-86be-4c41-8653-6cebd811a08e admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:40.824003 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 895/1806] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Aug 10 10:03:40 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:03:40.825904 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb8bb4f-8223-4f50-a104-82bfea255567 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:40.826381 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb8bb4f-8223-4f50-a104-82bfea255567 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:40.826766 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb8bb4f-8223-4f50-a104-82bfea255567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:40.865802 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-5cb8bb4f-8223-4f50-a104-82bfea255567 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:03:40.867186 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-5cb8bb4f-8223-4f50-a104-82bfea255567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:40.878473 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 912/1807] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:03:40 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:03:40.879441 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93797a2-86be-4c41-8653-6cebd811a08e admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:40.891136 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 896/1808] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:03:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:03:40.892883 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb8bb4f-8223-4f50-a104-82bfea255567 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:40.908446 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93797a2-86be-4c41-8653-6cebd811a08e admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:40.918480 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5061795-a5ea-4324-819d-b65759838a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:40.919158 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5061795-a5ea-4324-819d-b65759838a11 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:40.919433 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5061795-a5ea-4324-819d-b65759838a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:40.919709 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5061795-a5ea-4324-819d-b65759838a11 admin admin] PATH_INFO: `/v3/projects/352c2c1d415346f68277e38e0df33a83/users/8da8f2a50a6149239a0e7cd80558a9dc/roles/8daabcb6b7394e39b06a3453e33e32db` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:40.920058 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb8bb4f-8223-4f50-a104-82bfea255567 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:40.936813 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8cdb03-1770-42f6-ac60-68aded4a8481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:40.937672 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8cdb03-1770-42f6-ac60-68aded4a8481 admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:40.939090 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8cdb03-1770-42f6-ac60-68aded4a8481 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:40.939347 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8cdb03-1770-42f6-ac60-68aded4a8481 admin admin] PATH_INFO: `/v3/projects/22cf696116c240a9a2253909f3517fb1/users/7ee9dde09f3942d7b50f26d81dbbe0a1/roles/eb04edc46b3742d7a0f0ead26f68bc22` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:40.963760 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5061795-a5ea-4324-819d-b65759838a11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=352c2c1d415346f68277e38e0df33a83, user_id=8da8f2a50a6149239a0e7cd80558a9dc, role_id=8daabcb6b7394e39b06a3453e33e32db)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:40.967483 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5061795-a5ea-4324-819d-b65759838a11 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:40.981953 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8cdb03-1770-42f6-ac60-68aded4a8481 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22cf696116c240a9a2253909f3517fb1, user_id=7ee9dde09f3942d7b50f26d81dbbe0a1, role_id=eb04edc46b3742d7a0f0ead26f68bc22)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:41.000775 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 913/1809] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:03:40 2022] PUT /identity/v3/projects/352c2c1d415346f68277e38e0df33a83/users/8da8f2a50a6149239a0e7cd80558a9dc/roles/8daabcb6b7394e39b06a3453e33e32db => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:03:41.001755 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5061795-a5ea-4324-819d-b65759838a11 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:41.003387 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8cdb03-1770-42f6-ac60-68aded4a8481 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:41.029895 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 897/1810] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:03:40 2022] PUT /identity/v3/projects/22cf696116c240a9a2253909f3517fb1/users/7ee9dde09f3942d7b50f26d81dbbe0a1/roles/eb04edc46b3742d7a0f0ead26f68bc22 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:03:41.032023 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1cdf48-2e96-4e39-afde-d22c0bb728f1 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:41.032549 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1cdf48-2e96-4e39-afde-d22c0bb728f1 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:41.033987 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1cdf48-2e96-4e39-afde-d22c0bb728f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:41.049202 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:41.078767 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-3a1cdf48-2e96-4e39-afde-d22c0bb728f1 None None] MFA Rules not processed for user `8da8f2a50a6149239a0e7cd80558a9dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:03:41.080322 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-3a1cdf48-2e96-4e39-afde-d22c0bb728f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:41.120881 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:INSERT=5,keystone:DELETE=1,keystone:SELECT=94 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:41.174477 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5061795-a5ea-4324-819d-b65759838a11 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:41.260671 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 898/1811] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:03:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:03:41.261950 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1cdf48-2e96-4e39-afde-d22c0bb728f1 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:41.361600 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2ef042-e6dc-4067-9da3-b1e7bce6506a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:41.362401 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2ef042-e6dc-4067-9da3-b1e7bce6506a admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:41.362873 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2ef042-e6dc-4067-9da3-b1e7bce6506a admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:41.364087 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2ef042-e6dc-4067-9da3-b1e7bce6506a admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:41.365000 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2ef042-e6dc-4067-9da3-b1e7bce6506a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:03:41.365401 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2ef042-e6dc-4067-9da3-b1e7bce6506a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:41.368886 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2ef042-e6dc-4067-9da3-b1e7bce6506a admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:41.394886 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 914/1812] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 10 10:03:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 393 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:03:41.400032 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2ef042-e6dc-4067-9da3-b1e7bce6506a admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:41.414185 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1cdf48-2e96-4e39-afde-d22c0bb728f1 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:41.416267 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2ef042-e6dc-4067-9da3-b1e7bce6506a admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:41.423731 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be41a9e8-2835-4bd3-86e8-dcd622c18cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:41.424472 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be41a9e8-2835-4bd3-86e8-dcd622c18cb1 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:41.424752 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be41a9e8-2835-4bd3-86e8-dcd622c18cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:41.425309 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be41a9e8-2835-4bd3-86e8-dcd622c18cb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:41.425719 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ad7b4b-c481-40c8-82f9-4cd1fc167845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:41.426591 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be41a9e8-2835-4bd3-86e8-dcd622c18cb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:41.427606 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ad7b4b-c481-40c8-82f9-4cd1fc167845 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:41.430473 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be41a9e8-2835-4bd3-86e8-dcd622c18cb1 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:41.435742 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ad7b4b-c481-40c8-82f9-4cd1fc167845 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:41.436464 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ad7b4b-c481-40c8-82f9-4cd1fc167845 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:41.437443 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ad7b4b-c481-40c8-82f9-4cd1fc167845 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:41.440124 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ad7b4b-c481-40c8-82f9-4cd1fc167845 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:41.456737 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 899/1813] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:03:41 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:03:41.458125 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ad7b4b-c481-40c8-82f9-4cd1fc167845 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:41.486163 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ad7b4b-c481-40c8-82f9-4cd1fc167845 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:41.492313 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6278dd-5d5b-4a53-aefa-ec4065200f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:41.493602 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6278dd-5d5b-4a53-aefa-ec4065200f1d admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:41.494102 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6278dd-5d5b-4a53-aefa-ec4065200f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:41.495464 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6278dd-5d5b-4a53-aefa-ec4065200f1d admin admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:41.496589 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6278dd-5d5b-4a53-aefa-ec4065200f1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:41.497004 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 915/1814] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 10 10:03:41 2022] POST /identity/v3/projects => generated 377 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:03:41.498070 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be41a9e8-2835-4bd3-86e8-dcd622c18cb1 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:41.499770 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6278dd-5d5b-4a53-aefa-ec4065200f1d admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:41.556738 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 900/1815] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 10 10:03:41 2022] POST /identity/v3/projects => generated 387 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:03:41.558165 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6278dd-5d5b-4a53-aefa-ec4065200f1d admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:41.685533 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be41a9e8-2835-4bd3-86e8-dcd622c18cb1 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:41.754727 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6278dd-5d5b-4a53-aefa-ec4065200f1d admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:41.771848 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4d3f5d-2e06-4881-96f9-6ef0b03e2e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:41.775259 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d3f5d-2e06-4881-96f9-6ef0b03e2e6d admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:41.775539 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d3f5d-2e06-4881-96f9-6ef0b03e2e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:41.775818 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d3f5d-2e06-4881-96f9-6ef0b03e2e6d admin admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:41.779187 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4d3f5d-2e06-4881-96f9-6ef0b03e2e6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:41.785412 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4d3f5d-2e06-4881-96f9-6ef0b03e2e6d admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:41.811145 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:41.838890 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 901/1816] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 10 10:03:41 2022] POST /identity/v3/users => generated 295 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:03:41.845370 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a08bc8-a0f5-4e6a-a010-4e59849fc4de None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:41.845733 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a08bc8-a0f5-4e6a-a010-4e59849fc4de None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:41.845988 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a08bc8-a0f5-4e6a-a010-4e59849fc4de None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:41.849622 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 902/1817] 10.222.0.27 () {54 vars in 921 bytes} [Wed Aug 10 10:03:41 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:03:41.850486 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a08bc8-a0f5-4e6a-a010-4e59849fc4de None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:41.856051 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d005cd-7aba-47f2-951d-6a01c5ad1886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:41.856820 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d005cd-7aba-47f2-951d-6a01c5ad1886 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:41.857134 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d005cd-7aba-47f2-951d-6a01c5ad1886 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:41.857567 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d005cd-7aba-47f2-951d-6a01c5ad1886 admin admin] PATH_INFO: `/v3/projects/22cf696116c240a9a2253909f3517fb1/users/7ee9dde09f3942d7b50f26d81dbbe0a1/roles/eb04edc46b3742d7a0f0ead26f68bc22` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:41.861951 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d005cd-7aba-47f2-951d-6a01c5ad1886 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22cf696116c240a9a2253909f3517fb1, user_id=7ee9dde09f3942d7b50f26d81dbbe0a1, role_id=eb04edc46b3742d7a0f0ead26f68bc22)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:41.864852 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d005cd-7aba-47f2-951d-6a01c5ad1886 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:41.881503 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a08bc8-a0f5-4e6a-a010-4e59849fc4de None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:41.892322 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 916/1818] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:03:41 2022] PUT /identity/v3/projects/22cf696116c240a9a2253909f3517fb1/users/7ee9dde09f3942d7b50f26d81dbbe0a1/roles/eb04edc46b3742d7a0f0ead26f68bc22 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:03:41.897847 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d005cd-7aba-47f2-951d-6a01c5ad1886 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:41.906165 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-71d005cd-7aba-47f2-951d-6a01c5ad1886 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:41.979395 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:42.038391 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0c0d69-ec62-4438-9352-6102426d6f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:42.039851 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0c0d69-ec62-4438-9352-6102426d6f0b admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:42.040917 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0c0d69-ec62-4438-9352-6102426d6f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:42.041318 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0c0d69-ec62-4438-9352-6102426d6f0b admin admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:42.042922 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0c0d69-ec62-4438-9352-6102426d6f0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:42.048054 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0c0d69-ec62-4438-9352-6102426d6f0b admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:42.050788 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d005cd-7aba-47f2-951d-6a01c5ad1886 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:42.061330 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8674e3f-b57a-4c16-ac75-dc160adfa9b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd8580888cba41a88566da4540b1130c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:42.062781 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8674e3f-b57a-4c16-ac75-dc160adfa9b7 service nova] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:42.063274 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8674e3f-b57a-4c16-ac75-dc160adfa9b7 service nova] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:42.063814 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8674e3f-b57a-4c16-ac75-dc160adfa9b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:42.077228 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8674e3f-b57a-4c16-ac75-dc160adfa9b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:42.080467 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8674e3f-b57a-4c16-ac75-dc160adfa9b7 service nova] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:42.104705 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 903/1819] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 10 10:03:41 2022] POST /identity/v3/users => generated 294 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:03:42.105705 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0c0d69-ec62-4438-9352-6102426d6f0b admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:42.112701 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 917/1820] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:03:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:03:42.114973 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff98495-592e-4190-a22f-6402b1f48646 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:42.116115 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff98495-592e-4190-a22f-6402b1f48646 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:42.116648 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff98495-592e-4190-a22f-6402b1f48646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:42.145944 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0c0d69-ec62-4438-9352-6102426d6f0b admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:42.171695 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a1ae2f-03ba-4345-adca-d91d956cc184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:42.188325 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a1ae2f-03ba-4345-adca-d91d956cc184 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:42.189029 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a1ae2f-03ba-4345-adca-d91d956cc184 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:42.190924 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a1ae2f-03ba-4345-adca-d91d956cc184 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:42.191840 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a1ae2f-03ba-4345-adca-d91d956cc184 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:42.197868 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a1ae2f-03ba-4345-adca-d91d956cc184 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:42.201772 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-4ff98495-592e-4190-a22f-6402b1f48646 None None] MFA Rules not processed for user `7ee9dde09f3942d7b50f26d81dbbe0a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:03:42.208004 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-4ff98495-592e-4190-a22f-6402b1f48646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:42.223753 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 904/1821] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:03:42 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:03:42.228196 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ccf0ff-2105-40ae-ab32-262ec8abe22f None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:42.228752 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ccf0ff-2105-40ae-ab32-262ec8abe22f None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:42.229933 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ccf0ff-2105-40ae-ab32-262ec8abe22f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:42.272024 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-c9ccf0ff-2105-40ae-ab32-262ec8abe22f None None] MFA Rules not processed for user `dd8580888cba41a88566da4540b1130c`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:03:42.275203 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-c9ccf0ff-2105-40ae-ab32-262ec8abe22f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:42.300296 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 905/1822] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Aug 10 10:03:42 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:03:42.301552 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ccf0ff-2105-40ae-ab32-262ec8abe22f None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:42.333331 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ccf0ff-2105-40ae-ab32-262ec8abe22f None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:42.345653 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ca0782-3299-414a-9179-0bd29cfb41b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:42.346300 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ca0782-3299-414a-9179-0bd29cfb41b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:42.346585 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ca0782-3299-414a-9179-0bd29cfb41b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:42.346862 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ca0782-3299-414a-9179-0bd29cfb41b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:42.347581 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ca0782-3299-414a-9179-0bd29cfb41b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:42.349921 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ca0782-3299-414a-9179-0bd29cfb41b0 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:42.383072 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 906/1823] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:03:42 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:03:42.384122 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ca0782-3299-414a-9179-0bd29cfb41b0 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:42.388112 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-e3ca0782-3299-414a-9179-0bd29cfb41b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:42.406074 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 918/1824] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:03:42 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:03:42.408842 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ca0782-3299-414a-9179-0bd29cfb41b0 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:42.413657 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff98495-592e-4190-a22f-6402b1f48646 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:42.418005 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7398ca5d-8e89-4f4a-a9d1-9e3f3829d5a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:42.419036 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7398ca5d-8e89-4f4a-a9d1-9e3f3829d5a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:42.419490 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7398ca5d-8e89-4f4a-a9d1-9e3f3829d5a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:42.420080 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7398ca5d-8e89-4f4a-a9d1-9e3f3829d5a1 admin admin] PATH_INFO: `/v3/projects/5b681febfdec434bb21ff269dad2d9e0` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:42.421859 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7398ca5d-8e89-4f4a-a9d1-9e3f3829d5a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b681febfdec434bb21ff269dad2d9e0)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:42.424393 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7398ca5d-8e89-4f4a-a9d1-9e3f3829d5a1 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:42.439786 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff98495-592e-4190-a22f-6402b1f48646 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:42.453798 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8520ce27-8934-46e8-9732-d12d686a4281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:42.454584 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8520ce27-8934-46e8-9732-d12d686a4281 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:42.454932 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8520ce27-8934-46e8-9732-d12d686a4281 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:42.455278 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8520ce27-8934-46e8-9732-d12d686a4281 admin admin] PATH_INFO: `/v3/projects/32ab71f69b7642c78af2c17dfd8e2373/users/a5f1ea65bca7451980df77d26068d3dc/roles/eb04edc46b3742d7a0f0ead26f68bc22` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:42.475385 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8520ce27-8934-46e8-9732-d12d686a4281 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32ab71f69b7642c78af2c17dfd8e2373, user_id=a5f1ea65bca7451980df77d26068d3dc, role_id=eb04edc46b3742d7a0f0ead26f68bc22)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:42.479984 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8520ce27-8934-46e8-9732-d12d686a4281 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:42.582213 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-7398ca5d-8e89-4f4a-a9d1-9e3f3829d5a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b681febfdec434bb21ff269dad2d9e0', 'request_id': 'req-7398ca5d-8e89-4f4a-a9d1-9e3f3829d5a1'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:42.585492 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 919/1825] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:03:42 2022] PUT /identity/v3/projects/32ab71f69b7642c78af2c17dfd8e2373/users/a5f1ea65bca7451980df77d26068d3dc/roles/eb04edc46b3742d7a0f0ead26f68bc22 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:03:42.594974 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8520ce27-8934-46e8-9732-d12d686a4281 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:42.600253 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-7398ca5d-8e89-4f4a-a9d1-9e3f3829d5a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b681febfdec434bb21ff269dad2d9e0', 'request_id': 'req-7398ca5d-8e89-4f4a-a9d1-9e3f3829d5a1'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:42.615659 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-7398ca5d-8e89-4f4a-a9d1-9e3f3829d5a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b681febfdec434bb21ff269dad2d9e0', 'request_id': 'req-7398ca5d-8e89-4f4a-a9d1-9e3f3829d5a1'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:42.652385 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-7398ca5d-8e89-4f4a-a9d1-9e3f3829d5a1 admin admin] The token cache is being invalidate because project 5b681febfdec434bb21ff269dad2d9e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 10:03:42.652656 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-7398ca5d-8e89-4f4a-a9d1-9e3f3829d5a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:42.653383 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-7398ca5d-8e89-4f4a-a9d1-9e3f3829d5a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:42.656786 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 907/1826] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 10 10:03:42 2022] DELETE /identity/v3/projects/5b681febfdec434bb21ff269dad2d9e0 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:03:42.658571 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7398ca5d-8e89-4f4a-a9d1-9e3f3829d5a1 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:42.664825 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-7398ca5d-8e89-4f4a-a9d1-9e3f3829d5a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:42.701852 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:42.786201 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7398ca5d-8e89-4f4a-a9d1-9e3f3829d5a1 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:42.796045 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85cca23-3f72-4627-8c0a-f3fce5cb3d62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf8e725cbe0403d943b136235eac057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:42.796693 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85cca23-3f72-4627-8c0a-f3fce5cb3d62 service cinder] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:42.797115 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85cca23-3f72-4627-8c0a-f3fce5cb3d62 service cinder] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:42.797342 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85cca23-3f72-4627-8c0a-f3fce5cb3d62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:42.799337 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-b85cca23-3f72-4627-8c0a-f3fce5cb3d62 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:42.840347 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8520ce27-8934-46e8-9732-d12d686a4281 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:42.845002 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:42.897840 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85cca23-3f72-4627-8c0a-f3fce5cb3d62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:42.899560 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85cca23-3f72-4627-8c0a-f3fce5cb3d62 service cinder] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:42.912933 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 908/1827] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:03:42 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:03:42.913754 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85cca23-3f72-4627-8c0a-f3fce5cb3d62 service cinder] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:42.915211 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-b85cca23-3f72-4627-8c0a-f3fce5cb3d62 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:43.009539 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7447e15c-e32d-4df3-85a4-81735effb3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:43.010436 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7447e15c-e32d-4df3-85a4-81735effb3fd admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:43.011550 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7447e15c-e32d-4df3-85a4-81735effb3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:43.011993 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7447e15c-e32d-4df3-85a4-81735effb3fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:43.012686 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7447e15c-e32d-4df3-85a4-81735effb3fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:43.014357 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7447e15c-e32d-4df3-85a4-81735effb3fd admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:43.035299 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85cca23-3f72-4627-8c0a-f3fce5cb3d62 service cinder] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:43.050145 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 920/1828] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:03:42 2022] GET /identity/v3/roles => generated 1420 bytes in 464 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:03:43.051088 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7447e15c-e32d-4df3-85a4-81735effb3fd admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:43.056707 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7375d941-24a7-45d2-a0d5-1aa81ed51393 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd8580888cba41a88566da4540b1130c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:43.058856 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-7447e15c-e32d-4df3-85a4-81735effb3fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:43.071946 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7375d941-24a7-45d2-a0d5-1aa81ed51393 service nova] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:43.075065 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7375d941-24a7-45d2-a0d5-1aa81ed51393 service nova] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:43.076998 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7375d941-24a7-45d2-a0d5-1aa81ed51393 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:43.082255 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7447e15c-e32d-4df3-85a4-81735effb3fd admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:43.087248 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-7375d941-24a7-45d2-a0d5-1aa81ed51393 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:43.091806 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2768be-1cbe-480a-ab9d-f88c3ddf8e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:43.095133 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2768be-1cbe-480a-ab9d-f88c3ddf8e09 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:43.095782 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2768be-1cbe-480a-ab9d-f88c3ddf8e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:43.096507 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2768be-1cbe-480a-ab9d-f88c3ddf8e09 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:43.099794 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2768be-1cbe-480a-ab9d-f88c3ddf8e09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:43.109977 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2768be-1cbe-480a-ab9d-f88c3ddf8e09 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:43.127094 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7375d941-24a7-45d2-a0d5-1aa81ed51393 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:43.132583 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7375d941-24a7-45d2-a0d5-1aa81ed51393 service nova] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:43.143064 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 921/1829] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:03:43 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:03:43.143064 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6fde78-80ce-415c-9b87-68896a528383 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:43.143064 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6fde78-80ce-415c-9b87-68896a528383 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:43.143064 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6fde78-80ce-415c-9b87-68896a528383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:43.214162 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-3d6fde78-80ce-415c-9b87-68896a528383 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:03:43.215418 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-3d6fde78-80ce-415c-9b87-68896a528383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:43.215984 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 909/1830] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:03:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:03:43.217188 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7375d941-24a7-45d2-a0d5-1aa81ed51393 service nova] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:43.222292 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-7375d941-24a7-45d2-a0d5-1aa81ed51393 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:43.251686 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 922/1831] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:03:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:03:43.251686 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6fde78-80ce-415c-9b87-68896a528383 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:43.283460 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6fde78-80ce-415c-9b87-68896a528383 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:43.300310 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc35a77a-2a85-47f1-a059-dc5f0d434ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:43.301111 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc35a77a-2a85-47f1-a059-dc5f0d434ca8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:43.301365 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc35a77a-2a85-47f1-a059-dc5f0d434ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:43.301637 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc35a77a-2a85-47f1-a059-dc5f0d434ca8 admin admin] PATH_INFO: `/v3/projects/32ab71f69b7642c78af2c17dfd8e2373/users/a5f1ea65bca7451980df77d26068d3dc/roles/eb04edc46b3742d7a0f0ead26f68bc22` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:43.306492 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc35a77a-2a85-47f1-a059-dc5f0d434ca8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32ab71f69b7642c78af2c17dfd8e2373, user_id=a5f1ea65bca7451980df77d26068d3dc, role_id=eb04edc46b3742d7a0f0ead26f68bc22)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:43.309093 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7375d941-24a7-45d2-a0d5-1aa81ed51393 service nova] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:43.309227 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc35a77a-2a85-47f1-a059-dc5f0d434ca8 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:43.341799 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 923/1832] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:03:43 2022] PUT /identity/v3/projects/32ab71f69b7642c78af2c17dfd8e2373/users/a5f1ea65bca7451980df77d26068d3dc/roles/eb04edc46b3742d7a0f0ead26f68bc22 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:03:43.343155 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9354875f-f340-4100-9bde-9d57ab28fecc None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:43.343426 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9354875f-f340-4100-9bde-9d57ab28fecc None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:43.343698 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9354875f-f340-4100-9bde-9d57ab28fecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:43.344118 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed1e3bd-4272-4bec-bbb0-dd918c42ca5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:43.344856 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed1e3bd-4272-4bec-bbb0-dd918c42ca5a admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:43.345090 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed1e3bd-4272-4bec-bbb0-dd918c42ca5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:43.345344 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed1e3bd-4272-4bec-bbb0-dd918c42ca5a admin admin] PATH_INFO: `/v3/projects/41185466e2d94014988bc645f2c89ec6/users/f4e6bc50cc4b4fdba85e66f6badd7410/roles/8daabcb6b7394e39b06a3453e33e32db` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:43.407279 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed1e3bd-4272-4bec-bbb0-dd918c42ca5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=41185466e2d94014988bc645f2c89ec6, user_id=f4e6bc50cc4b4fdba85e66f6badd7410, role_id=8daabcb6b7394e39b06a3453e33e32db)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:43.408623 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-9354875f-f340-4100-9bde-9d57ab28fecc None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:03:43.410110 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-9354875f-f340-4100-9bde-9d57ab28fecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:43.410336 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed1e3bd-4272-4bec-bbb0-dd918c42ca5a admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:43.464769 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 910/1833] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:03:43 2022] PUT /identity/v3/projects/41185466e2d94014988bc645f2c89ec6/users/f4e6bc50cc4b4fdba85e66f6badd7410/roles/8daabcb6b7394e39b06a3453e33e32db => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:03:43.469864 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d575c1a-01ed-4f44-8c7e-73379092cc56 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:43.485395 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d575c1a-01ed-4f44-8c7e-73379092cc56 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:43.485693 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d575c1a-01ed-4f44-8c7e-73379092cc56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:43.560631 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-9d575c1a-01ed-4f44-8c7e-73379092cc56 None None] MFA Rules not processed for user `a5f1ea65bca7451980df77d26068d3dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:03:43.561968 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-9d575c1a-01ed-4f44-8c7e-73379092cc56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:43.621183 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 924/1834] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:03:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:03:43.621183 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d59588b-1bcf-424a-a9da-0c90f5ad7a2a None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:43.621183 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d59588b-1bcf-424a-a9da-0c90f5ad7a2a None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:43.621183 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d59588b-1bcf-424a-a9da-0c90f5ad7a2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:43.713199 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-5d59588b-1bcf-424a-a9da-0c90f5ad7a2a None None] MFA Rules not processed for user `f4e6bc50cc4b4fdba85e66f6badd7410`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:03:43.714430 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-5d59588b-1bcf-424a-a9da-0c90f5ad7a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:43.780847 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 911/1835] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:03:43 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:03:43.781990 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d575c1a-01ed-4f44-8c7e-73379092cc56 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:43.801803 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:43.808721 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:43.881275 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d575c1a-01ed-4f44-8c7e-73379092cc56 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:43.886127 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9986ad59-55b6-4a18-8906-2548aa6620db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:43.886750 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9986ad59-55b6-4a18-8906-2548aa6620db admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:43.887130 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9986ad59-55b6-4a18-8906-2548aa6620db admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:43.887501 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9986ad59-55b6-4a18-8906-2548aa6620db admin admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:43.888263 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9986ad59-55b6-4a18-8906-2548aa6620db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:03:43.888668 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9986ad59-55b6-4a18-8906-2548aa6620db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:43.890682 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9986ad59-55b6-4a18-8906-2548aa6620db admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:43.914162 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 925/1836] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:03:43 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:03:43.915531 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d59588b-1bcf-424a-a9da-0c90f5ad7a2a None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:43.924957 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 912/1837] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 10 10:03:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:03:43.926596 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9986ad59-55b6-4a18-8906-2548aa6620db admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:43.935155 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-9986ad59-55b6-4a18-8906-2548aa6620db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:43.954367 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9986ad59-55b6-4a18-8906-2548aa6620db admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:43.960394 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5130c5b4-20bb-4da0-a2cf-60b7a7e7e293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:43.961305 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5130c5b4-20bb-4da0-a2cf-60b7a7e7e293 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:43.961833 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5130c5b4-20bb-4da0-a2cf-60b7a7e7e293 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:43.962481 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5130c5b4-20bb-4da0-a2cf-60b7a7e7e293 admin admin] PATH_INFO: `/v3/users/4db888ac9aad4813a5a6c7793afda81d` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:43.965452 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5130c5b4-20bb-4da0-a2cf-60b7a7e7e293 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4db888ac9aad4813a5a6c7793afda81d)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:43.969114 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5130c5b4-20bb-4da0-a2cf-60b7a7e7e293 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:44.058837 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d59588b-1bcf-424a-a9da-0c90f5ad7a2a None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:44.068736 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-5130c5b4-20bb-4da0-a2cf-60b7a7e7e293 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4db888ac9aad4813a5a6c7793afda81d'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:44.076139 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c38ae0-5826-48bb-b1f0-3b365e01fd0e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf8e725cbe0403d943b136235eac057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:44.076827 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c38ae0-5826-48bb-b1f0-3b365e01fd0e service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:44.079313 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c38ae0-5826-48bb-b1f0-3b365e01fd0e service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:44.080359 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c38ae0-5826-48bb-b1f0-3b365e01fd0e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:44.085328 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-62c38ae0-5826-48bb-b1f0-3b365e01fd0e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:44.089548 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-5130c5b4-20bb-4da0-a2cf-60b7a7e7e293 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4db888ac9aad4813a5a6c7793afda81d'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:44.105149 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-5130c5b4-20bb-4da0-a2cf-60b7a7e7e293 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4db888ac9aad4813a5a6c7793afda81d'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:44.106433 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-5130c5b4-20bb-4da0-a2cf-60b7a7e7e293 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4db888ac9aad4813a5a6c7793afda81d'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:44.107704 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-5130c5b4-20bb-4da0-a2cf-60b7a7e7e293 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4db888ac9aad4813a5a6c7793afda81d'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:44.159113 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 913/1838] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 10 10:03:43 2022] DELETE /identity/v3/users/4db888ac9aad4813a5a6c7793afda81d => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:03:44.160841 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5130c5b4-20bb-4da0-a2cf-60b7a7e7e293 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:44.162753 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-5130c5b4-20bb-4da0-a2cf-60b7a7e7e293 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:44.236489 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c38ae0-5826-48bb-b1f0-3b365e01fd0e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:44.238133 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c38ae0-5826-48bb-b1f0-3b365e01fd0e service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:44.263040 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 926/1839] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:03:43 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:03:44.263875 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c38ae0-5826-48bb-b1f0-3b365e01fd0e service cinder] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:44.277891 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c38ae0-5826-48bb-b1f0-3b365e01fd0e service cinder] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:44.341057 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5130c5b4-20bb-4da0-a2cf-60b7a7e7e293 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:44.352467 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e495d3-0760-47e4-bb6d-70c4c401ca58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:44.353012 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e495d3-0760-47e4-bb6d-70c4c401ca58 admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:44.353322 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e495d3-0760-47e4-bb6d-70c4c401ca58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:44.353781 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e495d3-0760-47e4-bb6d-70c4c401ca58 admin admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:44.354431 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e495d3-0760-47e4-bb6d-70c4c401ca58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:44.356439 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e495d3-0760-47e4-bb6d-70c4c401ca58 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:44.404224 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b747ae-31f7-4da4-9cfe-dc40751872df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:44.404970 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b747ae-31f7-4da4-9cfe-dc40751872df admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:44.405307 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b747ae-31f7-4da4-9cfe-dc40751872df admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:44.405595 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b747ae-31f7-4da4-9cfe-dc40751872df admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:44.406265 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b747ae-31f7-4da4-9cfe-dc40751872df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:44.412883 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b747ae-31f7-4da4-9cfe-dc40751872df admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:44.426697 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 914/1840] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 10 10:03:44 2022] POST /identity/v3/projects => generated 387 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:03:44.429226 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af639c1-85d9-4b6f-9c99-c9610cebebea None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:44.431820 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af639c1-85d9-4b6f-9c99-c9610cebebea None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:44.432300 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af639c1-85d9-4b6f-9c99-c9610cebebea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:44.453944 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:44.476301 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 927/1841] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 10 10:03:44 2022] POST /identity/v3/projects => generated 367 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:03:44.477269 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b747ae-31f7-4da4-9cfe-dc40751872df admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:44.478700 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-1af639c1-85d9-4b6f-9c99-c9610cebebea None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:03:44.480670 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-1af639c1-85d9-4b6f-9c99-c9610cebebea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:44.493024 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:44.590083 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b747ae-31f7-4da4-9cfe-dc40751872df admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:44.596074 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b7c770-b34b-4018-a548-58b4460f55b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:44.596722 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b7c770-b34b-4018-a548-58b4460f55b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:44.597224 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b7c770-b34b-4018-a548-58b4460f55b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:44.597531 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b7c770-b34b-4018-a548-58b4460f55b7 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:44.598185 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b7c770-b34b-4018-a548-58b4460f55b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:44.600250 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b7c770-b34b-4018-a548-58b4460f55b7 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:44.640001 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 928/1842] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 10 10:03:44 2022] POST /identity/v3/users => generated 300 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:03:44.640830 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b7c770-b34b-4018-a548-58b4460f55b7 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:44.645667 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-28b7c770-b34b-4018-a548-58b4460f55b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:44.651523 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 915/1843] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:03:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:03:44.652520 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af639c1-85d9-4b6f-9c99-c9610cebebea None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:44.704479 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af639c1-85d9-4b6f-9c99-c9610cebebea None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:44.707203 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b7c770-b34b-4018-a548-58b4460f55b7 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:44.719175 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccd44e8-a45a-4133-9f68-cd0432b8ec9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:44.719805 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccd44e8-a45a-4133-9f68-cd0432b8ec9e admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:44.720083 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccd44e8-a45a-4133-9f68-cd0432b8ec9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:44.720355 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccd44e8-a45a-4133-9f68-cd0432b8ec9e admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:44.722093 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccd44e8-a45a-4133-9f68-cd0432b8ec9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:44.725115 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccd44e8-a45a-4133-9f68-cd0432b8ec9e admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:44.737425 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc28456e-0d87-4279-85cf-c6d7eedc93da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:44.741054 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc28456e-0d87-4279-85cf-c6d7eedc93da admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:44.742351 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 916/1844] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:03:44 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:03:44.743399 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccd44e8-a45a-4133-9f68-cd0432b8ec9e admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:44.744313 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc28456e-0d87-4279-85cf-c6d7eedc93da admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:44.744781 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc28456e-0d87-4279-85cf-c6d7eedc93da admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:44.745741 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc28456e-0d87-4279-85cf-c6d7eedc93da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:44.746672 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-3ccd44e8-a45a-4133-9f68-cd0432b8ec9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:44.753722 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc28456e-0d87-4279-85cf-c6d7eedc93da admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:44.819215 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 929/1845] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 10 10:03:44 2022] POST /identity/v3/users => generated 284 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:03:44.819215 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc28456e-0d87-4279-85cf-c6d7eedc93da admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:44.831031 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc28456e-0d87-4279-85cf-c6d7eedc93da admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:44.836439 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21962f8a-b211-4a40-9f36-92856549e1b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:44.837328 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21962f8a-b211-4a40-9f36-92856549e1b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:44.837829 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21962f8a-b211-4a40-9f36-92856549e1b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:44.839242 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21962f8a-b211-4a40-9f36-92856549e1b1 admin admin] PATH_INFO: `/v3/projects/c1817f44397b445ab2a96e970a246492/users/a3f601df06884147bb7bf570bd5b3eda/roles/eb04edc46b3742d7a0f0ead26f68bc22` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:44.852955 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccd44e8-a45a-4133-9f68-cd0432b8ec9e admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:44.858578 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8863bbcb-fc49-45cf-9377-307712bd343f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4294c170df354fe892831281acd4ea7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:44.859499 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8863bbcb-fc49-45cf-9377-307712bd343f service neutron] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:44.860192 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8863bbcb-fc49-45cf-9377-307712bd343f service neutron] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:44.860755 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8863bbcb-fc49-45cf-9377-307712bd343f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:44.865715 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21962f8a-b211-4a40-9f36-92856549e1b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1817f44397b445ab2a96e970a246492, user_id=a3f601df06884147bb7bf570bd5b3eda, role_id=eb04edc46b3742d7a0f0ead26f68bc22)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:44.869962 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21962f8a-b211-4a40-9f36-92856549e1b1 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:44.873812 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8863bbcb-fc49-45cf-9377-307712bd343f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:44.875794 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8863bbcb-fc49-45cf-9377-307712bd343f service neutron] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:44.891002 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 917/1846] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:03:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:03:44.892319 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8863bbcb-fc49-45cf-9377-307712bd343f service neutron] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:44.897131 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 930/1847] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:03:44 2022] PUT /identity/v3/projects/c1817f44397b445ab2a96e970a246492/users/a3f601df06884147bb7bf570bd5b3eda/roles/eb04edc46b3742d7a0f0ead26f68bc22 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:03:44.903636 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21962f8a-b211-4a40-9f36-92856549e1b1 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:44.906334 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8863bbcb-fc49-45cf-9377-307712bd343f service neutron] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:45.000759 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58dda18-ddcd-45fc-8116-8d8dcc2b85a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:45.002130 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58dda18-ddcd-45fc-8116-8d8dcc2b85a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:45.002412 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58dda18-ddcd-45fc-8116-8d8dcc2b85a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:45.002679 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58dda18-ddcd-45fc-8116-8d8dcc2b85a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:45.003488 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58dda18-ddcd-45fc-8116-8d8dcc2b85a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:45.005392 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58dda18-ddcd-45fc-8116-8d8dcc2b85a3 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:45.019268 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21962f8a-b211-4a40-9f36-92856549e1b1 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:45.025801 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eccbf36-9b38-41f9-802c-bd67080989d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:45.027187 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eccbf36-9b38-41f9-802c-bd67080989d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:45.027615 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eccbf36-9b38-41f9-802c-bd67080989d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:45.028142 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eccbf36-9b38-41f9-802c-bd67080989d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:45.029267 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eccbf36-9b38-41f9-802c-bd67080989d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:45.031197 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eccbf36-9b38-41f9-802c-bd67080989d4 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:45.036124 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 918/1848] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:03:44 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:03:45.039850 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58dda18-ddcd-45fc-8116-8d8dcc2b85a3 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:45.058666 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58dda18-ddcd-45fc-8116-8d8dcc2b85a3 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:45.064715 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9c8c6d-fb33-4ad2-b635-c43ad22026c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:45.065839 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9c8c6d-fb33-4ad2-b635-c43ad22026c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:45.066464 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9c8c6d-fb33-4ad2-b635-c43ad22026c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:45.067051 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9c8c6d-fb33-4ad2-b635-c43ad22026c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:45.067285 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 931/1849] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:03:44 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:03:45.068300 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eccbf36-9b38-41f9-802c-bd67080989d4 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:45.069088 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9c8c6d-fb33-4ad2-b635-c43ad22026c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:45.071389 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9c8c6d-fb33-4ad2-b635-c43ad22026c7 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:45.079191 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eccbf36-9b38-41f9-802c-bd67080989d4 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:45.084860 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747d5640-514a-419d-8aa0-64f770e6f318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:45.085806 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d5640-514a-419d-8aa0-64f770e6f318 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:45.086186 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d5640-514a-419d-8aa0-64f770e6f318 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:45.086441 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d5640-514a-419d-8aa0-64f770e6f318 admin admin] PATH_INFO: `/v3/projects/c1817f44397b445ab2a96e970a246492/users/a3f601df06884147bb7bf570bd5b3eda/roles/eb04edc46b3742d7a0f0ead26f68bc22` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:45.087959 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 919/1850] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:03:45 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 10:03:45.088694 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747d5640-514a-419d-8aa0-64f770e6f318 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1817f44397b445ab2a96e970a246492, user_id=a3f601df06884147bb7bf570bd5b3eda, role_id=eb04edc46b3742d7a0f0ead26f68bc22)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:45.091690 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747d5640-514a-419d-8aa0-64f770e6f318 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:45.091953 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9c8c6d-fb33-4ad2-b635-c43ad22026c7 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:45.107391 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9c8c6d-fb33-4ad2-b635-c43ad22026c7 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:45.109149 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 932/1851] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:03:45 2022] PUT /identity/v3/projects/c1817f44397b445ab2a96e970a246492/users/a3f601df06884147bb7bf570bd5b3eda/roles/eb04edc46b3742d7a0f0ead26f68bc22 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:03:45.117652 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f553b2-437c-4fcd-8a64-e726724674f7 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:45.117991 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f553b2-437c-4fcd-8a64-e726724674f7 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:45.118290 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f553b2-437c-4fcd-8a64-e726724674f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:45.144613 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:45.152061 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-e0f553b2-437c-4fcd-8a64-e726724674f7 None None] MFA Rules not processed for user `a3f601df06884147bb7bf570bd5b3eda`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:03:45.153521 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-e0f553b2-437c-4fcd-8a64-e726724674f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:45.181945 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:45.202245 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d05d5ca-2ed9-4a23-bec2-468bea4a165a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:45.202998 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d05d5ca-2ed9-4a23-bec2-468bea4a165a admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:45.203348 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d05d5ca-2ed9-4a23-bec2-468bea4a165a admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:45.203699 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d05d5ca-2ed9-4a23-bec2-468bea4a165a admin admin] PATH_INFO: `/v3/projects/78de4387327f49b78814aec3fecae381/users/9d65897948d04664a794c9e647e0b361/roles/8daabcb6b7394e39b06a3453e33e32db` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:45.226380 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d05d5ca-2ed9-4a23-bec2-468bea4a165a admin admin] RBAC: Authorizing `identity:create_grant(project_id=78de4387327f49b78814aec3fecae381, user_id=9d65897948d04664a794c9e647e0b361, role_id=8daabcb6b7394e39b06a3453e33e32db)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:45.229382 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d05d5ca-2ed9-4a23-bec2-468bea4a165a admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:45.248738 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 933/1852] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:03:45 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:03:45.257989 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f553b2-437c-4fcd-8a64-e726724674f7 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:45.259550 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-e0f553b2-437c-4fcd-8a64-e726724674f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:45.285928 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 920/1853] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:03:45 2022] PUT /identity/v3/projects/78de4387327f49b78814aec3fecae381/users/9d65897948d04664a794c9e647e0b361/roles/8daabcb6b7394e39b06a3453e33e32db => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 10:03:45.289309 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bed4e86-a9ba-401f-bf40-3ded0cfa2700 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:45.291322 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bed4e86-a9ba-401f-bf40-3ded0cfa2700 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:45.291740 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bed4e86-a9ba-401f-bf40-3ded0cfa2700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:45.374946 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-0bed4e86-a9ba-401f-bf40-3ded0cfa2700 None None] MFA Rules not processed for user `9d65897948d04664a794c9e647e0b361`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:03:45.376615 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-0bed4e86-a9ba-401f-bf40-3ded0cfa2700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:45.427815 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f553b2-437c-4fcd-8a64-e726724674f7 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:45.474668 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 921/1854] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:03:45 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:03:45.476700 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bed4e86-a9ba-401f-bf40-3ded0cfa2700 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:45.536187 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cbd16d-9962-4f42-a260-c4540f0ec903 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf8e725cbe0403d943b136235eac057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:45.537331 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cbd16d-9962-4f42-a260-c4540f0ec903 service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:45.537756 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cbd16d-9962-4f42-a260-c4540f0ec903 service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:45.538366 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cbd16d-9962-4f42-a260-c4540f0ec903 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:45.628214 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bed4e86-a9ba-401f-bf40-3ded0cfa2700 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:45.634881 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cbd16d-9962-4f42-a260-c4540f0ec903 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:45.636610 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23801f1-4bd3-44ce-9c00-4cbe76977e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:45.636898 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cbd16d-9962-4f42-a260-c4540f0ec903 service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:45.637604 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23801f1-4bd3-44ce-9c00-4cbe76977e05 admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:45.638048 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23801f1-4bd3-44ce-9c00-4cbe76977e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:45.638479 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23801f1-4bd3-44ce-9c00-4cbe76977e05 admin admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:45.639264 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23801f1-4bd3-44ce-9c00-4cbe76977e05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:45.642756 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23801f1-4bd3-44ce-9c00-4cbe76977e05 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:45.650378 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 934/1855] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:03:45 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:03:45.651280 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cbd16d-9962-4f42-a260-c4540f0ec903 service cinder] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:45.652968 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-51cbd16d-9962-4f42-a260-c4540f0ec903 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:45.675691 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cbd16d-9962-4f42-a260-c4540f0ec903 service cinder] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:45.684701 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6e1e4d-e3d1-4a37-968b-fac02e644126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:45.685464 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e1e4d-e3d1-4a37-968b-fac02e644126 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:45.685998 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e1e4d-e3d1-4a37-968b-fac02e644126 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:45.686301 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e1e4d-e3d1-4a37-968b-fac02e644126 admin admin] PATH_INFO: `/v3/projects/1e706130ad894745b581de904f25d5f2` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:45.687619 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6e1e4d-e3d1-4a37-968b-fac02e644126 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e706130ad894745b581de904f25d5f2)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:45.689646 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6e1e4d-e3d1-4a37-968b-fac02e644126 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:45.708588 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 922/1856] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 10 10:03:45 2022] POST /identity/v3/projects => generated 367 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:03:45.712376 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23801f1-4bd3-44ce-9c00-4cbe76977e05 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:45.723312 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:45.742447 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:45.775420 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-0c6e1e4d-e3d1-4a37-968b-fac02e644126 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e706130ad894745b581de904f25d5f2', 'request_id': 'req-0c6e1e4d-e3d1-4a37-968b-fac02e644126'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:45.795345 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-0c6e1e4d-e3d1-4a37-968b-fac02e644126 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e706130ad894745b581de904f25d5f2', 'request_id': 'req-0c6e1e4d-e3d1-4a37-968b-fac02e644126'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:45.798415 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23801f1-4bd3-44ce-9c00-4cbe76977e05 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:45.807354 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-0c6e1e4d-e3d1-4a37-968b-fac02e644126 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e706130ad894745b581de904f25d5f2', 'request_id': 'req-0c6e1e4d-e3d1-4a37-968b-fac02e644126'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:45.837609 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-0c6e1e4d-e3d1-4a37-968b-fac02e644126 admin admin] The token cache is being invalidate because project 1e706130ad894745b581de904f25d5f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 10:03:45.839293 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-0c6e1e4d-e3d1-4a37-968b-fac02e644126 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:45.841332 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-0c6e1e4d-e3d1-4a37-968b-fac02e644126 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:45.844725 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 935/1857] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 10 10:03:45 2022] DELETE /identity/v3/projects/1e706130ad894745b581de904f25d5f2 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:03:45.848642 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6e1e4d-e3d1-4a37-968b-fac02e644126 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:45.852001 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-0c6e1e4d-e3d1-4a37-968b-fac02e644126 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:45.929829 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705d3c2d-b65c-45d9-ad8c-e7e1394f4f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:45.930882 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d3c2d-b65c-45d9-ad8c-e7e1394f4f93 admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:45.930882 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d3c2d-b65c-45d9-ad8c-e7e1394f4f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:45.931109 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d3c2d-b65c-45d9-ad8c-e7e1394f4f93 admin admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:45.931745 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705d3c2d-b65c-45d9-ad8c-e7e1394f4f93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:45.933784 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705d3c2d-b65c-45d9-ad8c-e7e1394f4f93 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:45.960232 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 923/1858] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 10 10:03:45 2022] POST /identity/v3/users => generated 290 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 10:03:45.961202 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705d3c2d-b65c-45d9-ad8c-e7e1394f4f93 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:45.963244 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-705d3c2d-b65c-45d9-ad8c-e7e1394f4f93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:45.976247 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705d3c2d-b65c-45d9-ad8c-e7e1394f4f93 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:45.979213 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6e1e4d-e3d1-4a37-968b-fac02e644126 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:45.981513 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23260824-2cc0-493d-a90a-9d2553ec0f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:45.982280 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23260824-2cc0-493d-a90a-9d2553ec0f6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:45.982561 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23260824-2cc0-493d-a90a-9d2553ec0f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:45.982835 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23260824-2cc0-493d-a90a-9d2553ec0f6c admin admin] PATH_INFO: `/v3/users/f4e6bc50cc4b4fdba85e66f6badd7410` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:45.983996 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23260824-2cc0-493d-a90a-9d2553ec0f6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4e6bc50cc4b4fdba85e66f6badd7410)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:45.985967 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23260824-2cc0-493d-a90a-9d2553ec0f6c admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:45.994096 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c79ac0-c9a8-4f54-8f4e-57b7fe415a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:45.995012 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c79ac0-c9a8-4f54-8f4e-57b7fe415a23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:45.995592 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c79ac0-c9a8-4f54-8f4e-57b7fe415a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:45.996025 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c79ac0-c9a8-4f54-8f4e-57b7fe415a23 admin admin] PATH_INFO: `/v3/users/7ee9dde09f3942d7b50f26d81dbbe0a1` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:45.997516 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c79ac0-c9a8-4f54-8f4e-57b7fe415a23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ee9dde09f3942d7b50f26d81dbbe0a1)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:45.999755 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c79ac0-c9a8-4f54-8f4e-57b7fe415a23 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:46.066829 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-23260824-2cc0-493d-a90a-9d2553ec0f6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4e6bc50cc4b4fdba85e66f6badd7410'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:46.077180 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-96c79ac0-c9a8-4f54-8f4e-57b7fe415a23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ee9dde09f3942d7b50f26d81dbbe0a1'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:46.077669 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-23260824-2cc0-493d-a90a-9d2553ec0f6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4e6bc50cc4b4fdba85e66f6badd7410'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:46.088463 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-96c79ac0-c9a8-4f54-8f4e-57b7fe415a23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ee9dde09f3942d7b50f26d81dbbe0a1'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:46.089693 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-96c79ac0-c9a8-4f54-8f4e-57b7fe415a23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ee9dde09f3942d7b50f26d81dbbe0a1'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:46.090795 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-96c79ac0-c9a8-4f54-8f4e-57b7fe415a23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ee9dde09f3942d7b50f26d81dbbe0a1'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:46.093624 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-23260824-2cc0-493d-a90a-9d2553ec0f6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4e6bc50cc4b4fdba85e66f6badd7410'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:46.094608 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-23260824-2cc0-493d-a90a-9d2553ec0f6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4e6bc50cc4b4fdba85e66f6badd7410'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:46.095492 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-23260824-2cc0-493d-a90a-9d2553ec0f6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4e6bc50cc4b4fdba85e66f6badd7410'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:46.101144 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-96c79ac0-c9a8-4f54-8f4e-57b7fe415a23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ee9dde09f3942d7b50f26d81dbbe0a1'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:46.124448 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 924/1859] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 10 10:03:45 2022] DELETE /identity/v3/users/f4e6bc50cc4b4fdba85e66f6badd7410 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:03:46.126208 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23260824-2cc0-493d-a90a-9d2553ec0f6c admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:46.129509 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-23260824-2cc0-493d-a90a-9d2553ec0f6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:46.129780 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 936/1860] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 10 10:03:45 2022] DELETE /identity/v3/users/7ee9dde09f3942d7b50f26d81dbbe0a1 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:03:46.131419 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdea1fb2-e13f-4642-8c55-a5ac79bdc299 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:46.131850 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdea1fb2-e13f-4642-8c55-a5ac79bdc299 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:46.157021 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdea1fb2-e13f-4642-8c55-a5ac79bdc299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:46.171912 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:46.212687 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-cdea1fb2-e13f-4642-8c55-a5ac79bdc299 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:03:46.215045 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-cdea1fb2-e13f-4642-8c55-a5ac79bdc299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:46.238332 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23260824-2cc0-493d-a90a-9d2553ec0f6c admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:46.263102 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:46.319688 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 937/1861] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:03:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:03:46.327170 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29245de3-1cd4-406c-91ad-5d88bb34628e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:46.327861 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29245de3-1cd4-406c-91ad-5d88bb34628e admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:46.328143 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29245de3-1cd4-406c-91ad-5d88bb34628e admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:46.328416 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29245de3-1cd4-406c-91ad-5d88bb34628e admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:46.329765 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29245de3-1cd4-406c-91ad-5d88bb34628e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:46.332144 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29245de3-1cd4-406c-91ad-5d88bb34628e admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:46.333056 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdea1fb2-e13f-4642-8c55-a5ac79bdc299 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:46.334574 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-cdea1fb2-e13f-4642-8c55-a5ac79bdc299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:46.346430 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 925/1862] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:03:46 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:03:46.352904 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29245de3-1cd4-406c-91ad-5d88bb34628e admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:46.372889 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29245de3-1cd4-406c-91ad-5d88bb34628e admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:46.387210 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33c71a3-457c-48f6-bb96-e4c9e9c1cec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:46.387899 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33c71a3-457c-48f6-bb96-e4c9e9c1cec0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:46.388181 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33c71a3-457c-48f6-bb96-e4c9e9c1cec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:46.388456 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33c71a3-457c-48f6-bb96-e4c9e9c1cec0 admin admin] PATH_INFO: `/v3/projects/b686025e84c942568681521f175e4ca4/users/90b659e270594c4ba4d6a89f686f7145/roles/eb04edc46b3742d7a0f0ead26f68bc22` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:46.424872 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdea1fb2-e13f-4642-8c55-a5ac79bdc299 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:46.427806 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33c71a3-457c-48f6-bb96-e4c9e9c1cec0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b686025e84c942568681521f175e4ca4, user_id=90b659e270594c4ba4d6a89f686f7145, role_id=eb04edc46b3742d7a0f0ead26f68bc22)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:46.429657 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6640f93e-71ff-4627-93fb-388418b455cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4294c170df354fe892831281acd4ea7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:46.430822 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33c71a3-457c-48f6-bb96-e4c9e9c1cec0 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:46.430952 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6640f93e-71ff-4627-93fb-388418b455cb service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:46.431536 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6640f93e-71ff-4627-93fb-388418b455cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:46.431973 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6640f93e-71ff-4627-93fb-388418b455cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:46.445377 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6640f93e-71ff-4627-93fb-388418b455cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:46.447457 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6640f93e-71ff-4627-93fb-388418b455cb service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:46.458886 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 926/1863] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:03:46 2022] PUT /identity/v3/projects/b686025e84c942568681521f175e4ca4/users/90b659e270594c4ba4d6a89f686f7145/roles/eb04edc46b3742d7a0f0ead26f68bc22 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 10:03:46.464660 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33c71a3-457c-48f6-bb96-e4c9e9c1cec0 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:46.465323 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 938/1864] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:03:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 10:03:46.548472 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33c71a3-457c-48f6-bb96-e4c9e9c1cec0 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:46.554178 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4804e0-bb26-4ebd-b9c4-09bfde3a409f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:46.554869 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4804e0-bb26-4ebd-b9c4-09bfde3a409f admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:46.555155 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4804e0-bb26-4ebd-b9c4-09bfde3a409f admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:46.556360 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4804e0-bb26-4ebd-b9c4-09bfde3a409f admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:46.558174 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4804e0-bb26-4ebd-b9c4-09bfde3a409f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:46.560629 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4804e0-bb26-4ebd-b9c4-09bfde3a409f admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:46.581115 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 927/1865] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:03:46 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 10:03:46.588059 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6640f93e-71ff-4627-93fb-388418b455cb service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:46.609205 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6640f93e-71ff-4627-93fb-388418b455cb service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:46.615694 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df16f43c-af6a-4e1f-9210-b7013b3860f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:46.616648 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df16f43c-af6a-4e1f-9210-b7013b3860f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:46.617158 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df16f43c-af6a-4e1f-9210-b7013b3860f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:46.617587 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df16f43c-af6a-4e1f-9210-b7013b3860f0 admin admin] PATH_INFO: `/v3/projects/b686025e84c942568681521f175e4ca4/users/90b659e270594c4ba4d6a89f686f7145/roles/eb04edc46b3742d7a0f0ead26f68bc22` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:46.620867 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df16f43c-af6a-4e1f-9210-b7013b3860f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b686025e84c942568681521f175e4ca4, user_id=90b659e270594c4ba4d6a89f686f7145, role_id=eb04edc46b3742d7a0f0ead26f68bc22)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:46.624378 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df16f43c-af6a-4e1f-9210-b7013b3860f0 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:46.646022 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 939/1866] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:03:46 2022] PUT /identity/v3/projects/b686025e84c942568681521f175e4ca4/users/90b659e270594c4ba4d6a89f686f7145/roles/eb04edc46b3742d7a0f0ead26f68bc22 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:03:46.653640 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baa9f7b-333c-4397-940b-e2877e9223f4 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:46.654344 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baa9f7b-333c-4397-940b-e2877e9223f4 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:46.654970 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baa9f7b-333c-4397-940b-e2877e9223f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:46.702112 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-9baa9f7b-333c-4397-940b-e2877e9223f4 None None] MFA Rules not processed for user `90b659e270594c4ba4d6a89f686f7145`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:03:46.703503 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-9baa9f7b-333c-4397-940b-e2877e9223f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:46.751123 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:46.814355 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 928/1867] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:03:46 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 10:03:46.815566 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df16f43c-af6a-4e1f-9210-b7013b3860f0 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:46.817953 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-df16f43c-af6a-4e1f-9210-b7013b3860f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:46.882312 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df16f43c-af6a-4e1f-9210-b7013b3860f0 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:46.886136 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20989e2f-057a-46e7-bb5c-19ae1130278b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf8e725cbe0403d943b136235eac057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:46.886834 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20989e2f-057a-46e7-bb5c-19ae1130278b service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:46.887140 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20989e2f-057a-46e7-bb5c-19ae1130278b service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:46.887437 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20989e2f-057a-46e7-bb5c-19ae1130278b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:46.897714 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20989e2f-057a-46e7-bb5c-19ae1130278b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:46.899186 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20989e2f-057a-46e7-bb5c-19ae1130278b service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:46.910143 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 940/1868] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:03:46 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:03:47.014286 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baa9f7b-333c-4397-940b-e2877e9223f4 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:47.030631 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baa9f7b-333c-4397-940b-e2877e9223f4 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:47.038064 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8973f70-988b-4819-923d-6dd5dee613ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf8e725cbe0403d943b136235eac057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:47.038811 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8973f70-988b-4819-923d-6dd5dee613ec service cinder] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:47.039190 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8973f70-988b-4819-923d-6dd5dee613ec service cinder] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:47.039523 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8973f70-988b-4819-923d-6dd5dee613ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:47.041499 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-a8973f70-988b-4819-923d-6dd5dee613ec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:47.088336 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20989e2f-057a-46e7-bb5c-19ae1130278b service cinder] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:47.089999 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-20989e2f-057a-46e7-bb5c-19ae1130278b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:47.134435 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8973f70-988b-4819-923d-6dd5dee613ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:47.137201 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8973f70-988b-4819-923d-6dd5dee613ec service cinder] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:47.153620 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 929/1869] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:03:47 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:03:47.241337 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20989e2f-057a-46e7-bb5c-19ae1130278b service cinder] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:47.248912 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bfe5ac-56e9-424d-852a-9ea62b3c623e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:47.249953 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bfe5ac-56e9-424d-852a-9ea62b3c623e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:47.250431 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bfe5ac-56e9-424d-852a-9ea62b3c623e admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:47.251658 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bfe5ac-56e9-424d-852a-9ea62b3c623e admin admin] PATH_INFO: `/v3/projects/22cf696116c240a9a2253909f3517fb1` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:47.262057 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bfe5ac-56e9-424d-852a-9ea62b3c623e admin admin] RBAC: Authorizing `identity:delete_project(project_id=22cf696116c240a9a2253909f3517fb1)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:47.265599 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bfe5ac-56e9-424d-852a-9ea62b3c623e admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:47.269003 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8973f70-988b-4819-923d-6dd5dee613ec service cinder] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:47.270206 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:47.270550 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-a8973f70-988b-4819-923d-6dd5dee613ec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:47.296668 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8973f70-988b-4819-923d-6dd5dee613ec service cinder] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:47.313491 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47521c00-41fd-4e43-9d05-47934ac17462 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf8e725cbe0403d943b136235eac057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:47.314225 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47521c00-41fd-4e43-9d05-47934ac17462 service cinder] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:47.314712 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47521c00-41fd-4e43-9d05-47934ac17462 service cinder] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:47.314988 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47521c00-41fd-4e43-9d05-47934ac17462 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:47.323016 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-47521c00-41fd-4e43-9d05-47934ac17462 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:47.357854 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-06bfe5ac-56e9-424d-852a-9ea62b3c623e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22cf696116c240a9a2253909f3517fb1', 'request_id': 'req-06bfe5ac-56e9-424d-852a-9ea62b3c623e'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:47.370477 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-06bfe5ac-56e9-424d-852a-9ea62b3c623e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22cf696116c240a9a2253909f3517fb1', 'request_id': 'req-06bfe5ac-56e9-424d-852a-9ea62b3c623e'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:47.385797 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-06bfe5ac-56e9-424d-852a-9ea62b3c623e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22cf696116c240a9a2253909f3517fb1', 'request_id': 'req-06bfe5ac-56e9-424d-852a-9ea62b3c623e'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:47.407104 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-06bfe5ac-56e9-424d-852a-9ea62b3c623e admin admin] The token cache is being invalidate because project 22cf696116c240a9a2253909f3517fb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 10:03:47.407412 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-06bfe5ac-56e9-424d-852a-9ea62b3c623e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:47.408987 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-06bfe5ac-56e9-424d-852a-9ea62b3c623e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:47.414696 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 941/1870] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 10 10:03:47 2022] DELETE /identity/v3/projects/22cf696116c240a9a2253909f3517fb1 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:03:47.418432 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6db228d-bb1a-409a-bc5a-4baba2b7c987 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:47.418720 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6db228d-bb1a-409a-bc5a-4baba2b7c987 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:47.418997 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6db228d-bb1a-409a-bc5a-4baba2b7c987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:47.432132 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47521c00-41fd-4e43-9d05-47934ac17462 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:47.434147 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47521c00-41fd-4e43-9d05-47934ac17462 service cinder] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:47.445095 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-f6db228d-bb1a-409a-bc5a-4baba2b7c987 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:03:47.446550 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-f6db228d-bb1a-409a-bc5a-4baba2b7c987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:47.456156 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 930/1871] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:03:47 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:03:47.543980 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47521c00-41fd-4e43-9d05-47934ac17462 service cinder] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:47.545443 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-47521c00-41fd-4e43-9d05-47934ac17462 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:47.572181 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 942/1872] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:03:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:03:47.573730 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b895ee1e-0d3e-48fa-aa9d-144872fc7a10 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:47.574018 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b895ee1e-0d3e-48fa-aa9d-144872fc7a10 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:47.574321 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b895ee1e-0d3e-48fa-aa9d-144872fc7a10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:47.577737 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47521c00-41fd-4e43-9d05-47934ac17462 service cinder] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:47.586240 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d30d32-569b-4919-b36c-74c009534484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:47.597732 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d30d32-569b-4919-b36c-74c009534484 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:47.598578 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d30d32-569b-4919-b36c-74c009534484 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:47.599003 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d30d32-569b-4919-b36c-74c009534484 admin admin] PATH_INFO: `/v3/projects/41185466e2d94014988bc645f2c89ec6` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:47.608104 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d30d32-569b-4919-b36c-74c009534484 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41185466e2d94014988bc645f2c89ec6)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:47.614550 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d30d32-569b-4919-b36c-74c009534484 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:47.643267 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-b895ee1e-0d3e-48fa-aa9d-144872fc7a10 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:03:47.646207 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-b895ee1e-0d3e-48fa-aa9d-144872fc7a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:47.689340 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 943/1873] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:03:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:03:47.695163 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b895ee1e-0d3e-48fa-aa9d-144872fc7a10 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:47.732263 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b895ee1e-0d3e-48fa-aa9d-144872fc7a10 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:47.737606 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-65d30d32-569b-4919-b36c-74c009534484 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41185466e2d94014988bc645f2c89ec6', 'request_id': 'req-65d30d32-569b-4919-b36c-74c009534484'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:47.744913 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:47.747627 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-65d30d32-569b-4919-b36c-74c009534484 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41185466e2d94014988bc645f2c89ec6', 'request_id': 'req-65d30d32-569b-4919-b36c-74c009534484'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:47.770818 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-65d30d32-569b-4919-b36c-74c009534484 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41185466e2d94014988bc645f2c89ec6', 'request_id': 'req-65d30d32-569b-4919-b36c-74c009534484'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:47.790306 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-65d30d32-569b-4919-b36c-74c009534484 admin admin] The token cache is being invalidate because project 41185466e2d94014988bc645f2c89ec6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 10:03:47.790609 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-65d30d32-569b-4919-b36c-74c009534484 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:47.793504 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-65d30d32-569b-4919-b36c-74c009534484 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:47.797115 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 931/1874] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 10 10:03:47 2022] DELETE /identity/v3/projects/41185466e2d94014988bc645f2c89ec6 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 10:03:47.801715 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d30d32-569b-4919-b36c-74c009534484 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:47.803170 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-65d30d32-569b-4919-b36c-74c009534484 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:47.885971 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39628225-bb2d-4ea2-9dba-05ac09922d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:47.887861 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39628225-bb2d-4ea2-9dba-05ac09922d93 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:47.888344 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39628225-bb2d-4ea2-9dba-05ac09922d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:47.889752 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39628225-bb2d-4ea2-9dba-05ac09922d93 admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:47.890642 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39628225-bb2d-4ea2-9dba-05ac09922d93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:03:47.891152 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39628225-bb2d-4ea2-9dba-05ac09922d93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:47.893164 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39628225-bb2d-4ea2-9dba-05ac09922d93 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:47.924680 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 944/1875] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 10 10:03:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:03:47.927309 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39628225-bb2d-4ea2-9dba-05ac09922d93 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:47.930355 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-39628225-bb2d-4ea2-9dba-05ac09922d93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:47.952607 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39628225-bb2d-4ea2-9dba-05ac09922d93 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:47.966106 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea90aa3-8272-4fdc-94e9-714c78dc0542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:47.967829 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea90aa3-8272-4fdc-94e9-714c78dc0542 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:47.968124 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea90aa3-8272-4fdc-94e9-714c78dc0542 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:47.968401 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea90aa3-8272-4fdc-94e9-714c78dc0542 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:47.969578 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea90aa3-8272-4fdc-94e9-714c78dc0542 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:47.971647 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea90aa3-8272-4fdc-94e9-714c78dc0542 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:47.973979 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d30d32-569b-4919-b36c-74c009534484 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:47.986601 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574d0eed-909c-4a84-9da7-485689d72161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:47.987266 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574d0eed-909c-4a84-9da7-485689d72161 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:47.987544 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574d0eed-909c-4a84-9da7-485689d72161 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:47.987813 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574d0eed-909c-4a84-9da7-485689d72161 admin admin] PATH_INFO: `/v3/users/a3f601df06884147bb7bf570bd5b3eda` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:47.989774 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574d0eed-909c-4a84-9da7-485689d72161 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3f601df06884147bb7bf570bd5b3eda)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:47.991732 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574d0eed-909c-4a84-9da7-485689d72161 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:48.010485 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:48.033291 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 945/1876] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 10 10:03:47 2022] POST /identity/v3/projects => generated 381 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 10:03:48.035627 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea90aa3-8272-4fdc-94e9-714c78dc0542 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:48.122535 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-574d0eed-909c-4a84-9da7-485689d72161 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3f601df06884147bb7bf570bd5b3eda'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:48.137852 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-574d0eed-909c-4a84-9da7-485689d72161 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3f601df06884147bb7bf570bd5b3eda'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:48.151257 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-574d0eed-909c-4a84-9da7-485689d72161 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3f601df06884147bb7bf570bd5b3eda'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:48.152948 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-574d0eed-909c-4a84-9da7-485689d72161 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3f601df06884147bb7bf570bd5b3eda'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:48.154393 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-574d0eed-909c-4a84-9da7-485689d72161 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3f601df06884147bb7bf570bd5b3eda'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:48.178629 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea90aa3-8272-4fdc-94e9-714c78dc0542 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:48.197808 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d2ba35-8060-41ec-a827-8efb5dd409cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:48.198903 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d2ba35-8060-41ec-a827-8efb5dd409cf admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:48.199411 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d2ba35-8060-41ec-a827-8efb5dd409cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:48.199894 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d2ba35-8060-41ec-a827-8efb5dd409cf admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:48.213497 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 932/1877] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 10 10:03:47 2022] DELETE /identity/v3/users/a3f601df06884147bb7bf570bd5b3eda => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 10:03:48.216605 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d2ba35-8060-41ec-a827-8efb5dd409cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:48.222560 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d2ba35-8060-41ec-a827-8efb5dd409cf admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:48.268443 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574d0eed-909c-4a84-9da7-485689d72161 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:48.268591 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 946/1878] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 10 10:03:48 2022] POST /identity/v3/users => generated 291 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:03:48.270378 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-574d0eed-909c-4a84-9da7-485689d72161 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:48.394802 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574d0eed-909c-4a84-9da7-485689d72161 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:48.405430 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de14acb4-5002-4f54-923b-86eadc3540b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:48.406914 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de14acb4-5002-4f54-923b-86eadc3540b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:48.407625 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de14acb4-5002-4f54-923b-86eadc3540b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:48.408141 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de14acb4-5002-4f54-923b-86eadc3540b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:48.409845 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de14acb4-5002-4f54-923b-86eadc3540b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:48.412252 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de14acb4-5002-4f54-923b-86eadc3540b4 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:48.415913 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:48.440286 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 933/1879] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:03:48 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:03:48.442910 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d2ba35-8060-41ec-a827-8efb5dd409cf admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:48.456801 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d2ba35-8060-41ec-a827-8efb5dd409cf admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:48.464132 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bf73bf-e28d-491e-9671-65bb06dc5cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:48.465643 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bf73bf-e28d-491e-9671-65bb06dc5cd9 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:48.465810 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bf73bf-e28d-491e-9671-65bb06dc5cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:48.466091 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bf73bf-e28d-491e-9671-65bb06dc5cd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:48.467077 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bf73bf-e28d-491e-9671-65bb06dc5cd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:48.469860 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bf73bf-e28d-491e-9671-65bb06dc5cd9 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:48.486904 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 947/1880] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:03:48 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:03:48.487930 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de14acb4-5002-4f54-923b-86eadc3540b4 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:48.499048 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de14acb4-5002-4f54-923b-86eadc3540b4 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:48.504473 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25464f4-aec0-4869-900f-ea502f138bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:48.505387 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25464f4-aec0-4869-900f-ea502f138bcd admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:48.505687 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25464f4-aec0-4869-900f-ea502f138bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:48.505947 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25464f4-aec0-4869-900f-ea502f138bcd admin admin] PATH_INFO: `/v3/projects/8deada1671904d71a40c4b1399b53105/users/359d9f19d1874fe1ab7c72c55a03d060/roles/8daabcb6b7394e39b06a3453e33e32db` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:48.525683 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25464f4-aec0-4869-900f-ea502f138bcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=8deada1671904d71a40c4b1399b53105, user_id=359d9f19d1874fe1ab7c72c55a03d060, role_id=8daabcb6b7394e39b06a3453e33e32db)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:48.528760 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25464f4-aec0-4869-900f-ea502f138bcd admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:48.564206 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 934/1881] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:03:48 2022] PUT /identity/v3/projects/8deada1671904d71a40c4b1399b53105/users/359d9f19d1874fe1ab7c72c55a03d060/roles/8daabcb6b7394e39b06a3453e33e32db => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:03:48.566823 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8631b8d9-1dd4-4adf-9dbe-039264b00fac None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:48.567330 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8631b8d9-1dd4-4adf-9dbe-039264b00fac None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:48.567798 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8631b8d9-1dd4-4adf-9dbe-039264b00fac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:48.599901 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-8631b8d9-1dd4-4adf-9dbe-039264b00fac None None] MFA Rules not processed for user `359d9f19d1874fe1ab7c72c55a03d060`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:03:48.601377 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-8631b8d9-1dd4-4adf-9dbe-039264b00fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:48.703145 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25464f4-aec0-4869-900f-ea502f138bcd admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:48.703328 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 948/1882] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:03:48 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:03:48.782845 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25464f4-aec0-4869-900f-ea502f138bcd admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:48.788690 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efb8de7-f057-482c-9410-fbc7c1028e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:48.789458 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efb8de7-f057-482c-9410-fbc7c1028e8b admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:48.789827 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efb8de7-f057-482c-9410-fbc7c1028e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:48.790197 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efb8de7-f057-482c-9410-fbc7c1028e8b admin admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:48.791176 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efb8de7-f057-482c-9410-fbc7c1028e8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:48.793433 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efb8de7-f057-482c-9410-fbc7c1028e8b admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:48.833588 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8631b8d9-1dd4-4adf-9dbe-039264b00fac None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:48.845374 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 935/1883] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 10 10:03:48 2022] POST /identity/v3/projects => generated 381 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:03:48.858174 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8631b8d9-1dd4-4adf-9dbe-039264b00fac None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:48.973467 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efb8de7-f057-482c-9410-fbc7c1028e8b admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:48.976013 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-2efb8de7-f057-482c-9410-fbc7c1028e8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:48.995566 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becd2aef-464b-447b-af1f-f342e64dba4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:48.996404 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becd2aef-464b-447b-af1f-f342e64dba4a admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:48.996779 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becd2aef-464b-447b-af1f-f342e64dba4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:48.997205 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becd2aef-464b-447b-af1f-f342e64dba4a admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:48.999299 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becd2aef-464b-447b-af1f-f342e64dba4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:49.002063 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becd2aef-464b-447b-af1f-f342e64dba4a admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:49.014723 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:49.054639 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 949/1884] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 10 10:03:48 2022] POST /identity/v3/users => generated 297 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:03:49.056130 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becd2aef-464b-447b-af1f-f342e64dba4a admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:49.093261 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becd2aef-464b-447b-af1f-f342e64dba4a admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:49.095782 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efb8de7-f057-482c-9410-fbc7c1028e8b admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:49.103053 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5cbdaf-446d-4489-a7f5-1481c78a8edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:49.103686 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5cbdaf-446d-4489-a7f5-1481c78a8edb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:49.103977 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5cbdaf-446d-4489-a7f5-1481c78a8edb admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:49.104354 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5cbdaf-446d-4489-a7f5-1481c78a8edb admin admin] PATH_INFO: `/v3/projects/c1817f44397b445ab2a96e970a246492` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:49.106481 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2bdc1a-7899-4399-9516-621bdb3055d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:49.106611 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5cbdaf-446d-4489-a7f5-1481c78a8edb admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1817f44397b445ab2a96e970a246492)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:49.107631 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2bdc1a-7899-4399-9516-621bdb3055d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:49.108015 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2bdc1a-7899-4399-9516-621bdb3055d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:49.108488 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2bdc1a-7899-4399-9516-621bdb3055d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:49.109304 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2bdc1a-7899-4399-9516-621bdb3055d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:49.111302 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5cbdaf-446d-4489-a7f5-1481c78a8edb admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:49.111692 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2bdc1a-7899-4399-9516-621bdb3055d0 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:49.126806 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 950/1885] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:03:49 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:03:49.130803 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2bdc1a-7899-4399-9516-621bdb3055d0 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:49.144219 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2bdc1a-7899-4399-9516-621bdb3055d0 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:49.149808 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8821bbe-869a-44bf-8f92-37527dcea6b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:49.150559 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8821bbe-869a-44bf-8f92-37527dcea6b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:49.150914 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8821bbe-869a-44bf-8f92-37527dcea6b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:49.151260 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8821bbe-869a-44bf-8f92-37527dcea6b2 admin admin] PATH_INFO: `/v3/projects/48dc0e31c2074db2a2b1469a95fa66da/users/6b816b99c0794ca9b672f0761ff6f970/roles/eb04edc46b3742d7a0f0ead26f68bc22` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:49.169990 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8821bbe-869a-44bf-8f92-37527dcea6b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48dc0e31c2074db2a2b1469a95fa66da, user_id=6b816b99c0794ca9b672f0761ff6f970, role_id=eb04edc46b3742d7a0f0ead26f68bc22)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:49.173106 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8821bbe-869a-44bf-8f92-37527dcea6b2 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:49.196231 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 951/1886] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:03:49 2022] PUT /identity/v3/projects/48dc0e31c2074db2a2b1469a95fa66da/users/6b816b99c0794ca9b672f0761ff6f970/roles/eb04edc46b3742d7a0f0ead26f68bc22 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:03:49.200960 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8821bbe-869a-44bf-8f92-37527dcea6b2 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:49.233744 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-7c5cbdaf-446d-4489-a7f5-1481c78a8edb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1817f44397b445ab2a96e970a246492', 'request_id': 'req-7c5cbdaf-446d-4489-a7f5-1481c78a8edb'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:49.260467 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-7c5cbdaf-446d-4489-a7f5-1481c78a8edb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1817f44397b445ab2a96e970a246492', 'request_id': 'req-7c5cbdaf-446d-4489-a7f5-1481c78a8edb'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:49.264431 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:49.274635 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-7c5cbdaf-446d-4489-a7f5-1481c78a8edb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1817f44397b445ab2a96e970a246492', 'request_id': 'req-7c5cbdaf-446d-4489-a7f5-1481c78a8edb'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:49.299175 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-7c5cbdaf-446d-4489-a7f5-1481c78a8edb admin admin] The token cache is being invalidate because project c1817f44397b445ab2a96e970a246492 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 10:03:49.299490 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-7c5cbdaf-446d-4489-a7f5-1481c78a8edb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:49.301544 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-7c5cbdaf-446d-4489-a7f5-1481c78a8edb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:49.307842 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 936/1887] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 10 10:03:48 2022] DELETE /identity/v3/projects/c1817f44397b445ab2a96e970a246492 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:03:49.314239 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662d9277-7691-4f65-afda-96ae816bba01 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:49.314515 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662d9277-7691-4f65-afda-96ae816bba01 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:49.314795 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662d9277-7691-4f65-afda-96ae816bba01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:49.341436 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8821bbe-869a-44bf-8f92-37527dcea6b2 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:49.394118 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-662d9277-7691-4f65-afda-96ae816bba01 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:03:49.395651 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-662d9277-7691-4f65-afda-96ae816bba01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:49.570727 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bf35f5-48b3-43d4-b364-c7c0d487f09f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:49.571928 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf35f5-48b3-43d4-b364-c7c0d487f09f admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:49.572218 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf35f5-48b3-43d4-b364-c7c0d487f09f admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:49.572605 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf35f5-48b3-43d4-b364-c7c0d487f09f admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:49.573690 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bf35f5-48b3-43d4-b364-c7c0d487f09f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:49.576022 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bf35f5-48b3-43d4-b364-c7c0d487f09f admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:49.579476 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 937/1888] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:03:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:03:49.588112 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4630ea9a-8297-4848-8a04-382df002e7d3 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:49.588408 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4630ea9a-8297-4848-8a04-382df002e7d3 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:49.588745 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4630ea9a-8297-4848-8a04-382df002e7d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:49.617920 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 952/1889] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:03:49 2022] GET /identity/v3/roles => generated 1420 bytes in 418 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:03:49.622923 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bf35f5-48b3-43d4-b364-c7c0d487f09f admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:49.628595 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-42bf35f5-48b3-43d4-b364-c7c0d487f09f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:49.629034 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-4630ea9a-8297-4848-8a04-382df002e7d3 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:03:49.632552 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-4630ea9a-8297-4848-8a04-382df002e7d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:49.656003 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 938/1890] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:03:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 10:03:49.658347 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bf35f5-48b3-43d4-b364-c7c0d487f09f admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:49.661088 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4630ea9a-8297-4848-8a04-382df002e7d3 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:49.674090 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ab0a1a-3919-46f2-aff9-b4311e882e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:49.675075 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ab0a1a-3919-46f2-aff9-b4311e882e13 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:49.675389 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ab0a1a-3919-46f2-aff9-b4311e882e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:49.675780 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ab0a1a-3919-46f2-aff9-b4311e882e13 admin admin] PATH_INFO: `/v3/projects/48dc0e31c2074db2a2b1469a95fa66da/users/6b816b99c0794ca9b672f0761ff6f970/roles/eb04edc46b3742d7a0f0ead26f68bc22` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:49.679702 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ab0a1a-3919-46f2-aff9-b4311e882e13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48dc0e31c2074db2a2b1469a95fa66da, user_id=6b816b99c0794ca9b672f0761ff6f970, role_id=eb04edc46b3742d7a0f0ead26f68bc22)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:49.684363 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4630ea9a-8297-4848-8a04-382df002e7d3 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:49.687458 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ab0a1a-3919-46f2-aff9-b4311e882e13 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:49.696360 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed644b28-0625-404f-814a-b106dc736448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:49.700864 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed644b28-0625-404f-814a-b106dc736448 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:49.701191 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed644b28-0625-404f-814a-b106dc736448 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:49.701472 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed644b28-0625-404f-814a-b106dc736448 admin admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:49.702152 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed644b28-0625-404f-814a-b106dc736448 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:03:49.702608 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed644b28-0625-404f-814a-b106dc736448 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:49.705478 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed644b28-0625-404f-814a-b106dc736448 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:49.709734 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 953/1891] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:03:49 2022] PUT /identity/v3/projects/48dc0e31c2074db2a2b1469a95fa66da/users/6b816b99c0794ca9b672f0761ff6f970/roles/eb04edc46b3742d7a0f0ead26f68bc22 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 10:03:49.746710 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd30b8e9-fc66-451c-9a9d-f2059bdd975d None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:49.750680 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd30b8e9-fc66-451c-9a9d-f2059bdd975d None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:49.751051 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd30b8e9-fc66-451c-9a9d-f2059bdd975d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:49.766870 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 939/1892] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 10 10:03:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:03:49.769927 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed644b28-0625-404f-814a-b106dc736448 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:49.790855 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed644b28-0625-404f-814a-b106dc736448 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:49.847328 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-bd30b8e9-fc66-451c-9a9d-f2059bdd975d None None] MFA Rules not processed for user `6b816b99c0794ca9b672f0761ff6f970`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:03:49.848740 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-bd30b8e9-fc66-451c-9a9d-f2059bdd975d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:49.866741 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ab7700-d0cb-4ecd-99ad-729708fdba97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:49.868094 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ab7700-d0cb-4ecd-99ad-729708fdba97 admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:49.868478 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ab7700-d0cb-4ecd-99ad-729708fdba97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:49.868757 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ab7700-d0cb-4ecd-99ad-729708fdba97 admin admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:49.869440 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ab7700-d0cb-4ecd-99ad-729708fdba97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:49.871504 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ab7700-d0cb-4ecd-99ad-729708fdba97 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:49.908274 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 940/1893] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 10 10:03:49 2022] POST /identity/v3/projects => generated 381 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:03:49.910458 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ab7700-d0cb-4ecd-99ad-729708fdba97 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:49.913842 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:49.951370 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 954/1894] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:03:49 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:03:49.967373 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd30b8e9-fc66-451c-9a9d-f2059bdd975d None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:49.970991 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-bd30b8e9-fc66-451c-9a9d-f2059bdd975d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:50.066602 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:50.091033 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ab7700-d0cb-4ecd-99ad-729708fdba97 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:50.101331 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5743df5-b85a-404e-8bd1-d275d5167d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:50.103141 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5743df5-b85a-404e-8bd1-d275d5167d96 admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:50.105818 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5743df5-b85a-404e-8bd1-d275d5167d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:50.106112 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5743df5-b85a-404e-8bd1-d275d5167d96 admin admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:50.106800 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5743df5-b85a-404e-8bd1-d275d5167d96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:50.110407 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5743df5-b85a-404e-8bd1-d275d5167d96 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:50.136252 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd30b8e9-fc66-451c-9a9d-f2059bdd975d None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:50.159095 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 941/1895] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 10 10:03:49 2022] POST /identity/v3/users => generated 291 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:03:50.163639 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5743df5-b85a-404e-8bd1-d275d5167d96 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:50.181761 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5743df5-b85a-404e-8bd1-d275d5167d96 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:50.199032 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80628f6-65ba-4955-b5d9-8742f1483a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:50.199678 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80628f6-65ba-4955-b5d9-8742f1483a1a admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:50.199963 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80628f6-65ba-4955-b5d9-8742f1483a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:50.200245 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80628f6-65ba-4955-b5d9-8742f1483a1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:50.200904 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80628f6-65ba-4955-b5d9-8742f1483a1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:50.203549 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80628f6-65ba-4955-b5d9-8742f1483a1a admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:50.220576 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 942/1896] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:03:50 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 10:03:50.224629 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80628f6-65ba-4955-b5d9-8742f1483a1a admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:50.240154 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80628f6-65ba-4955-b5d9-8742f1483a1a admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:50.248966 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6107b5e1-8952-40aa-91f0-f553dc2a2a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:50.249891 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6107b5e1-8952-40aa-91f0-f553dc2a2a71 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:50.250183 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6107b5e1-8952-40aa-91f0-f553dc2a2a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:50.250462 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6107b5e1-8952-40aa-91f0-f553dc2a2a71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:50.251179 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6107b5e1-8952-40aa-91f0-f553dc2a2a71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:50.253606 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6107b5e1-8952-40aa-91f0-f553dc2a2a71 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:50.266749 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 943/1897] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:03:50 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:03:50.270838 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6107b5e1-8952-40aa-91f0-f553dc2a2a71 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:50.277172 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530d817a-0d9f-4dbd-89de-4a438a7203e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf8e725cbe0403d943b136235eac057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:50.277874 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530d817a-0d9f-4dbd-89de-4a438a7203e7 service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:50.278268 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530d817a-0d9f-4dbd-89de-4a438a7203e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:50.278604 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530d817a-0d9f-4dbd-89de-4a438a7203e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:50.309164 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6107b5e1-8952-40aa-91f0-f553dc2a2a71 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:50.309164 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b798f02-0fea-4fdf-9149-f33af501701e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:50.309164 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b798f02-0fea-4fdf-9149-f33af501701e admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:50.309164 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b798f02-0fea-4fdf-9149-f33af501701e admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:50.310178 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b798f02-0fea-4fdf-9149-f33af501701e admin admin] PATH_INFO: `/v3/projects/bb5a6f9ff36c4959a1cb16345f36bb6a/users/2ce05e1ed79241cbb0a85b0707598186/roles/8daabcb6b7394e39b06a3453e33e32db` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:50.321826 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b798f02-0fea-4fdf-9149-f33af501701e admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb5a6f9ff36c4959a1cb16345f36bb6a, user_id=2ce05e1ed79241cbb0a85b0707598186, role_id=8daabcb6b7394e39b06a3453e33e32db)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:50.325211 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b798f02-0fea-4fdf-9149-f33af501701e admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:50.340478 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 944/1898] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:03:50 2022] PUT /identity/v3/projects/bb5a6f9ff36c4959a1cb16345f36bb6a/users/2ce05e1ed79241cbb0a85b0707598186/roles/8daabcb6b7394e39b06a3453e33e32db => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:03:50.351972 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20615f2-0a44-4be6-a4a6-04676c324a36 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:50.353232 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20615f2-0a44-4be6-a4a6-04676c324a36 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:50.353556 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20615f2-0a44-4be6-a4a6-04676c324a36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:50.380301 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530d817a-0d9f-4dbd-89de-4a438a7203e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:50.381964 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530d817a-0d9f-4dbd-89de-4a438a7203e7 service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:50.389306 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-f20615f2-0a44-4be6-a4a6-04676c324a36 None None] MFA Rules not processed for user `2ce05e1ed79241cbb0a85b0707598186`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:03:50.391255 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-f20615f2-0a44-4be6-a4a6-04676c324a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:50.396699 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 955/1899] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:03:49 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:03:50.473963 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 945/1900] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:03:50 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:03:50.478347 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530d817a-0d9f-4dbd-89de-4a438a7203e7 service cinder] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:50.489185 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530d817a-0d9f-4dbd-89de-4a438a7203e7 service cinder] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:50.537782 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:50.561195 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971d2acc-6b5c-4ba2-b27b-3451dddd45f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:50.561816 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971d2acc-6b5c-4ba2-b27b-3451dddd45f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:50.562093 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971d2acc-6b5c-4ba2-b27b-3451dddd45f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:50.562407 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971d2acc-6b5c-4ba2-b27b-3451dddd45f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:50.563154 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971d2acc-6b5c-4ba2-b27b-3451dddd45f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:50.565077 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971d2acc-6b5c-4ba2-b27b-3451dddd45f5 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:50.602941 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 956/1901] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 10 10:03:50 2022] POST /identity/v3/projects => generated 381 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 10:03:50.607333 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20615f2-0a44-4be6-a4a6-04676c324a36 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:50.621495 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20615f2-0a44-4be6-a4a6-04676c324a36 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:50.714173 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6c94fa-e1f6-4b49-9786-2c38ccc05aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:50.714803 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6c94fa-e1f6-4b49-9786-2c38ccc05aa1 admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:50.715140 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6c94fa-e1f6-4b49-9786-2c38ccc05aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:50.715403 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6c94fa-e1f6-4b49-9786-2c38ccc05aa1 admin admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:50.716063 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6c94fa-e1f6-4b49-9786-2c38ccc05aa1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:50.721255 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6c94fa-e1f6-4b49-9786-2c38ccc05aa1 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:50.749910 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 946/1902] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 10 10:03:50 2022] POST /identity/v3/users => generated 297 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 10:03:50.755402 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971d2acc-6b5c-4ba2-b27b-3451dddd45f5 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:50.772525 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971d2acc-6b5c-4ba2-b27b-3451dddd45f5 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:50.774944 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107c4620-40b8-4351-abbf-236aaacb9bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:50.775577 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c4620-40b8-4351-abbf-236aaacb9bdb admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:50.775862 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c4620-40b8-4351-abbf-236aaacb9bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:50.776212 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c4620-40b8-4351-abbf-236aaacb9bdb admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:50.776987 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107c4620-40b8-4351-abbf-236aaacb9bdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:50.778769 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107c4620-40b8-4351-abbf-236aaacb9bdb admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:50.798536 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 957/1903] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:03:50 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:03:50.802736 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6c94fa-e1f6-4b49-9786-2c38ccc05aa1 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:50.813356 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6c94fa-e1f6-4b49-9786-2c38ccc05aa1 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:50.824148 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b381df-11f1-4a5d-8f6b-d42f64456ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:50.824148 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b381df-11f1-4a5d-8f6b-d42f64456ba4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:50.824148 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b381df-11f1-4a5d-8f6b-d42f64456ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:50.824148 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b381df-11f1-4a5d-8f6b-d42f64456ba4 admin admin] PATH_INFO: `/v3/projects/b698774575084a3a91092a561e8386d4/users/eb8ba0d4390443e68e0296a465134da5/roles/eb04edc46b3742d7a0f0ead26f68bc22` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:50.837093 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b381df-11f1-4a5d-8f6b-d42f64456ba4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b698774575084a3a91092a561e8386d4, user_id=eb8ba0d4390443e68e0296a465134da5, role_id=eb04edc46b3742d7a0f0ead26f68bc22)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:50.840198 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b381df-11f1-4a5d-8f6b-d42f64456ba4 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:50.842824 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:50.865297 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 947/1904] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:03:50 2022] PUT /identity/v3/projects/b698774575084a3a91092a561e8386d4/users/eb8ba0d4390443e68e0296a465134da5/roles/eb04edc46b3742d7a0f0ead26f68bc22 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:03:50.868105 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107c4620-40b8-4351-abbf-236aaacb9bdb admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:50.887921 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107c4620-40b8-4351-abbf-236aaacb9bdb admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:50.903464 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b381df-11f1-4a5d-8f6b-d42f64456ba4 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:51.012599 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b381df-11f1-4a5d-8f6b-d42f64456ba4 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:51.018364 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ae5b71-7156-45c6-b720-278fea6a6ce2 tempest-VolumeQuotaClassesTest-1234482092 tempest-VolumeQuotaClassesTest-1234482092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b816b99c0794ca9b672f0761ff6f970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48dc0e31c2074db2a2b1469a95fa66da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:51.018997 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ae5b71-7156-45c6-b720-278fea6a6ce2 tempest-VolumeQuotaClassesTest-1234482092 tempest-VolumeQuotaClassesTest-1234482092-project-admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:51.020252 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ae5b71-7156-45c6-b720-278fea6a6ce2 tempest-VolumeQuotaClassesTest-1234482092 tempest-VolumeQuotaClassesTest-1234482092-project-admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:51.020538 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ae5b71-7156-45c6-b720-278fea6a6ce2 tempest-VolumeQuotaClassesTest-1234482092 tempest-VolumeQuotaClassesTest-1234482092-project-admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:51.021357 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ae5b71-7156-45c6-b720-278fea6a6ce2 tempest-VolumeQuotaClassesTest-1234482092 tempest-VolumeQuotaClassesTest-1234482092-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:03:51.021605 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e090b2af-64ea-4daa-89ea-951fd9d29ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:51.021722 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ae5b71-7156-45c6-b720-278fea6a6ce2 tempest-VolumeQuotaClassesTest-1234482092 tempest-VolumeQuotaClassesTest-1234482092-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:51.023694 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ae5b71-7156-45c6-b720-278fea6a6ce2 tempest-VolumeQuotaClassesTest-1234482092 tempest-VolumeQuotaClassesTest-1234482092-project-admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:51.024768 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e090b2af-64ea-4daa-89ea-951fd9d29ad6 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:51.025209 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e090b2af-64ea-4daa-89ea-951fd9d29ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:51.026973 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e090b2af-64ea-4daa-89ea-951fd9d29ad6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:51.027940 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e090b2af-64ea-4daa-89ea-951fd9d29ad6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:51.029892 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e090b2af-64ea-4daa-89ea-951fd9d29ad6 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:51.045314 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 948/1905] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 10 10:03:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:03:51.049560 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ae5b71-7156-45c6-b720-278fea6a6ce2 tempest-VolumeQuotaClassesTest-1234482092 tempest-VolumeQuotaClassesTest-1234482092-project-admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:51.059215 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 958/1906] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:03:50 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:03:51.062322 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e090b2af-64ea-4daa-89ea-951fd9d29ad6 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:51.072470 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ae5b71-7156-45c6-b720-278fea6a6ce2 tempest-VolumeQuotaClassesTest-1234482092 tempest-VolumeQuotaClassesTest-1234482092-project-admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:51.077633 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b5e274-2cc3-44a5-89ac-5708ee6a57cf tempest-VolumeQuotaClassesTest-1234482092 tempest-VolumeQuotaClassesTest-1234482092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b816b99c0794ca9b672f0761ff6f970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48dc0e31c2074db2a2b1469a95fa66da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:51.078825 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b5e274-2cc3-44a5-89ac-5708ee6a57cf tempest-VolumeQuotaClassesTest-1234482092 tempest-VolumeQuotaClassesTest-1234482092-project-admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:51.079115 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b5e274-2cc3-44a5-89ac-5708ee6a57cf tempest-VolumeQuotaClassesTest-1234482092 tempest-VolumeQuotaClassesTest-1234482092-project-admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:51.079391 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b5e274-2cc3-44a5-89ac-5708ee6a57cf tempest-VolumeQuotaClassesTest-1234482092 tempest-VolumeQuotaClassesTest-1234482092-project-admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:51.080030 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b5e274-2cc3-44a5-89ac-5708ee6a57cf tempest-VolumeQuotaClassesTest-1234482092 tempest-VolumeQuotaClassesTest-1234482092-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:51.082895 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b5e274-2cc3-44a5-89ac-5708ee6a57cf tempest-VolumeQuotaClassesTest-1234482092 tempest-VolumeQuotaClassesTest-1234482092-project-admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:51.086918 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e090b2af-64ea-4daa-89ea-951fd9d29ad6 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:51.115834 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3014755-dcb9-41b4-85db-1707482e3189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:51.115834 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3014755-dcb9-41b4-85db-1707482e3189 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:51.115834 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3014755-dcb9-41b4-85db-1707482e3189 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:51.115834 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3014755-dcb9-41b4-85db-1707482e3189 admin admin] PATH_INFO: `/v3/projects/b698774575084a3a91092a561e8386d4/users/eb8ba0d4390443e68e0296a465134da5/roles/eb04edc46b3742d7a0f0ead26f68bc22` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:51.120264 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3014755-dcb9-41b4-85db-1707482e3189 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b698774575084a3a91092a561e8386d4, user_id=eb8ba0d4390443e68e0296a465134da5, role_id=eb04edc46b3742d7a0f0ead26f68bc22)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:51.129498 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3014755-dcb9-41b4-85db-1707482e3189 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:51.145846 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 959/1907] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:03:51 2022] PUT /identity/v3/projects/b698774575084a3a91092a561e8386d4/users/eb8ba0d4390443e68e0296a465134da5/roles/eb04edc46b3742d7a0f0ead26f68bc22 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 10:03:51.163344 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b2d0ca-1444-4749-9dfe-72723def2f52 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:51.163344 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b2d0ca-1444-4749-9dfe-72723def2f52 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:51.163344 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b2d0ca-1444-4749-9dfe-72723def2f52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:51.163645 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 949/1908] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 10 10:03:51 2022] POST /identity/v3/projects => generated 354 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:03:51.165109 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b5e274-2cc3-44a5-89ac-5708ee6a57cf tempest-VolumeQuotaClassesTest-1234482092 tempest-VolumeQuotaClassesTest-1234482092-project-admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:51.263449 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-93b2d0ca-1444-4749-9dfe-72723def2f52 None None] MFA Rules not processed for user `eb8ba0d4390443e68e0296a465134da5`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:03:51.264950 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-93b2d0ca-1444-4749-9dfe-72723def2f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:51.356997 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b5e274-2cc3-44a5-89ac-5708ee6a57cf tempest-VolumeQuotaClassesTest-1234482092 tempest-VolumeQuotaClassesTest-1234482092-project-admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:51.367306 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4cfbd9-1c91-431f-b1e8-6b0a5da2fb84 tempest-VolumeQuotaClassesTest-1234482092 tempest-VolumeQuotaClassesTest-1234482092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b816b99c0794ca9b672f0761ff6f970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48dc0e31c2074db2a2b1469a95fa66da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:51.368115 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4cfbd9-1c91-431f-b1e8-6b0a5da2fb84 tempest-VolumeQuotaClassesTest-1234482092 tempest-VolumeQuotaClassesTest-1234482092-project-admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:51.368864 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4cfbd9-1c91-431f-b1e8-6b0a5da2fb84 tempest-VolumeQuotaClassesTest-1234482092 tempest-VolumeQuotaClassesTest-1234482092-project-admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:51.368864 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4cfbd9-1c91-431f-b1e8-6b0a5da2fb84 tempest-VolumeQuotaClassesTest-1234482092 tempest-VolumeQuotaClassesTest-1234482092-project-admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:51.369394 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4cfbd9-1c91-431f-b1e8-6b0a5da2fb84 tempest-VolumeQuotaClassesTest-1234482092 tempest-VolumeQuotaClassesTest-1234482092-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:03:51.369730 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4cfbd9-1c91-431f-b1e8-6b0a5da2fb84 tempest-VolumeQuotaClassesTest-1234482092 tempest-VolumeQuotaClassesTest-1234482092-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:51.373452 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4cfbd9-1c91-431f-b1e8-6b0a5da2fb84 tempest-VolumeQuotaClassesTest-1234482092 tempest-VolumeQuotaClassesTest-1234482092-project-admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:51.375750 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 960/1909] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:03:51 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:03:51.391310 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 950/1910] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 10 10:03:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:03:51.391479 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b2d0ca-1444-4749-9dfe-72723def2f52 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:51.425797 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:51.449212 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4cfbd9-1c91-431f-b1e8-6b0a5da2fb84 tempest-VolumeQuotaClassesTest-1234482092 tempest-VolumeQuotaClassesTest-1234482092-project-admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:51.462064 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4cfbd9-1c91-431f-b1e8-6b0a5da2fb84 tempest-VolumeQuotaClassesTest-1234482092 tempest-VolumeQuotaClassesTest-1234482092-project-admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:51.467796 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3094b8-8614-4ce7-b06a-cc95a48ce4de tempest-VolumeQuotaClassesTest-1234482092 tempest-VolumeQuotaClassesTest-1234482092-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b816b99c0794ca9b672f0761ff6f970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48dc0e31c2074db2a2b1469a95fa66da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:51.468802 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3094b8-8614-4ce7-b06a-cc95a48ce4de tempest-VolumeQuotaClassesTest-1234482092 tempest-VolumeQuotaClassesTest-1234482092-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:51.469632 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3094b8-8614-4ce7-b06a-cc95a48ce4de tempest-VolumeQuotaClassesTest-1234482092 tempest-VolumeQuotaClassesTest-1234482092-project-admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:51.470081 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3094b8-8614-4ce7-b06a-cc95a48ce4de tempest-VolumeQuotaClassesTest-1234482092 tempest-VolumeQuotaClassesTest-1234482092-project-admin] PATH_INFO: `/v3/projects/3f4633047fff4cb38dfc70431dcd1ebb` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:51.471355 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3094b8-8614-4ce7-b06a-cc95a48ce4de tempest-VolumeQuotaClassesTest-1234482092 tempest-VolumeQuotaClassesTest-1234482092-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3f4633047fff4cb38dfc70431dcd1ebb)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:51.473452 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b2d0ca-1444-4749-9dfe-72723def2f52 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:51.473839 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3094b8-8614-4ce7-b06a-cc95a48ce4de tempest-VolumeQuotaClassesTest-1234482092 tempest-VolumeQuotaClassesTest-1234482092-project-admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:51.479448 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913aa78b-e843-493d-97b5-bcf3b9018e15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf8e725cbe0403d943b136235eac057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:51.480186 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913aa78b-e843-493d-97b5-bcf3b9018e15 service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:51.480515 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913aa78b-e843-493d-97b5-bcf3b9018e15 service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:51.480817 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913aa78b-e843-493d-97b5-bcf3b9018e15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:51.493545 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913aa78b-e843-493d-97b5-bcf3b9018e15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:51.496086 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913aa78b-e843-493d-97b5-bcf3b9018e15 service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:51.518418 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 961/1911] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:03:51 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:03:51.578948 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-cb3094b8-8614-4ce7-b06a-cc95a48ce4de tempest-VolumeQuotaClassesTest-1234482092 tempest-VolumeQuotaClassesTest-1234482092-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f4633047fff4cb38dfc70431dcd1ebb', 'request_id': 'req-cb3094b8-8614-4ce7-b06a-cc95a48ce4de'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:51.583837 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:INSERT=2,keystone:SELECT=93,keystone:DELETE=5 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:51.591417 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-cb3094b8-8614-4ce7-b06a-cc95a48ce4de tempest-VolumeQuotaClassesTest-1234482092 tempest-VolumeQuotaClassesTest-1234482092-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f4633047fff4cb38dfc70431dcd1ebb', 'request_id': 'req-cb3094b8-8614-4ce7-b06a-cc95a48ce4de'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:51.609579 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-cb3094b8-8614-4ce7-b06a-cc95a48ce4de tempest-VolumeQuotaClassesTest-1234482092 tempest-VolumeQuotaClassesTest-1234482092-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f4633047fff4cb38dfc70431dcd1ebb', 'request_id': 'req-cb3094b8-8614-4ce7-b06a-cc95a48ce4de'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:51.622381 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913aa78b-e843-493d-97b5-bcf3b9018e15 service cinder] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:51.627839 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-cb3094b8-8614-4ce7-b06a-cc95a48ce4de tempest-VolumeQuotaClassesTest-1234482092 tempest-VolumeQuotaClassesTest-1234482092-project-admin] The token cache is being invalidate because project 3f4633047fff4cb38dfc70431dcd1ebb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 10:03:51.628145 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-cb3094b8-8614-4ce7-b06a-cc95a48ce4de tempest-VolumeQuotaClassesTest-1234482092 tempest-VolumeQuotaClassesTest-1234482092-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:51.628828 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-cb3094b8-8614-4ce7-b06a-cc95a48ce4de tempest-VolumeQuotaClassesTest-1234482092 tempest-VolumeQuotaClassesTest-1234482092-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:51.630540 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 951/1912] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 10 10:03:51 2022] DELETE /identity/v3/projects/3f4633047fff4cb38dfc70431dcd1ebb => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:03:51.632831 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913aa78b-e843-493d-97b5-bcf3b9018e15 service cinder] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:51.693429 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdadf78-db8d-43f1-a529-e2a30e166377 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf8e725cbe0403d943b136235eac057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:51.693931 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdadf78-db8d-43f1-a529-e2a30e166377 service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:51.694463 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdadf78-db8d-43f1-a529-e2a30e166377 service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:51.694645 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdadf78-db8d-43f1-a529-e2a30e166377 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:51.696472 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-4fdadf78-db8d-43f1-a529-e2a30e166377 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:51.759694 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdadf78-db8d-43f1-a529-e2a30e166377 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:51.761380 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdadf78-db8d-43f1-a529-e2a30e166377 service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:51.771454 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 962/1913] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:03:51 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 10:03:51.949777 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3094b8-8614-4ce7-b06a-cc95a48ce4de tempest-VolumeQuotaClassesTest-1234482092 tempest-VolumeQuotaClassesTest-1234482092-project-admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:51.951368 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-cb3094b8-8614-4ce7-b06a-cc95a48ce4de tempest-VolumeQuotaClassesTest-1234482092 tempest-VolumeQuotaClassesTest-1234482092-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:52.050077 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3094b8-8614-4ce7-b06a-cc95a48ce4de tempest-VolumeQuotaClassesTest-1234482092 tempest-VolumeQuotaClassesTest-1234482092-project-admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:52.059038 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52effb5-c36b-4d10-b6e8-d371427b5e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:52.059803 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52effb5-c36b-4d10-b6e8-d371427b5e55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:52.060031 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52effb5-c36b-4d10-b6e8-d371427b5e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:52.060355 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52effb5-c36b-4d10-b6e8-d371427b5e55 admin admin] PATH_INFO: `/v3/users/359d9f19d1874fe1ab7c72c55a03d060` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:52.063726 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52effb5-c36b-4d10-b6e8-d371427b5e55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=359d9f19d1874fe1ab7c72c55a03d060)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:52.065741 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52effb5-c36b-4d10-b6e8-d371427b5e55 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:52.154204 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdadf78-db8d-43f1-a529-e2a30e166377 service cinder] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:52.156771 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-4fdadf78-db8d-43f1-a529-e2a30e166377 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:52.157685 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-c52effb5-c36b-4d10-b6e8-d371427b5e55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '359d9f19d1874fe1ab7c72c55a03d060'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:52.171389 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-c52effb5-c36b-4d10-b6e8-d371427b5e55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '359d9f19d1874fe1ab7c72c55a03d060'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:52.178532 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdadf78-db8d-43f1-a529-e2a30e166377 service cinder] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:52.185043 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9fb6b3-e18e-400a-915c-972051b7e2e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:52.185771 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9fb6b3-e18e-400a-915c-972051b7e2e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:52.186073 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9fb6b3-e18e-400a-915c-972051b7e2e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:52.186373 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9fb6b3-e18e-400a-915c-972051b7e2e2 admin admin] PATH_INFO: `/v3/users/2ce05e1ed79241cbb0a85b0707598186` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:52.187675 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9fb6b3-e18e-400a-915c-972051b7e2e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ce05e1ed79241cbb0a85b0707598186)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:52.189817 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9fb6b3-e18e-400a-915c-972051b7e2e2 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:52.190087 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-c52effb5-c36b-4d10-b6e8-d371427b5e55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '359d9f19d1874fe1ab7c72c55a03d060'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:52.190807 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-c52effb5-c36b-4d10-b6e8-d371427b5e55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '359d9f19d1874fe1ab7c72c55a03d060'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:52.191484 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-c52effb5-c36b-4d10-b6e8-d371427b5e55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '359d9f19d1874fe1ab7c72c55a03d060'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:52.210435 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 952/1914] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 10 10:03:51 2022] DELETE /identity/v3/users/359d9f19d1874fe1ab7c72c55a03d060 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:03:52.215137 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c41b80-d5be-4a93-a606-1e386a24214d None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:52.215497 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c41b80-d5be-4a93-a606-1e386a24214d None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:52.215843 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c41b80-d5be-4a93-a606-1e386a24214d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:52.237348 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-e5c41b80-d5be-4a93-a606-1e386a24214d None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:03:52.238732 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-e5c41b80-d5be-4a93-a606-1e386a24214d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:52.244740 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-0c9fb6b3-e18e-400a-915c-972051b7e2e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ce05e1ed79241cbb0a85b0707598186'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:52.254871 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-0c9fb6b3-e18e-400a-915c-972051b7e2e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ce05e1ed79241cbb0a85b0707598186'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:52.255614 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-0c9fb6b3-e18e-400a-915c-972051b7e2e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ce05e1ed79241cbb0a85b0707598186'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:52.256225 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-0c9fb6b3-e18e-400a-915c-972051b7e2e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ce05e1ed79241cbb0a85b0707598186'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:52.264215 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-0c9fb6b3-e18e-400a-915c-972051b7e2e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ce05e1ed79241cbb0a85b0707598186'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:52.274854 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:52.285710 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 963/1915] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 10 10:03:52 2022] DELETE /identity/v3/users/2ce05e1ed79241cbb0a85b0707598186 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 10:03:52.290287 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eb424a-f161-4c8b-810e-4c2d2d61aaa1 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:52.291068 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eb424a-f161-4c8b-810e-4c2d2d61aaa1 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:52.291651 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eb424a-f161-4c8b-810e-4c2d2d61aaa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:52.311989 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 953/1916] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:03:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:03:52.317155 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-64eb424a-f161-4c8b-810e-4c2d2d61aaa1 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:03:52.318581 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-64eb424a-f161-4c8b-810e-4c2d2d61aaa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:52.322915 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c41b80-d5be-4a93-a606-1e386a24214d None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:52.324553 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-e5c41b80-d5be-4a93-a606-1e386a24214d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:52.349343 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:52.416246 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 964/1917] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:03:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 10:03:52.426434 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eb424a-f161-4c8b-810e-4c2d2d61aaa1 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:52.428166 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-64eb424a-f161-4c8b-810e-4c2d2d61aaa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:52.436442 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c41b80-d5be-4a93-a606-1e386a24214d None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:52.531059 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eb424a-f161-4c8b-810e-4c2d2d61aaa1 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:52.533094 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3271b4c7-f2ae-428a-945f-fc7402108034 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4294c170df354fe892831281acd4ea7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:52.534239 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3271b4c7-f2ae-428a-945f-fc7402108034 service neutron] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:52.534778 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3271b4c7-f2ae-428a-945f-fc7402108034 service neutron] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:52.535057 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3271b4c7-f2ae-428a-945f-fc7402108034 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:52.535948 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84c5e00-5d22-41e4-a143-d76bb566d9e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4294c170df354fe892831281acd4ea7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:52.536677 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84c5e00-5d22-41e4-a143-d76bb566d9e7 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:52.537015 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84c5e00-5d22-41e4-a143-d76bb566d9e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:52.537385 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84c5e00-5d22-41e4-a143-d76bb566d9e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:52.547138 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3271b4c7-f2ae-428a-945f-fc7402108034 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:52.548153 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84c5e00-5d22-41e4-a143-d76bb566d9e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:52.548775 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3271b4c7-f2ae-428a-945f-fc7402108034 service neutron] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:52.549777 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84c5e00-5d22-41e4-a143-d76bb566d9e7 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:52.561501 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 954/1918] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:03:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 10:03:52.564582 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 965/1919] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:03:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 10:03:53.091166 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3271b4c7-f2ae-428a-945f-fc7402108034 service neutron] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:53.092640 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-3271b4c7-f2ae-428a-945f-fc7402108034 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:53.108481 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84c5e00-5d22-41e4-a143-d76bb566d9e7 service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:53.110313 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-c84c5e00-5d22-41e4-a143-d76bb566d9e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:53.118118 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3271b4c7-f2ae-428a-945f-fc7402108034 service neutron] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:53.124246 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7593285e-abb7-46a0-aad9-661dd99ae83c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:53.125750 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7593285e-abb7-46a0-aad9-661dd99ae83c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:53.126216 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7593285e-abb7-46a0-aad9-661dd99ae83c admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:53.126677 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7593285e-abb7-46a0-aad9-661dd99ae83c admin admin] PATH_INFO: `/v3/projects/bb5a6f9ff36c4959a1cb16345f36bb6a` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:53.127320 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84c5e00-5d22-41e4-a143-d76bb566d9e7 service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:53.128758 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7593285e-abb7-46a0-aad9-661dd99ae83c admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb5a6f9ff36c4959a1cb16345f36bb6a)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:53.134160 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7593285e-abb7-46a0-aad9-661dd99ae83c admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:53.136415 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6017b4b1-e177-4998-a559-322541ee8c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:53.137646 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6017b4b1-e177-4998-a559-322541ee8c0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:53.137936 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6017b4b1-e177-4998-a559-322541ee8c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:53.138208 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6017b4b1-e177-4998-a559-322541ee8c0f admin admin] PATH_INFO: `/v3/projects/8deada1671904d71a40c4b1399b53105` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:53.139563 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6017b4b1-e177-4998-a559-322541ee8c0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8deada1671904d71a40c4b1399b53105)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:53.143099 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6017b4b1-e177-4998-a559-322541ee8c0f admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:53.209694 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-6017b4b1-e177-4998-a559-322541ee8c0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8deada1671904d71a40c4b1399b53105', 'request_id': 'req-6017b4b1-e177-4998-a559-322541ee8c0f'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:53.218486 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-6017b4b1-e177-4998-a559-322541ee8c0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8deada1671904d71a40c4b1399b53105', 'request_id': 'req-6017b4b1-e177-4998-a559-322541ee8c0f'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:53.222168 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-7593285e-abb7-46a0-aad9-661dd99ae83c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb5a6f9ff36c4959a1cb16345f36bb6a', 'request_id': 'req-7593285e-abb7-46a0-aad9-661dd99ae83c'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:53.227756 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-6017b4b1-e177-4998-a559-322541ee8c0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8deada1671904d71a40c4b1399b53105', 'request_id': 'req-6017b4b1-e177-4998-a559-322541ee8c0f'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:53.229878 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-7593285e-abb7-46a0-aad9-661dd99ae83c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb5a6f9ff36c4959a1cb16345f36bb6a', 'request_id': 'req-7593285e-abb7-46a0-aad9-661dd99ae83c'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:53.241307 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-7593285e-abb7-46a0-aad9-661dd99ae83c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb5a6f9ff36c4959a1cb16345f36bb6a', 'request_id': 'req-7593285e-abb7-46a0-aad9-661dd99ae83c'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:53.241488 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-6017b4b1-e177-4998-a559-322541ee8c0f admin admin] The token cache is being invalidate because project 8deada1671904d71a40c4b1399b53105 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 10:03:53.241727 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-6017b4b1-e177-4998-a559-322541ee8c0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:53.242630 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-6017b4b1-e177-4998-a559-322541ee8c0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:53.244482 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 966/1920] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 10 10:03:53 2022] DELETE /identity/v3/projects/8deada1671904d71a40c4b1399b53105 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:03:53.249464 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6017b4b1-e177-4998-a559-322541ee8c0f admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:53.250940 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-6017b4b1-e177-4998-a559-322541ee8c0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:53.266531 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-7593285e-abb7-46a0-aad9-661dd99ae83c admin admin] The token cache is being invalidate because project bb5a6f9ff36c4959a1cb16345f36bb6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 10:03:53.267113 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-7593285e-abb7-46a0-aad9-661dd99ae83c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:53.268106 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-7593285e-abb7-46a0-aad9-661dd99ae83c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:53.270421 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 955/1921] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 10 10:03:53 2022] DELETE /identity/v3/projects/bb5a6f9ff36c4959a1cb16345f36bb6a => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:03:53.274814 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7593285e-abb7-46a0-aad9-661dd99ae83c admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:53.278717 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-7593285e-abb7-46a0-aad9-661dd99ae83c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:53.283457 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:53.339123 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:53.363827 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6017b4b1-e177-4998-a559-322541ee8c0f admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:53.370356 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7593285e-abb7-46a0-aad9-661dd99ae83c admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:53.372663 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f17ec8-fd02-4f23-a04e-01ffd746b5f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:53.373340 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f17ec8-fd02-4f23-a04e-01ffd746b5f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:53.373620 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f17ec8-fd02-4f23-a04e-01ffd746b5f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:53.373898 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f17ec8-fd02-4f23-a04e-01ffd746b5f7 admin admin] PATH_INFO: `/v3/users/6b816b99c0794ca9b672f0761ff6f970` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:53.375062 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f17ec8-fd02-4f23-a04e-01ffd746b5f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b816b99c0794ca9b672f0761ff6f970)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:53.376875 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d87602-0b1a-45bc-9fc8-b6b396f960f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:53.377012 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f17ec8-fd02-4f23-a04e-01ffd746b5f7 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:53.377817 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d87602-0b1a-45bc-9fc8-b6b396f960f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:53.378219 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d87602-0b1a-45bc-9fc8-b6b396f960f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:53.378596 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d87602-0b1a-45bc-9fc8-b6b396f960f5 admin admin] PATH_INFO: `/v3/users/eb8ba0d4390443e68e0296a465134da5` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:53.380754 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d87602-0b1a-45bc-9fc8-b6b396f960f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb8ba0d4390443e68e0296a465134da5)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:53.383671 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d87602-0b1a-45bc-9fc8-b6b396f960f5 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:53.443649 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-b6f17ec8-fd02-4f23-a04e-01ffd746b5f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b816b99c0794ca9b672f0761ff6f970'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:53.454120 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-51d87602-0b1a-45bc-9fc8-b6b396f960f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb8ba0d4390443e68e0296a465134da5'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:53.455285 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-b6f17ec8-fd02-4f23-a04e-01ffd746b5f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b816b99c0794ca9b672f0761ff6f970'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:53.456196 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-b6f17ec8-fd02-4f23-a04e-01ffd746b5f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b816b99c0794ca9b672f0761ff6f970'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:53.457232 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-b6f17ec8-fd02-4f23-a04e-01ffd746b5f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b816b99c0794ca9b672f0761ff6f970'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:53.463170 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-51d87602-0b1a-45bc-9fc8-b6b396f960f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb8ba0d4390443e68e0296a465134da5'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:53.467262 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-b6f17ec8-fd02-4f23-a04e-01ffd746b5f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b816b99c0794ca9b672f0761ff6f970'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:53.473218 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-51d87602-0b1a-45bc-9fc8-b6b396f960f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb8ba0d4390443e68e0296a465134da5'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:53.474185 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-51d87602-0b1a-45bc-9fc8-b6b396f960f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb8ba0d4390443e68e0296a465134da5'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:53.474876 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-51d87602-0b1a-45bc-9fc8-b6b396f960f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb8ba0d4390443e68e0296a465134da5'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:53.490007 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 967/1922] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 10 10:03:53 2022] DELETE /identity/v3/users/6b816b99c0794ca9b672f0761ff6f970 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:03:53.494318 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f17ec8-fd02-4f23-a04e-01ffd746b5f7 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:53.495748 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-b6f17ec8-fd02-4f23-a04e-01ffd746b5f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:53.495923 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 956/1923] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 10 10:03:53 2022] DELETE /identity/v3/users/eb8ba0d4390443e68e0296a465134da5 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:03:53.584854 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f17ec8-fd02-4f23-a04e-01ffd746b5f7 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:53.634587 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30271b79-5ad1-4bf7-8781-ec8f75841de6 None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:53.634941 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30271b79-5ad1-4bf7-8781-ec8f75841de6 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:53.635972 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30271b79-5ad1-4bf7-8781-ec8f75841de6 None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:53.638052 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 957/1924] 10.222.0.27 () {54 vars in 921 bytes} [Wed Aug 10 10:03:53 2022] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:03:53.662685 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3774269-81e0-4854-9719-ad5d4e75c08a None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:53.663843 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3774269-81e0-4854-9719-ad5d4e75c08a None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:53.664510 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3774269-81e0-4854-9719-ad5d4e75c08a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:53.688824 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:53.719020 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1608307-b955-44ef-ae49-e899695782ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:53.719346 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-c3774269-81e0-4854-9719-ad5d4e75c08a None None] MFA Rules not processed for user `dd8580888cba41a88566da4540b1130c`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:03:53.719677 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1608307-b955-44ef-ae49-e899695782ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:53.719959 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1608307-b955-44ef-ae49-e899695782ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:53.720232 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1608307-b955-44ef-ae49-e899695782ce admin admin] PATH_INFO: `/v3/users/9d65897948d04664a794c9e647e0b361` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:53.720601 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-c3774269-81e0-4854-9719-ad5d4e75c08a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:53.725378 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1608307-b955-44ef-ae49-e899695782ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d65897948d04664a794c9e647e0b361)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:53.727568 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1608307-b955-44ef-ae49-e899695782ce admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:53.865458 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-c1608307-b955-44ef-ae49-e899695782ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d65897948d04664a794c9e647e0b361'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:53.884597 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-c1608307-b955-44ef-ae49-e899695782ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d65897948d04664a794c9e647e0b361'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:53.885281 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-c1608307-b955-44ef-ae49-e899695782ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d65897948d04664a794c9e647e0b361'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:53.886032 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-c1608307-b955-44ef-ae49-e899695782ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d65897948d04664a794c9e647e0b361'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:53.894203 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-c1608307-b955-44ef-ae49-e899695782ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d65897948d04664a794c9e647e0b361'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:53.907132 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 958/1925] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Aug 10 10:03:53 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:03:53.937739 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 968/1926] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 10 10:03:53 2022] DELETE /identity/v3/users/9d65897948d04664a794c9e647e0b361 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:03:53.939542 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ccbe3-f193-462b-8a60-9f508f9153a3 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:53.940038 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ccbe3-f193-462b-8a60-9f508f9153a3 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:53.940345 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ccbe3-f193-462b-8a60-9f508f9153a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:53.956193 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1608307-b955-44ef-ae49-e899695782ce admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:53.958140 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-c1608307-b955-44ef-ae49-e899695782ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:53.972611 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-199ccbe3-f193-462b-8a60-9f508f9153a3 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:03:53.981082 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-199ccbe3-f193-462b-8a60-9f508f9153a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:54.076997 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1608307-b955-44ef-ae49-e899695782ce admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:54.103185 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:54.120194 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 959/1927] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:03:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 10:03:54.132801 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705ca065-a7d4-428c-9ee2-23e1417c0689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:54.134109 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705ca065-a7d4-428c-9ee2-23e1417c0689 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:54.134396 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705ca065-a7d4-428c-9ee2-23e1417c0689 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:54.134673 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705ca065-a7d4-428c-9ee2-23e1417c0689 admin admin] PATH_INFO: `/v3/projects/b698774575084a3a91092a561e8386d4` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:54.138709 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705ca065-a7d4-428c-9ee2-23e1417c0689 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b698774575084a3a91092a561e8386d4)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:54.141844 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705ca065-a7d4-428c-9ee2-23e1417c0689 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:54.152405 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199ccbe3-f193-462b-8a60-9f508f9153a3 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:54.156554 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-199ccbe3-f193-462b-8a60-9f508f9153a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:54.248456 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-705ca065-a7d4-428c-9ee2-23e1417c0689 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b698774575084a3a91092a561e8386d4', 'request_id': 'req-705ca065-a7d4-428c-9ee2-23e1417c0689'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:54.259502 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-705ca065-a7d4-428c-9ee2-23e1417c0689 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b698774575084a3a91092a561e8386d4', 'request_id': 'req-705ca065-a7d4-428c-9ee2-23e1417c0689'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:54.261373 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199ccbe3-f193-462b-8a60-9f508f9153a3 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:54.281491 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-705ca065-a7d4-428c-9ee2-23e1417c0689 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b698774575084a3a91092a561e8386d4', 'request_id': 'req-705ca065-a7d4-428c-9ee2-23e1417c0689'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:54.284172 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:54.296258 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-705ca065-a7d4-428c-9ee2-23e1417c0689 admin admin] The token cache is being invalidate because project b698774575084a3a91092a561e8386d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 10:03:54.296607 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-705ca065-a7d4-428c-9ee2-23e1417c0689 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:54.297362 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-705ca065-a7d4-428c-9ee2-23e1417c0689 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:54.298906 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 969/1928] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 10 10:03:53 2022] DELETE /identity/v3/projects/b698774575084a3a91092a561e8386d4 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:03:54.304347 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705ca065-a7d4-428c-9ee2-23e1417c0689 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:54.307654 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-705ca065-a7d4-428c-9ee2-23e1417c0689 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:54.319899 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ebde26-efc3-45fe-8a1e-254f4f700dde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4294c170df354fe892831281acd4ea7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:54.320605 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ebde26-efc3-45fe-8a1e-254f4f700dde service neutron] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:54.320906 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ebde26-efc3-45fe-8a1e-254f4f700dde service neutron] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:54.321272 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ebde26-efc3-45fe-8a1e-254f4f700dde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:54.323333 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-f0ebde26-efc3-45fe-8a1e-254f4f700dde service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:54.398693 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ebde26-efc3-45fe-8a1e-254f4f700dde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:54.400310 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ebde26-efc3-45fe-8a1e-254f4f700dde service neutron] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:54.412102 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 960/1929] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:03:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:03:54.413430 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8d4295-92a6-4ce1-a097-fd3332231530 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:54.413721 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8d4295-92a6-4ce1-a097-fd3332231530 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:54.413998 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8d4295-92a6-4ce1-a097-fd3332231530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:54.425848 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705ca065-a7d4-428c-9ee2-23e1417c0689 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:54.434202 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9089b05f-e9ff-4a90-86c3-f79f2669425f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd8580888cba41a88566da4540b1130c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:54.434835 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9089b05f-e9ff-4a90-86c3-f79f2669425f service nova] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:54.435116 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9089b05f-e9ff-4a90-86c3-f79f2669425f service nova] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:54.435390 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9089b05f-e9ff-4a90-86c3-f79f2669425f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:54.437367 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-9089b05f-e9ff-4a90-86c3-f79f2669425f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:54.437494 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-9b8d4295-92a6-4ce1-a097-fd3332231530 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:03:54.439865 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-9b8d4295-92a6-4ce1-a097-fd3332231530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:54.456569 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9089b05f-e9ff-4a90-86c3-f79f2669425f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:54.457166 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 961/1930] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:03:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:03:54.457166 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8d4295-92a6-4ce1-a097-fd3332231530 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:54.457625 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9089b05f-e9ff-4a90-86c3-f79f2669425f service nova] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:54.458953 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-9b8d4295-92a6-4ce1-a097-fd3332231530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:54.466047 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 970/1931] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:03:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:03:54.467759 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38cf859-f381-44cd-8611-358a72d132c6 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:54.468215 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38cf859-f381-44cd-8611-358a72d132c6 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:54.468686 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38cf859-f381-44cd-8611-358a72d132c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:54.473332 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8d4295-92a6-4ce1-a097-fd3332231530 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:54.479794 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceefed5d-202e-407d-887f-9c7ecc1cf91b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:54.481326 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceefed5d-202e-407d-887f-9c7ecc1cf91b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:54.481959 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceefed5d-202e-407d-887f-9c7ecc1cf91b admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:54.482448 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceefed5d-202e-407d-887f-9c7ecc1cf91b admin admin] PATH_INFO: `/v3/projects/48dc0e31c2074db2a2b1469a95fa66da` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:54.484110 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceefed5d-202e-407d-887f-9c7ecc1cf91b admin admin] RBAC: Authorizing `identity:delete_project(project_id=48dc0e31c2074db2a2b1469a95fa66da)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:54.486556 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceefed5d-202e-407d-887f-9c7ecc1cf91b admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:54.491594 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-e38cf859-f381-44cd-8611-358a72d132c6 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:03:54.493313 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-e38cf859-f381-44cd-8611-358a72d132c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:54.504072 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 971/1932] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:03:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:03:54.508718 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38cf859-f381-44cd-8611-358a72d132c6 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:54.534497 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38cf859-f381-44cd-8611-358a72d132c6 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:54.547717 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb599573-c355-4f4d-853f-d5a0d8333b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:54.549866 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb599573-c355-4f4d-853f-d5a0d8333b17 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:54.550249 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb599573-c355-4f4d-853f-d5a0d8333b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:54.550616 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb599573-c355-4f4d-853f-d5a0d8333b17 admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:54.551958 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb599573-c355-4f4d-853f-d5a0d8333b17 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:03:54.552431 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb599573-c355-4f4d-853f-d5a0d8333b17 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:54.556516 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb599573-c355-4f4d-853f-d5a0d8333b17 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:54.581218 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 972/1933] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 10 10:03:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 10:03:54.582266 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb599573-c355-4f4d-853f-d5a0d8333b17 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:54.595852 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb599573-c355-4f4d-853f-d5a0d8333b17 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:54.596684 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-ceefed5d-202e-407d-887f-9c7ecc1cf91b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48dc0e31c2074db2a2b1469a95fa66da', 'request_id': 'req-ceefed5d-202e-407d-887f-9c7ecc1cf91b'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:54.599631 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:54.615526 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-ceefed5d-202e-407d-887f-9c7ecc1cf91b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48dc0e31c2074db2a2b1469a95fa66da', 'request_id': 'req-ceefed5d-202e-407d-887f-9c7ecc1cf91b'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:54.660374 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-ceefed5d-202e-407d-887f-9c7ecc1cf91b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48dc0e31c2074db2a2b1469a95fa66da', 'request_id': 'req-ceefed5d-202e-407d-887f-9c7ecc1cf91b'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:54.694686 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58797406-39ec-47b2-a755-4f37716ff422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:54.695596 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58797406-39ec-47b2-a755-4f37716ff422 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:54.696891 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58797406-39ec-47b2-a755-4f37716ff422 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:54.697579 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58797406-39ec-47b2-a755-4f37716ff422 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:54.700447 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58797406-39ec-47b2-a755-4f37716ff422 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:54.705756 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58797406-39ec-47b2-a755-4f37716ff422 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:54.712501 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-ceefed5d-202e-407d-887f-9c7ecc1cf91b admin admin] The token cache is being invalidate because project 48dc0e31c2074db2a2b1469a95fa66da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 10:03:54.712501 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-ceefed5d-202e-407d-887f-9c7ecc1cf91b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:54.727257 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-ceefed5d-202e-407d-887f-9c7ecc1cf91b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:54.733406 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 962/1934] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 10 10:03:54 2022] DELETE /identity/v3/projects/48dc0e31c2074db2a2b1469a95fa66da => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:03:54.744670 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29648651-0b2f-4cd6-b964-4ec3517f77b4 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:54.746097 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29648651-0b2f-4cd6-b964-4ec3517f77b4 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:54.746628 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29648651-0b2f-4cd6-b964-4ec3517f77b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:54.806267 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 973/1935] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 10 10:03:54 2022] POST /identity/v3/projects => generated 377 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:03:54.810057 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-29648651-0b2f-4cd6-b964-4ec3517f77b4 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:03:54.811369 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58797406-39ec-47b2-a755-4f37716ff422 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:54.812458 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-29648651-0b2f-4cd6-b964-4ec3517f77b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:54.813329 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-58797406-39ec-47b2-a755-4f37716ff422 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:54.897167 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:54.917224 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 963/1936] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:03:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:03:54.918465 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29648651-0b2f-4cd6-b964-4ec3517f77b4 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:54.919905 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-29648651-0b2f-4cd6-b964-4ec3517f77b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:54.922195 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58797406-39ec-47b2-a755-4f37716ff422 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:54.927115 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f145ac66-fbe6-428d-aa57-1328266fe36d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:54.927837 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f145ac66-fbe6-428d-aa57-1328266fe36d admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:54.928178 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f145ac66-fbe6-428d-aa57-1328266fe36d admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:54.928518 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f145ac66-fbe6-428d-aa57-1328266fe36d admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:54.929492 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f145ac66-fbe6-428d-aa57-1328266fe36d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:54.932088 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f145ac66-fbe6-428d-aa57-1328266fe36d admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:54.936533 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29648651-0b2f-4cd6-b964-4ec3517f77b4 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:54.947798 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7e2b47-16f3-4429-8c04-e98804f33797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:54.948492 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7e2b47-16f3-4429-8c04-e98804f33797 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:54.948776 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7e2b47-16f3-4429-8c04-e98804f33797 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:54.949124 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7e2b47-16f3-4429-8c04-e98804f33797 admin admin] PATH_INFO: `/v3/projects/78de4387327f49b78814aec3fecae381` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:54.950239 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7e2b47-16f3-4429-8c04-e98804f33797 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78de4387327f49b78814aec3fecae381)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:54.952252 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7e2b47-16f3-4429-8c04-e98804f33797 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:54.962205 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 974/1937] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 10 10:03:54 2022] POST /identity/v3/users => generated 289 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:03:54.963853 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407ad45b-6ddd-417a-a378-872d0ce86e1f None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:54.964285 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407ad45b-6ddd-417a-a378-872d0ce86e1f None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:54.964557 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407ad45b-6ddd-417a-a378-872d0ce86e1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:54.987025 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-407ad45b-6ddd-417a-a378-872d0ce86e1f None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:03:54.988243 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-407ad45b-6ddd-417a-a378-872d0ce86e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:54.998116 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 975/1938] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:03:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:03:54.998872 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407ad45b-6ddd-417a-a378-872d0ce86e1f None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:55.008607 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407ad45b-6ddd-417a-a378-872d0ce86e1f None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:55.009585 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-1e7e2b47-16f3-4429-8c04-e98804f33797 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78de4387327f49b78814aec3fecae381', 'request_id': 'req-1e7e2b47-16f3-4429-8c04-e98804f33797'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:55.016382 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-1e7e2b47-16f3-4429-8c04-e98804f33797 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78de4387327f49b78814aec3fecae381', 'request_id': 'req-1e7e2b47-16f3-4429-8c04-e98804f33797'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:55.025709 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-1e7e2b47-16f3-4429-8c04-e98804f33797 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78de4387327f49b78814aec3fecae381', 'request_id': 'req-1e7e2b47-16f3-4429-8c04-e98804f33797'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:55.038656 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-1e7e2b47-16f3-4429-8c04-e98804f33797 admin admin] The token cache is being invalidate because project 78de4387327f49b78814aec3fecae381 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 10:03:55.038843 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-1e7e2b47-16f3-4429-8c04-e98804f33797 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:55.042046 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-1e7e2b47-16f3-4429-8c04-e98804f33797 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:55.043741 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 964/1939] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 10 10:03:54 2022] DELETE /identity/v3/projects/78de4387327f49b78814aec3fecae381 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:03:55.044477 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7e2b47-16f3-4429-8c04-e98804f33797 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:55.045870 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-1e7e2b47-16f3-4429-8c04-e98804f33797 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:55.075478 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca3bea6-42c3-4568-a3da-1d37e25bea37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:55.076475 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca3bea6-42c3-4568-a3da-1d37e25bea37 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:55.076676 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca3bea6-42c3-4568-a3da-1d37e25bea37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:55.077025 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca3bea6-42c3-4568-a3da-1d37e25bea37 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:55.077746 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca3bea6-42c3-4568-a3da-1d37e25bea37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:55.079531 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca3bea6-42c3-4568-a3da-1d37e25bea37 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:55.091605 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 976/1940] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:03:54 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:03:55.092119 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca3bea6-42c3-4568-a3da-1d37e25bea37 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:55.094583 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-9ca3bea6-42c3-4568-a3da-1d37e25bea37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:55.114673 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca3bea6-42c3-4568-a3da-1d37e25bea37 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:55.119614 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a63a8d-de06-4888-a45f-1f7e73f4e118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:55.120293 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a63a8d-de06-4888-a45f-1f7e73f4e118 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:55.120574 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a63a8d-de06-4888-a45f-1f7e73f4e118 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:55.120850 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a63a8d-de06-4888-a45f-1f7e73f4e118 admin admin] PATH_INFO: `/v3/users/90b659e270594c4ba4d6a89f686f7145` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:55.122068 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a63a8d-de06-4888-a45f-1f7e73f4e118 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90b659e270594c4ba4d6a89f686f7145)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:55.124186 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a63a8d-de06-4888-a45f-1f7e73f4e118 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:55.129670 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7e2b47-16f3-4429-8c04-e98804f33797 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:55.134847 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d42ab44-3a6e-4489-bc64-29e52a15d9a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:55.135460 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d42ab44-3a6e-4489-bc64-29e52a15d9a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:55.135824 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d42ab44-3a6e-4489-bc64-29e52a15d9a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:55.136100 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d42ab44-3a6e-4489-bc64-29e52a15d9a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:55.136788 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d42ab44-3a6e-4489-bc64-29e52a15d9a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:03:55.137115 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d42ab44-3a6e-4489-bc64-29e52a15d9a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:55.138740 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d42ab44-3a6e-4489-bc64-29e52a15d9a9 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:55.141863 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:55.153552 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 965/1941] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 10 10:03:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:03:55.157680 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d42ab44-3a6e-4489-bc64-29e52a15d9a9 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:55.157680 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-4d42ab44-3a6e-4489-bc64-29e52a15d9a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:55.170100 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d42ab44-3a6e-4489-bc64-29e52a15d9a9 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:55.174742 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dcf865-54b9-45c7-94bc-167e3fc6fb5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:55.175345 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dcf865-54b9-45c7-94bc-167e3fc6fb5d admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:55.175621 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dcf865-54b9-45c7-94bc-167e3fc6fb5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:55.175922 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dcf865-54b9-45c7-94bc-167e3fc6fb5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:55.176557 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dcf865-54b9-45c7-94bc-167e3fc6fb5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:55.178201 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dcf865-54b9-45c7-94bc-167e3fc6fb5d admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:55.182387 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-70a63a8d-de06-4888-a45f-1f7e73f4e118 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90b659e270594c4ba4d6a89f686f7145'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:55.189280 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 966/1942] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:03:55 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:03:55.190486 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dcf865-54b9-45c7-94bc-167e3fc6fb5d admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:55.194953 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-70a63a8d-de06-4888-a45f-1f7e73f4e118 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90b659e270594c4ba4d6a89f686f7145'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:55.195653 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-70a63a8d-de06-4888-a45f-1f7e73f4e118 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90b659e270594c4ba4d6a89f686f7145'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:55.196384 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-70a63a8d-de06-4888-a45f-1f7e73f4e118 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90b659e270594c4ba4d6a89f686f7145'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:55.200504 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dcf865-54b9-45c7-94bc-167e3fc6fb5d admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:55.204410 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-70a63a8d-de06-4888-a45f-1f7e73f4e118 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90b659e270594c4ba4d6a89f686f7145'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:55.205580 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1cbe96-a74f-4525-949a-8e4779dc96d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:55.206178 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1cbe96-a74f-4525-949a-8e4779dc96d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:55.206472 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1cbe96-a74f-4525-949a-8e4779dc96d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:55.206753 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1cbe96-a74f-4525-949a-8e4779dc96d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:55.207382 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1cbe96-a74f-4525-949a-8e4779dc96d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:55.209324 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1cbe96-a74f-4525-949a-8e4779dc96d1 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:55.233362 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 977/1943] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 10 10:03:55 2022] DELETE /identity/v3/users/90b659e270594c4ba4d6a89f686f7145 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:03:55.234252 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a63a8d-de06-4888-a45f-1f7e73f4e118 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:55.237042 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-70a63a8d-de06-4888-a45f-1f7e73f4e118 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:55.264352 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 967/1944] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 10 10:03:55 2022] POST /identity/v3/projects => generated 385 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:03:55.268857 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1cbe96-a74f-4525-949a-8e4779dc96d1 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:55.271129 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-3a1cbe96-a74f-4525-949a-8e4779dc96d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:55.300430 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:55.335712 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a63a8d-de06-4888-a45f-1f7e73f4e118 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:55.414882 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1cbe96-a74f-4525-949a-8e4779dc96d1 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:55.420797 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30c42e6-e919-4972-afa4-c06c6ee6593b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:55.421627 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30c42e6-e919-4972-afa4-c06c6ee6593b admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:55.421919 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30c42e6-e919-4972-afa4-c06c6ee6593b admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:55.422186 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30c42e6-e919-4972-afa4-c06c6ee6593b admin admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:55.422837 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30c42e6-e919-4972-afa4-c06c6ee6593b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:55.425605 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30c42e6-e919-4972-afa4-c06c6ee6593b admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:55.447594 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24426b7-e701-418f-a98d-ba9b97b72fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:55.448304 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24426b7-e701-418f-a98d-ba9b97b72fea admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:55.448581 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24426b7-e701-418f-a98d-ba9b97b72fea admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:55.448897 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24426b7-e701-418f-a98d-ba9b97b72fea admin admin] PATH_INFO: `/v3/projects/3f0c9fa63f5e4519be1e4665269617e6/users/5c3130ab850d4586859b0ca7fd1516c6/roles/8daabcb6b7394e39b06a3453e33e32db` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:55.474263 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 968/1945] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 10 10:03:55 2022] POST /identity/v3/users => generated 293 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 10:03:55.476665 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24426b7-e701-418f-a98d-ba9b97b72fea admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f0c9fa63f5e4519be1e4665269617e6, user_id=5c3130ab850d4586859b0ca7fd1516c6, role_id=8daabcb6b7394e39b06a3453e33e32db)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:55.480243 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24426b7-e701-418f-a98d-ba9b97b72fea admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:55.482145 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30c42e6-e919-4972-afa4-c06c6ee6593b admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:55.498124 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30c42e6-e919-4972-afa4-c06c6ee6593b admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:55.505399 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 978/1946] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:03:55 2022] PUT /identity/v3/projects/3f0c9fa63f5e4519be1e4665269617e6/users/5c3130ab850d4586859b0ca7fd1516c6/roles/8daabcb6b7394e39b06a3453e33e32db => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:03:55.515558 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1fce7e-4007-4111-a47c-3b5a37803e32 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:55.515946 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1fce7e-4007-4111-a47c-3b5a37803e32 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:55.516221 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1fce7e-4007-4111-a47c-3b5a37803e32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:55.555035 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-4f1fce7e-4007-4111-a47c-3b5a37803e32 None None] MFA Rules not processed for user `5c3130ab850d4586859b0ca7fd1516c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:03:55.557680 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-4f1fce7e-4007-4111-a47c-3b5a37803e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:55.602101 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7920bfb2-94c6-4251-85a3-032995a4bced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:55.602846 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7920bfb2-94c6-4251-85a3-032995a4bced admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:55.603198 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7920bfb2-94c6-4251-85a3-032995a4bced admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:55.603845 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7920bfb2-94c6-4251-85a3-032995a4bced admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:55.605511 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7920bfb2-94c6-4251-85a3-032995a4bced admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:55.607690 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7920bfb2-94c6-4251-85a3-032995a4bced admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:55.624138 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 969/1947] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:03:55 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:03:55.629106 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7920bfb2-94c6-4251-85a3-032995a4bced admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:55.646405 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7920bfb2-94c6-4251-85a3-032995a4bced admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:55.655758 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed12994-fa56-4103-8f63-8c9b305b976b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:55.656541 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed12994-fa56-4103-8f63-8c9b305b976b admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:55.656920 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed12994-fa56-4103-8f63-8c9b305b976b admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:55.657322 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed12994-fa56-4103-8f63-8c9b305b976b admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:55.658130 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed12994-fa56-4103-8f63-8c9b305b976b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:55.659997 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 979/1948] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:03:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:03:55.660867 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed12994-fa56-4103-8f63-8c9b305b976b admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:55.674222 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1fce7e-4007-4111-a47c-3b5a37803e32 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:55.680607 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-4f1fce7e-4007-4111-a47c-3b5a37803e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:55.691802 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 970/1949] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:03:55 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:03:55.693499 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed12994-fa56-4103-8f63-8c9b305b976b admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:55.707457 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed12994-fa56-4103-8f63-8c9b305b976b admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:55.714479 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c68ca3e-3b39-437e-a4ff-809efcc373da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:55.715358 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c68ca3e-3b39-437e-a4ff-809efcc373da admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:55.715954 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c68ca3e-3b39-437e-a4ff-809efcc373da admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:55.716169 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c68ca3e-3b39-437e-a4ff-809efcc373da admin admin] PATH_INFO: `/v3/projects/12c28a5bd27943d0925963c84b4e6d28/users/80dbeefbcc5849b1aaf040f02e5cb350/roles/8daabcb6b7394e39b06a3453e33e32db` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:55.736035 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c68ca3e-3b39-437e-a4ff-809efcc373da admin admin] RBAC: Authorizing `identity:create_grant(project_id=12c28a5bd27943d0925963c84b4e6d28, user_id=80dbeefbcc5849b1aaf040f02e5cb350, role_id=8daabcb6b7394e39b06a3453e33e32db)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:55.739407 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c68ca3e-3b39-437e-a4ff-809efcc373da admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:55.760387 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 971/1950] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:03:55 2022] PUT /identity/v3/projects/12c28a5bd27943d0925963c84b4e6d28/users/80dbeefbcc5849b1aaf040f02e5cb350/roles/8daabcb6b7394e39b06a3453e33e32db => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:03:55.774417 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a40ac2-8633-4a84-918a-148335dccbfa None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:55.774711 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a40ac2-8633-4a84-918a-148335dccbfa None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:55.775325 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a40ac2-8633-4a84-918a-148335dccbfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:55.783330 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:55.814713 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1fce7e-4007-4111-a47c-3b5a37803e32 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:55.837583 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:55.840792 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-83a40ac2-8633-4a84-918a-148335dccbfa None None] MFA Rules not processed for user `80dbeefbcc5849b1aaf040f02e5cb350`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:03:55.842938 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-83a40ac2-8633-4a84-918a-148335dccbfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:55.887012 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d378cf12-4590-4e81-b62f-89f3ef0d7214 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e7f1ec6ad64b978f8817a5d2a73757', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:55.887787 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d378cf12-4590-4e81-b62f-89f3ef0d7214 service glance] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:55.888487 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d378cf12-4590-4e81-b62f-89f3ef0d7214 service glance] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:55.888704 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d378cf12-4590-4e81-b62f-89f3ef0d7214 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:55.956124 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 972/1951] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:03:55 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 10:03:55.961665 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a40ac2-8633-4a84-918a-148335dccbfa None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:55.994307 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d378cf12-4590-4e81-b62f-89f3ef0d7214 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:55.997160 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d378cf12-4590-4e81-b62f-89f3ef0d7214 service glance] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:56.009696 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 980/1952] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:03:55 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 10:03:56.047012 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d378cf12-4590-4e81-b62f-89f3ef0d7214 service glance] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:56.049116 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-d378cf12-4590-4e81-b62f-89f3ef0d7214 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:56.065693 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d378cf12-4590-4e81-b62f-89f3ef0d7214 service glance] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:56.071724 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059e46aa-549d-41b2-9cbc-c83d87599c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:56.072742 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e46aa-549d-41b2-9cbc-c83d87599c9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:56.073054 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e46aa-549d-41b2-9cbc-c83d87599c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:56.073370 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e46aa-549d-41b2-9cbc-c83d87599c9c admin admin] PATH_INFO: `/v3/projects/b686025e84c942568681521f175e4ca4` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:56.074827 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059e46aa-549d-41b2-9cbc-c83d87599c9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b686025e84c942568681521f175e4ca4)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:56.075527 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a40ac2-8633-4a84-918a-148335dccbfa None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:56.078116 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059e46aa-549d-41b2-9cbc-c83d87599c9c admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:56.082799 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bba0f1-5773-4b32-b081-b93fd7010570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:56.083596 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bba0f1-5773-4b32-b081-b93fd7010570 admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:56.083730 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bba0f1-5773-4b32-b081-b93fd7010570 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:56.083962 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bba0f1-5773-4b32-b081-b93fd7010570 admin admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:56.084606 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bba0f1-5773-4b32-b081-b93fd7010570 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:56.087160 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bba0f1-5773-4b32-b081-b93fd7010570 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:56.139791 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 973/1953] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 10 10:03:55 2022] POST /identity/v3/projects => generated 385 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:03:56.140786 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bba0f1-5773-4b32-b081-b93fd7010570 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:56.145615 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-059e46aa-549d-41b2-9cbc-c83d87599c9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b686025e84c942568681521f175e4ca4', 'request_id': 'req-059e46aa-549d-41b2-9cbc-c83d87599c9c'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:56.151929 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-059e46aa-549d-41b2-9cbc-c83d87599c9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b686025e84c942568681521f175e4ca4', 'request_id': 'req-059e46aa-549d-41b2-9cbc-c83d87599c9c'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:56.162686 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-059e46aa-549d-41b2-9cbc-c83d87599c9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b686025e84c942568681521f175e4ca4', 'request_id': 'req-059e46aa-549d-41b2-9cbc-c83d87599c9c'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:56.178657 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-059e46aa-549d-41b2-9cbc-c83d87599c9c admin admin] The token cache is being invalidate because project b686025e84c942568681521f175e4ca4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 10:03:56.179307 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-059e46aa-549d-41b2-9cbc-c83d87599c9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:56.179984 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-059e46aa-549d-41b2-9cbc-c83d87599c9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:56.182111 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 981/1954] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 10 10:03:56 2022] DELETE /identity/v3/projects/b686025e84c942568681521f175e4ca4 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 10:03:56.186709 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0177477-c6ab-491b-81f0-53ffa776937b None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:56.187133 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0177477-c6ab-491b-81f0-53ffa776937b None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:56.187414 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0177477-c6ab-491b-81f0-53ffa776937b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:56.207003 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-b0177477-c6ab-491b-81f0-53ffa776937b None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:03:56.208196 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-b0177477-c6ab-491b-81f0-53ffa776937b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:56.211961 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bba0f1-5773-4b32-b081-b93fd7010570 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:56.216208 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 982/1955] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:03:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:03:56.221302 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec36e060-7f0e-49d5-b025-f6010eb2cc6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:56.222062 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec36e060-7f0e-49d5-b025-f6010eb2cc6f admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:56.222411 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec36e060-7f0e-49d5-b025-f6010eb2cc6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:56.222747 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec36e060-7f0e-49d5-b025-f6010eb2cc6f admin admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:56.223544 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec36e060-7f0e-49d5-b025-f6010eb2cc6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:56.225323 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8764cc86-6fe7-4f83-a273-6e816968f369 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:56.225323 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8764cc86-6fe7-4f83-a273-6e816968f369 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:56.225493 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8764cc86-6fe7-4f83-a273-6e816968f369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:56.225665 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec36e060-7f0e-49d5-b025-f6010eb2cc6f admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:56.245936 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-8764cc86-6fe7-4f83-a273-6e816968f369 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:03:56.247383 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-8764cc86-6fe7-4f83-a273-6e816968f369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:56.250733 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 974/1956] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 10 10:03:56 2022] POST /identity/v3/users => generated 293 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:03:56.254912 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec36e060-7f0e-49d5-b025-f6010eb2cc6f admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:56.256458 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-ec36e060-7f0e-49d5-b025-f6010eb2cc6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:56.259185 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 983/1957] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:03:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 10:03:56.263525 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8764cc86-6fe7-4f83-a273-6e816968f369 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:56.270708 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec36e060-7f0e-49d5-b025-f6010eb2cc6f admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:56.272946 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8764cc86-6fe7-4f83-a273-6e816968f369 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:56.275439 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb31c5b-1650-4f36-8256-329fa2717f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:56.275899 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb31c5b-1650-4f36-8256-329fa2717f86 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:56.276191 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb31c5b-1650-4f36-8256-329fa2717f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:56.276491 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb31c5b-1650-4f36-8256-329fa2717f86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:56.277173 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb31c5b-1650-4f36-8256-329fa2717f86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:56.278063 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a1145d-6c57-4ea2-9820-b9beea3739cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:56.278660 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a1145d-6c57-4ea2-9820-b9beea3739cb admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:56.278782 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb31c5b-1650-4f36-8256-329fa2717f86 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:56.278931 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a1145d-6c57-4ea2-9820-b9beea3739cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:56.279397 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a1145d-6c57-4ea2-9820-b9beea3739cb admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:56.280088 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a1145d-6c57-4ea2-9820-b9beea3739cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:03:56.280401 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a1145d-6c57-4ea2-9820-b9beea3739cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:56.282034 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a1145d-6c57-4ea2-9820-b9beea3739cb admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:56.290271 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 975/1958] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:03:56 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:03:56.294181 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb31c5b-1650-4f36-8256-329fa2717f86 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:56.296554 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 984/1959] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 10 10:03:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:03:56.301364 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a1145d-6c57-4ea2-9820-b9beea3739cb admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:56.305213 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb31c5b-1650-4f36-8256-329fa2717f86 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:56.309171 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:56.310427 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2e2faf-173d-4d6e-9a47-3b39076b415e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:56.310965 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2e2faf-173d-4d6e-9a47-3b39076b415e admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:56.311399 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2e2faf-173d-4d6e-9a47-3b39076b415e admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:56.311697 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2e2faf-173d-4d6e-9a47-3b39076b415e admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:56.312526 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2e2faf-173d-4d6e-9a47-3b39076b415e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:56.313703 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a1145d-6c57-4ea2-9820-b9beea3739cb admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:56.314107 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2e2faf-173d-4d6e-9a47-3b39076b415e admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:56.318082 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:56.320325 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50848b69-5636-4ed3-978b-a78b0af9ffe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:56.321373 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50848b69-5636-4ed3-978b-a78b0af9ffe8 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:56.321842 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50848b69-5636-4ed3-978b-a78b0af9ffe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:56.322128 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50848b69-5636-4ed3-978b-a78b0af9ffe8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:56.322811 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50848b69-5636-4ed3-978b-a78b0af9ffe8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:56.324857 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50848b69-5636-4ed3-978b-a78b0af9ffe8 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:56.330368 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 976/1960] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:03:56 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:03:56.334709 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2e2faf-173d-4d6e-9a47-3b39076b415e admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:56.346710 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2e2faf-173d-4d6e-9a47-3b39076b415e admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:56.352068 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad53c140-2ed5-444e-b1b9-c1fc62edc2a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:56.352962 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad53c140-2ed5-444e-b1b9-c1fc62edc2a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:56.353443 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad53c140-2ed5-444e-b1b9-c1fc62edc2a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:56.354288 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad53c140-2ed5-444e-b1b9-c1fc62edc2a8 admin admin] PATH_INFO: `/v3/projects/c81f5f013a3e462c81d6cc30aa0775c3/users/125a918c795a4a9f8d6516af94ce92b0/roles/8daabcb6b7394e39b06a3453e33e32db` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:56.365027 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 985/1961] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 10 10:03:56 2022] POST /identity/v3/projects => generated 381 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:03:56.369627 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50848b69-5636-4ed3-978b-a78b0af9ffe8 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:56.378219 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad53c140-2ed5-444e-b1b9-c1fc62edc2a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c81f5f013a3e462c81d6cc30aa0775c3, user_id=125a918c795a4a9f8d6516af94ce92b0, role_id=8daabcb6b7394e39b06a3453e33e32db)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:56.381251 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad53c140-2ed5-444e-b1b9-c1fc62edc2a8 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:56.400299 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 977/1962] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:03:56 2022] PUT /identity/v3/projects/c81f5f013a3e462c81d6cc30aa0775c3/users/125a918c795a4a9f8d6516af94ce92b0/roles/8daabcb6b7394e39b06a3453e33e32db => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 10:03:56.410426 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312ace96-9564-4202-aac8-357bc430328b None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:56.410814 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312ace96-9564-4202-aac8-357bc430328b None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:56.411092 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312ace96-9564-4202-aac8-357bc430328b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:56.441234 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-312ace96-9564-4202-aac8-357bc430328b None None] MFA Rules not processed for user `125a918c795a4a9f8d6516af94ce92b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:03:56.442469 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-312ace96-9564-4202-aac8-357bc430328b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:56.449550 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50848b69-5636-4ed3-978b-a78b0af9ffe8 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:56.520812 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f20c62-a1bd-4fb7-9fb4-019746a32a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:56.521517 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f20c62-a1bd-4fb7-9fb4-019746a32a39 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:56.521798 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f20c62-a1bd-4fb7-9fb4-019746a32a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:56.522066 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f20c62-a1bd-4fb7-9fb4-019746a32a39 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:56.522820 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f20c62-a1bd-4fb7-9fb4-019746a32a39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:56.525092 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f20c62-a1bd-4fb7-9fb4-019746a32a39 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:56.527261 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 978/1963] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:03:56 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 10:03:56.531889 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312ace96-9564-4202-aac8-357bc430328b None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:56.556040 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 986/1964] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 10 10:03:56 2022] POST /identity/v3/users => generated 291 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 10:03:56.559608 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f20c62-a1bd-4fb7-9fb4-019746a32a39 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:56.569305 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312ace96-9564-4202-aac8-357bc430328b None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:56.581291 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400f6dab-1d9e-47a3-9f33-c3fd7f8a0423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:56.581927 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400f6dab-1d9e-47a3-9f33-c3fd7f8a0423 admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:56.582210 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400f6dab-1d9e-47a3-9f33-c3fd7f8a0423 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:56.582574 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400f6dab-1d9e-47a3-9f33-c3fd7f8a0423 admin admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:56.583114 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400f6dab-1d9e-47a3-9f33-c3fd7f8a0423 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:56.585040 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400f6dab-1d9e-47a3-9f33-c3fd7f8a0423 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:56.587214 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f20c62-a1bd-4fb7-9fb4-019746a32a39 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:56.592740 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6e35ea-088d-485f-9cd3-34ffef7b4a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:56.593569 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6e35ea-088d-485f-9cd3-34ffef7b4a48 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:56.593934 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6e35ea-088d-485f-9cd3-34ffef7b4a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:56.594297 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6e35ea-088d-485f-9cd3-34ffef7b4a48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:56.595116 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6e35ea-088d-485f-9cd3-34ffef7b4a48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:56.596790 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6e35ea-088d-485f-9cd3-34ffef7b4a48 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:56.609207 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 987/1965] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:03:56 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 10:03:56.613528 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6e35ea-088d-485f-9cd3-34ffef7b4a48 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:56.632382 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6e35ea-088d-485f-9cd3-34ffef7b4a48 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:56.648310 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 979/1966] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 10 10:03:56 2022] POST /identity/v3/projects => generated 387 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 10:03:56.649011 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d73c766-adaf-4f87-8002-d59f1bed4f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:56.649758 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d73c766-adaf-4f87-8002-d59f1bed4f5a admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:56.650198 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d73c766-adaf-4f87-8002-d59f1bed4f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:56.650607 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d73c766-adaf-4f87-8002-d59f1bed4f5a admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:56.651392 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d73c766-adaf-4f87-8002-d59f1bed4f5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:56.652757 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400f6dab-1d9e-47a3-9f33-c3fd7f8a0423 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:56.656878 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d73c766-adaf-4f87-8002-d59f1bed4f5a admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:56.689147 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 988/1967] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:03:56 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:03:56.691856 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d73c766-adaf-4f87-8002-d59f1bed4f5a admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:56.713821 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d73c766-adaf-4f87-8002-d59f1bed4f5a admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:56.765748 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400f6dab-1d9e-47a3-9f33-c3fd7f8a0423 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:56.771695 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ab0ad9-f44b-4b8c-88df-a5e8d5244edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:56.772335 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab0ad9-f44b-4b8c-88df-a5e8d5244edb admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:56.772939 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab0ad9-f44b-4b8c-88df-a5e8d5244edb admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:56.774280 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab0ad9-f44b-4b8c-88df-a5e8d5244edb admin admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:56.774280 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ab0ad9-f44b-4b8c-88df-a5e8d5244edb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:56.776290 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ab0ad9-f44b-4b8c-88df-a5e8d5244edb admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:56.786218 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:56.796354 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9bd2fb-a839-4f5f-a686-2882896f1bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:56.797200 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9bd2fb-a839-4f5f-a686-2882896f1bd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:56.797834 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9bd2fb-a839-4f5f-a686-2882896f1bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:56.798730 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9bd2fb-a839-4f5f-a686-2882896f1bd0 admin admin] PATH_INFO: `/v3/projects/0b1a01aaf9f0440591893974a5f7709c/users/99f24f12cd27428f9ac7f6ccf526cc1b/roles/8daabcb6b7394e39b06a3453e33e32db` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:56.819335 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 980/1968] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 10 10:03:56 2022] POST /identity/v3/users => generated 300 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:03:56.820629 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ab0ad9-f44b-4b8c-88df-a5e8d5244edb admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:56.828025 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9bd2fb-a839-4f5f-a686-2882896f1bd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b1a01aaf9f0440591893974a5f7709c, user_id=99f24f12cd27428f9ac7f6ccf526cc1b, role_id=8daabcb6b7394e39b06a3453e33e32db)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:56.831152 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9bd2fb-a839-4f5f-a686-2882896f1bd0 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:56.833562 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ab0ad9-f44b-4b8c-88df-a5e8d5244edb admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:56.839588 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c2d336-1ef5-4077-85ed-edfc79881dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:56.840265 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c2d336-1ef5-4077-85ed-edfc79881dcf admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:56.840684 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c2d336-1ef5-4077-85ed-edfc79881dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:56.841027 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c2d336-1ef5-4077-85ed-edfc79881dcf admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:56.841846 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c2d336-1ef5-4077-85ed-edfc79881dcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:56.844133 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c2d336-1ef5-4077-85ed-edfc79881dcf admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:56.855465 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 989/1969] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:03:56 2022] PUT /identity/v3/projects/0b1a01aaf9f0440591893974a5f7709c/users/99f24f12cd27428f9ac7f6ccf526cc1b/roles/8daabcb6b7394e39b06a3453e33e32db => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:03:56.859796 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 981/1970] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:03:56 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 10:03:56.876824 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9bd2fb-a839-4f5f-a686-2882896f1bd0 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:56.876960 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e6abf4-95c3-4abf-b9d0-6cd021875fcd None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:56.876960 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e6abf4-95c3-4abf-b9d0-6cd021875fcd None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:56.876960 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e6abf4-95c3-4abf-b9d0-6cd021875fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:56.917261 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-30e6abf4-95c3-4abf-b9d0-6cd021875fcd None None] MFA Rules not processed for user `99f24f12cd27428f9ac7f6ccf526cc1b`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:03:56.918261 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-30e6abf4-95c3-4abf-b9d0-6cd021875fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:56.924926 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:57.044896 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 982/1971] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:03:56 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:03:57.045152 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9bd2fb-a839-4f5f-a686-2882896f1bd0 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:57.046874 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e6abf4-95c3-4abf-b9d0-6cd021875fcd None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:57.047207 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f4fb27-d143-4944-9a96-e4e57b865cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:57.047883 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f4fb27-d143-4944-9a96-e4e57b865cdf admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:57.048380 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f4fb27-d143-4944-9a96-e4e57b865cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:57.048666 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f4fb27-d143-4944-9a96-e4e57b865cdf admin admin] PATH_INFO: `/v3/projects/deb3378212f84df6ab5aadb96e4de624/users/ea35b9a390984e9989e4eb9e15b4431e/roles/eb04edc46b3742d7a0f0ead26f68bc22` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:57.061125 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e6abf4-95c3-4abf-b9d0-6cd021875fcd None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:57.066563 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c79b9c4-3373-43d7-9638-218d6eab4920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:57.067224 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c79b9c4-3373-43d7-9638-218d6eab4920 admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:57.067599 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c79b9c4-3373-43d7-9638-218d6eab4920 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:57.068087 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c79b9c4-3373-43d7-9638-218d6eab4920 admin admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:57.068652 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f4fb27-d143-4944-9a96-e4e57b865cdf admin admin] RBAC: Authorizing `identity:create_grant(project_id=deb3378212f84df6ab5aadb96e4de624, user_id=ea35b9a390984e9989e4eb9e15b4431e, role_id=eb04edc46b3742d7a0f0ead26f68bc22)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:57.068771 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c79b9c4-3373-43d7-9638-218d6eab4920 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:57.071421 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c79b9c4-3373-43d7-9638-218d6eab4920 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:57.072180 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f4fb27-d143-4944-9a96-e4e57b865cdf admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:57.088924 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 990/1972] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:03:56 2022] PUT /identity/v3/projects/deb3378212f84df6ab5aadb96e4de624/users/ea35b9a390984e9989e4eb9e15b4431e/roles/eb04edc46b3742d7a0f0ead26f68bc22 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:03:57.093031 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f4fb27-d143-4944-9a96-e4e57b865cdf admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:57.109158 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 983/1973] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 10 10:03:57 2022] POST /identity/v3/projects => generated 381 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 10:03:57.113374 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c79b9c4-3373-43d7-9638-218d6eab4920 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:57.174822 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f4fb27-d143-4944-9a96-e4e57b865cdf admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:57.195155 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c79b9c4-3373-43d7-9638-218d6eab4920 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:57.200968 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c215ecb4-3aef-4cca-8a9b-711491f14c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:57.201624 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c215ecb4-3aef-4cca-8a9b-711491f14c39 admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:57.201910 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c215ecb4-3aef-4cca-8a9b-711491f14c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:57.202183 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c215ecb4-3aef-4cca-8a9b-711491f14c39 admin admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:57.202933 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c215ecb4-3aef-4cca-8a9b-711491f14c39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:57.204977 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c215ecb4-3aef-4cca-8a9b-711491f14c39 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:57.245614 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 984/1974] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 10 10:03:57 2022] POST /identity/v3/users => generated 297 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 10:03:57.246708 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c215ecb4-3aef-4cca-8a9b-711491f14c39 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:57.263348 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1396d1e7-0155-426e-8e35-86d77ca64bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:57.264013 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1396d1e7-0155-426e-8e35-86d77ca64bbf admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:57.264291 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1396d1e7-0155-426e-8e35-86d77ca64bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:57.264570 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1396d1e7-0155-426e-8e35-86d77ca64bbf admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:57.265289 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1396d1e7-0155-426e-8e35-86d77ca64bbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:57.267197 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1396d1e7-0155-426e-8e35-86d77ca64bbf admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:57.278820 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 991/1975] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:03:57 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 10:03:57.281106 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c215ecb4-3aef-4cca-8a9b-711491f14c39 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:57.283301 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1396d1e7-0155-426e-8e35-86d77ca64bbf admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:57.293977 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1396d1e7-0155-426e-8e35-86d77ca64bbf admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:57.298969 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68133199-9664-41bc-b211-7ca4460f8700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:57.299723 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68133199-9664-41bc-b211-7ca4460f8700 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:57.300017 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68133199-9664-41bc-b211-7ca4460f8700 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:57.300300 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68133199-9664-41bc-b211-7ca4460f8700 admin admin] PATH_INFO: `/v3/projects/deb3378212f84df6ab5aadb96e4de624/users/ea35b9a390984e9989e4eb9e15b4431e/roles/eb04edc46b3742d7a0f0ead26f68bc22` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:57.300779 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e91bb2-1115-4df7-aef9-7220f3b947ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:57.302416 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68133199-9664-41bc-b211-7ca4460f8700 admin admin] RBAC: Authorizing `identity:create_grant(project_id=deb3378212f84df6ab5aadb96e4de624, user_id=ea35b9a390984e9989e4eb9e15b4431e, role_id=eb04edc46b3742d7a0f0ead26f68bc22)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:57.304849 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e91bb2-1115-4df7-aef9-7220f3b947ff admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:57.305174 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e91bb2-1115-4df7-aef9-7220f3b947ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:57.306461 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68133199-9664-41bc-b211-7ca4460f8700 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:57.308303 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e91bb2-1115-4df7-aef9-7220f3b947ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:57.309422 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:57.311212 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e91bb2-1115-4df7-aef9-7220f3b947ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:57.313423 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e91bb2-1115-4df7-aef9-7220f3b947ff admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:57.324356 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 992/1976] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:03:57 2022] PUT /identity/v3/projects/deb3378212f84df6ab5aadb96e4de624/users/ea35b9a390984e9989e4eb9e15b4431e/roles/eb04edc46b3742d7a0f0ead26f68bc22 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 10:03:57.339359 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b85f687-a249-4853-aff8-b865fa8ecd99 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:57.339674 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b85f687-a249-4853-aff8-b865fa8ecd99 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:57.339942 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b85f687-a249-4853-aff8-b865fa8ecd99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:57.349363 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 985/1977] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:03:57 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:03:57.353305 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e91bb2-1115-4df7-aef9-7220f3b947ff admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:57.373162 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e91bb2-1115-4df7-aef9-7220f3b947ff admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:57.378401 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-3b85f687-a249-4853-aff8-b865fa8ecd99 None None] MFA Rules not processed for user `ea35b9a390984e9989e4eb9e15b4431e`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:03:57.380782 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-3b85f687-a249-4853-aff8-b865fa8ecd99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:57.486465 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df4f3af-2ae8-4294-8d05-e1372fb93789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:57.490765 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df4f3af-2ae8-4294-8d05-e1372fb93789 admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:57.491261 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df4f3af-2ae8-4294-8d05-e1372fb93789 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:57.491696 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df4f3af-2ae8-4294-8d05-e1372fb93789 admin admin] PATH_INFO: `/v3/projects/7f7a0e5ce5114ce7a540f6bd1173a1c5/users/0d7a8817ff3d4e749a3bdf72c6396b64/roles/eb04edc46b3742d7a0f0ead26f68bc22` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:57.508977 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:57.522792 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df4f3af-2ae8-4294-8d05-e1372fb93789 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f7a0e5ce5114ce7a540f6bd1173a1c5, user_id=0d7a8817ff3d4e749a3bdf72c6396b64, role_id=eb04edc46b3742d7a0f0ead26f68bc22)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:57.532853 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df4f3af-2ae8-4294-8d05-e1372fb93789 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:57.558598 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 986/1978] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:03:57 2022] PUT /identity/v3/projects/7f7a0e5ce5114ce7a540f6bd1173a1c5/users/0d7a8817ff3d4e749a3bdf72c6396b64/roles/eb04edc46b3742d7a0f0ead26f68bc22 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:03:57.562342 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df4f3af-2ae8-4294-8d05-e1372fb93789 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:57.586739 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 993/1979] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:03:57 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:03:57.600570 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b85f687-a249-4853-aff8-b865fa8ecd99 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:57.601983 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-3b85f687-a249-4853-aff8-b865fa8ecd99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:57.692685 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b85f687-a249-4853-aff8-b865fa8ecd99 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:57.705642 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df4f3af-2ae8-4294-8d05-e1372fb93789 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:57.713130 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca7688f-ec4d-4f1a-a43a-b58ee27987d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:57.713920 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca7688f-ec4d-4f1a-a43a-b58ee27987d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:57.714503 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca7688f-ec4d-4f1a-a43a-b58ee27987d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:57.715004 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca7688f-ec4d-4f1a-a43a-b58ee27987d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:57.715792 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca7688f-ec4d-4f1a-a43a-b58ee27987d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:57.717673 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca7688f-ec4d-4f1a-a43a-b58ee27987d1 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:57.744479 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 987/1980] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:03:57 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:03:57.744479 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca7688f-ec4d-4f1a-a43a-b58ee27987d1 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:57.750780 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca7688f-ec4d-4f1a-a43a-b58ee27987d1 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:57.760202 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b1bfd9-82f2-4e3c-8061-cadfe2d99c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:57.760703 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245431a7-7c23-40ea-9bfa-979a467be51d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf8e725cbe0403d943b136235eac057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:57.760934 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b1bfd9-82f2-4e3c-8061-cadfe2d99c1b admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:57.761245 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b1bfd9-82f2-4e3c-8061-cadfe2d99c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:57.761608 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b1bfd9-82f2-4e3c-8061-cadfe2d99c1b admin admin] PATH_INFO: `/v3/projects/7f7a0e5ce5114ce7a540f6bd1173a1c5/users/0d7a8817ff3d4e749a3bdf72c6396b64/roles/eb04edc46b3742d7a0f0ead26f68bc22` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:57.762518 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245431a7-7c23-40ea-9bfa-979a467be51d service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:57.762962 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245431a7-7c23-40ea-9bfa-979a467be51d service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:57.763385 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245431a7-7c23-40ea-9bfa-979a467be51d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:57.763504 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b1bfd9-82f2-4e3c-8061-cadfe2d99c1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f7a0e5ce5114ce7a540f6bd1173a1c5, user_id=0d7a8817ff3d4e749a3bdf72c6396b64, role_id=eb04edc46b3742d7a0f0ead26f68bc22)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:57.766303 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b1bfd9-82f2-4e3c-8061-cadfe2d99c1b admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:57.777918 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 988/1981] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:03:57 2022] PUT /identity/v3/projects/7f7a0e5ce5114ce7a540f6bd1173a1c5/users/0d7a8817ff3d4e749a3bdf72c6396b64/roles/eb04edc46b3742d7a0f0ead26f68bc22 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 10:03:57.788891 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a5bd2-ad81-4ca0-85dd-724b047c862b None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:57.789276 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a5bd2-ad81-4ca0-85dd-724b047c862b None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:57.789399 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a5bd2-ad81-4ca0-85dd-724b047c862b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:57.817543 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:57.822022 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-160a5bd2-ad81-4ca0-85dd-724b047c862b None None] MFA Rules not processed for user `0d7a8817ff3d4e749a3bdf72c6396b64`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:03:57.823340 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-160a5bd2-ad81-4ca0-85dd-724b047c862b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:57.839205 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245431a7-7c23-40ea-9bfa-979a467be51d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:57.840656 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245431a7-7c23-40ea-9bfa-979a467be51d service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:57.860750 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 994/1982] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:03:57 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 10:03:57.919178 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 989/1983] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:03:57 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:03:57.941895 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245431a7-7c23-40ea-9bfa-979a467be51d service cinder] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:57.943544 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-245431a7-7c23-40ea-9bfa-979a467be51d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:57.958225 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245431a7-7c23-40ea-9bfa-979a467be51d service cinder] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:58.011889 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7778cb10-db32-421d-bde1-3ebcce7cac9b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf8e725cbe0403d943b136235eac057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:58.012505 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7778cb10-db32-421d-bde1-3ebcce7cac9b service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:58.012786 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7778cb10-db32-421d-bde1-3ebcce7cac9b service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:58.013059 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7778cb10-db32-421d-bde1-3ebcce7cac9b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:58.022266 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7778cb10-db32-421d-bde1-3ebcce7cac9b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:58.023703 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7778cb10-db32-421d-bde1-3ebcce7cac9b service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:58.033019 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 995/1984] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:03:57 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:03:58.567131 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160a5bd2-ad81-4ca0-85dd-724b047c862b None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:58.574791 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7778cb10-db32-421d-bde1-3ebcce7cac9b service cinder] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:58.586098 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7778cb10-db32-421d-bde1-3ebcce7cac9b service cinder] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:58.600229 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa133e9-f504-4035-ac6b-f050d4c34590 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf8e725cbe0403d943b136235eac057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:58.601727 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa133e9-f504-4035-ac6b-f050d4c34590 service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:58.602687 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa133e9-f504-4035-ac6b-f050d4c34590 service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:58.603811 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa133e9-f504-4035-ac6b-f050d4c34590 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:58.608904 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-baa133e9-f504-4035-ac6b-f050d4c34590 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:58.685496 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:58.702475 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa133e9-f504-4035-ac6b-f050d4c34590 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:58.705850 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa133e9-f504-4035-ac6b-f050d4c34590 service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:58.710412 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160a5bd2-ad81-4ca0-85dd-724b047c862b None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:58.716931 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9debe560-76ea-4b87-a52e-a7a1122dfa57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:58.717897 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9debe560-76ea-4b87-a52e-a7a1122dfa57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:58.718029 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9debe560-76ea-4b87-a52e-a7a1122dfa57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:58.718233 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9debe560-76ea-4b87-a52e-a7a1122dfa57 admin admin] PATH_INFO: `/v3/users/99f24f12cd27428f9ac7f6ccf526cc1b` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:58.719471 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9debe560-76ea-4b87-a52e-a7a1122dfa57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99f24f12cd27428f9ac7f6ccf526cc1b)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:58.721771 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9debe560-76ea-4b87-a52e-a7a1122dfa57 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:58.734125 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 996/1985] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:03:58 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:03:58.807297 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-9debe560-76ea-4b87-a52e-a7a1122dfa57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99f24f12cd27428f9ac7f6ccf526cc1b'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:58.837700 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-9debe560-76ea-4b87-a52e-a7a1122dfa57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99f24f12cd27428f9ac7f6ccf526cc1b'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:58.855556 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-9debe560-76ea-4b87-a52e-a7a1122dfa57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99f24f12cd27428f9ac7f6ccf526cc1b'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:58.856206 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-9debe560-76ea-4b87-a52e-a7a1122dfa57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99f24f12cd27428f9ac7f6ccf526cc1b'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:58.856898 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-9debe560-76ea-4b87-a52e-a7a1122dfa57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99f24f12cd27428f9ac7f6ccf526cc1b'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:58.892335 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 990/1986] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 10 10:03:58 2022] DELETE /identity/v3/users/99f24f12cd27428f9ac7f6ccf526cc1b => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:03:58.898832 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bf035d-70ca-4de0-a067-d5007f216bab None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:58.899337 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bf035d-70ca-4de0-a067-d5007f216bab None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:58.900042 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bf035d-70ca-4de0-a067-d5007f216bab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:58.949430 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-94bf035d-70ca-4de0-a067-d5007f216bab None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:03:58.952826 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-94bf035d-70ca-4de0-a067-d5007f216bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:59.058138 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 997/1987] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:03:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:03:59.070277 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9debe560-76ea-4b87-a52e-a7a1122dfa57 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:59.071731 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-9debe560-76ea-4b87-a52e-a7a1122dfa57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:59.141605 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9debe560-76ea-4b87-a52e-a7a1122dfa57 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:59.146199 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c193068-44e4-4b83-aeb5-5487d325884d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4294c170df354fe892831281acd4ea7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:59.146925 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c193068-44e4-4b83-aeb5-5487d325884d service neutron] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:59.147205 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c193068-44e4-4b83-aeb5-5487d325884d service neutron] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:59.147475 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c193068-44e4-4b83-aeb5-5487d325884d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:59.160529 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c193068-44e4-4b83-aeb5-5487d325884d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:59.160529 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c193068-44e4-4b83-aeb5-5487d325884d service neutron] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:59.186001 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 991/1988] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:03:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:03:59.566659 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bf035d-70ca-4de0-a067-d5007f216bab None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:59.568850 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-94bf035d-70ca-4de0-a067-d5007f216bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:03:59.591339 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bf035d-70ca-4de0-a067-d5007f216bab None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:59.605394 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a47f91-3ea4-4e24-91a6-12a9f893db94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:59.606085 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a47f91-3ea4-4e24-91a6-12a9f893db94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:59.606365 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a47f91-3ea4-4e24-91a6-12a9f893db94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:59.606696 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a47f91-3ea4-4e24-91a6-12a9f893db94 admin admin] PATH_INFO: `/v3/projects/0b1a01aaf9f0440591893974a5f7709c` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:59.608577 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a47f91-3ea4-4e24-91a6-12a9f893db94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b1a01aaf9f0440591893974a5f7709c)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:59.610557 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a47f91-3ea4-4e24-91a6-12a9f893db94 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:59.643712 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:59.704488 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-f0a47f91-3ea4-4e24-91a6-12a9f893db94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b1a01aaf9f0440591893974a5f7709c', 'request_id': 'req-f0a47f91-3ea4-4e24-91a6-12a9f893db94'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:59.720854 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-f0a47f91-3ea4-4e24-91a6-12a9f893db94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b1a01aaf9f0440591893974a5f7709c', 'request_id': 'req-f0a47f91-3ea4-4e24-91a6-12a9f893db94'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:59.733304 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-f0a47f91-3ea4-4e24-91a6-12a9f893db94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b1a01aaf9f0440591893974a5f7709c', 'request_id': 'req-f0a47f91-3ea4-4e24-91a6-12a9f893db94'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:59.758566 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-f0a47f91-3ea4-4e24-91a6-12a9f893db94 admin admin] The token cache is being invalidate because project 0b1a01aaf9f0440591893974a5f7709c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 10:03:59.759005 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-f0a47f91-3ea4-4e24-91a6-12a9f893db94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:59.759817 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-f0a47f91-3ea4-4e24-91a6-12a9f893db94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:59.761812 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 998/1989] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 10 10:03:59 2022] DELETE /identity/v3/projects/0b1a01aaf9f0440591893974a5f7709c => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:03:59.766127 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c193068-44e4-4b83-aeb5-5487d325884d service neutron] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:03:59.777450 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c193068-44e4-4b83-aeb5-5487d325884d service neutron] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:03:59.850734 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61d69f8-4b0a-4980-b940-14d344cd8b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:03:59.851493 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61d69f8-4b0a-4980-b940-14d344cd8b3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:03:59.851781 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61d69f8-4b0a-4980-b940-14d344cd8b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:03:59.852079 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61d69f8-4b0a-4980-b940-14d344cd8b3f admin admin] PATH_INFO: `/v3/users/0d7a8817ff3d4e749a3bdf72c6396b64` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:03:59.853628 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61d69f8-4b0a-4980-b940-14d344cd8b3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d7a8817ff3d4e749a3bdf72c6396b64)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:03:59.855863 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61d69f8-4b0a-4980-b940-14d344cd8b3f admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:03:59.880761 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:03:59.911791 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-e61d69f8-4b0a-4980-b940-14d344cd8b3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d7a8817ff3d4e749a3bdf72c6396b64'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:59.918818 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-e61d69f8-4b0a-4980-b940-14d344cd8b3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d7a8817ff3d4e749a3bdf72c6396b64'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:59.926562 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-e61d69f8-4b0a-4980-b940-14d344cd8b3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d7a8817ff3d4e749a3bdf72c6396b64'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:59.927259 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-e61d69f8-4b0a-4980-b940-14d344cd8b3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d7a8817ff3d4e749a3bdf72c6396b64'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:59.927906 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-e61d69f8-4b0a-4980-b940-14d344cd8b3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d7a8817ff3d4e749a3bdf72c6396b64'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:03:59.969630 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 992/1990] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 10 10:03:59 2022] DELETE /identity/v3/users/0d7a8817ff3d4e749a3bdf72c6396b64 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:04:00.489313 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a47f91-3ea4-4e24-91a6-12a9f893db94 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:00.500165 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-f0a47f91-3ea4-4e24-91a6-12a9f893db94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:00.537598 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a47f91-3ea4-4e24-91a6-12a9f893db94 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:00.602104 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b3cd6f-28ea-4854-8b34-452217917b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:00.602820 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b3cd6f-28ea-4854-8b34-452217917b2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:00.603087 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b3cd6f-28ea-4854-8b34-452217917b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:00.603363 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b3cd6f-28ea-4854-8b34-452217917b2a admin admin] PATH_INFO: `/v3/projects/7f7a0e5ce5114ce7a540f6bd1173a1c5` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:00.604609 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b3cd6f-28ea-4854-8b34-452217917b2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f7a0e5ce5114ce7a540f6bd1173a1c5)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:00.606634 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b3cd6f-28ea-4854-8b34-452217917b2a admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:00.687345 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-80b3cd6f-28ea-4854-8b34-452217917b2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f7a0e5ce5114ce7a540f6bd1173a1c5', 'request_id': 'req-80b3cd6f-28ea-4854-8b34-452217917b2a'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:00.692997 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-80b3cd6f-28ea-4854-8b34-452217917b2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f7a0e5ce5114ce7a540f6bd1173a1c5', 'request_id': 'req-80b3cd6f-28ea-4854-8b34-452217917b2a'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:00.702362 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-80b3cd6f-28ea-4854-8b34-452217917b2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f7a0e5ce5114ce7a540f6bd1173a1c5', 'request_id': 'req-80b3cd6f-28ea-4854-8b34-452217917b2a'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:00.724718 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-80b3cd6f-28ea-4854-8b34-452217917b2a admin admin] The token cache is being invalidate because project 7f7a0e5ce5114ce7a540f6bd1173a1c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 10:04:00.724989 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-80b3cd6f-28ea-4854-8b34-452217917b2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:00.725590 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-80b3cd6f-28ea-4854-8b34-452217917b2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:00.727622 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 999/1991] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 10 10:04:00 2022] DELETE /identity/v3/projects/7f7a0e5ce5114ce7a540f6bd1173a1c5 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:04:00.732778 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b63679b-cfcf-43a7-a3db-65b394679131 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:00.733297 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b63679b-cfcf-43a7-a3db-65b394679131 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:00.733651 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b63679b-cfcf-43a7-a3db-65b394679131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:00.763781 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-2b63679b-cfcf-43a7-a3db-65b394679131 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:04:00.765292 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-2b63679b-cfcf-43a7-a3db-65b394679131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:00.857230 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 993/1992] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:04:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 10:04:00.863367 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20229497-edf1-4899-af27-93e2b5df86a3 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:00.863732 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20229497-edf1-4899-af27-93e2b5df86a3 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:00.864282 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20229497-edf1-4899-af27-93e2b5df86a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:00.888128 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-20229497-edf1-4899-af27-93e2b5df86a3 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:04:00.889789 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-20229497-edf1-4899-af27-93e2b5df86a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:00.901688 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1000/1993] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:04:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 10:04:00.906677 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b63679b-cfcf-43a7-a3db-65b394679131 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:00.922136 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b63679b-cfcf-43a7-a3db-65b394679131 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:00.927621 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896b8cdb-1834-4d80-b6d1-9b1d1cebd2db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:00.928316 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896b8cdb-1834-4d80-b6d1-9b1d1cebd2db admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:00.928662 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896b8cdb-1834-4d80-b6d1-9b1d1cebd2db admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:00.929024 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896b8cdb-1834-4d80-b6d1-9b1d1cebd2db admin admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:00.929857 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896b8cdb-1834-4d80-b6d1-9b1d1cebd2db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:04:00.930610 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896b8cdb-1834-4d80-b6d1-9b1d1cebd2db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:00.932391 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896b8cdb-1834-4d80-b6d1-9b1d1cebd2db admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:00.945735 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 994/1994] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 10 10:04:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 10:04:00.949923 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20229497-edf1-4899-af27-93e2b5df86a3 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:00.961197 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20229497-edf1-4899-af27-93e2b5df86a3 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:00.967230 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d022aa-33d6-4176-a2ee-ea7e02f49d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:00.968077 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d022aa-33d6-4176-a2ee-ea7e02f49d2b admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:00.968517 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d022aa-33d6-4176-a2ee-ea7e02f49d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:00.968941 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d022aa-33d6-4176-a2ee-ea7e02f49d2b admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:00.969770 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d022aa-33d6-4176-a2ee-ea7e02f49d2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:00.971908 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d022aa-33d6-4176-a2ee-ea7e02f49d2b admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:01.004108 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1001/1995] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 10 10:04:00 2022] POST /identity/v3/projects => generated 383 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:04:01.009862 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896b8cdb-1834-4d80-b6d1-9b1d1cebd2db admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:01.020727 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896b8cdb-1834-4d80-b6d1-9b1d1cebd2db admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:01.091072 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51067f1e-4ea1-464c-a951-e6b86f3c2254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:01.091778 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51067f1e-4ea1-464c-a951-e6b86f3c2254 admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:01.092082 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51067f1e-4ea1-464c-a951-e6b86f3c2254 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:01.092325 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51067f1e-4ea1-464c-a951-e6b86f3c2254 admin admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:01.092953 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51067f1e-4ea1-464c-a951-e6b86f3c2254 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:01.094955 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51067f1e-4ea1-464c-a951-e6b86f3c2254 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:01.120160 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 995/1996] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 10 10:04:01 2022] POST /identity/v3/users => generated 292 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 10:04:01.124185 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d022aa-33d6-4176-a2ee-ea7e02f49d2b admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:01.135498 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d022aa-33d6-4176-a2ee-ea7e02f49d2b admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:01.152093 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0019a30b-9a09-4ed0-a808-1d6a60469a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:01.158311 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0019a30b-9a09-4ed0-a808-1d6a60469a09 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:01.158739 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0019a30b-9a09-4ed0-a808-1d6a60469a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:01.159095 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0019a30b-9a09-4ed0-a808-1d6a60469a09 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:01.159981 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0019a30b-9a09-4ed0-a808-1d6a60469a09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:01.161967 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0019a30b-9a09-4ed0-a808-1d6a60469a09 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:01.168640 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:04:01.177097 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1002/1997] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:04:01 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:04:01.179924 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51067f1e-4ea1-464c-a951-e6b86f3c2254 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:01.192232 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51067f1e-4ea1-464c-a951-e6b86f3c2254 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:01.196932 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b64530e-4425-4c0b-9de2-7e9198658171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:01.197584 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b64530e-4425-4c0b-9de2-7e9198658171 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:01.197971 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b64530e-4425-4c0b-9de2-7e9198658171 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:01.198240 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b64530e-4425-4c0b-9de2-7e9198658171 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:01.198875 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b64530e-4425-4c0b-9de2-7e9198658171 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:01.200495 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b64530e-4425-4c0b-9de2-7e9198658171 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:01.212811 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 996/1998] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:04:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:04:01.216808 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0019a30b-9a09-4ed0-a808-1d6a60469a09 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:01.227727 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0019a30b-9a09-4ed0-a808-1d6a60469a09 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:01.233915 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e17693-8f0b-49cf-914e-62703b6a2156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:01.234577 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e17693-8f0b-49cf-914e-62703b6a2156 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:01.234746 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e17693-8f0b-49cf-914e-62703b6a2156 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:01.235001 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e17693-8f0b-49cf-914e-62703b6a2156 admin admin] PATH_INFO: `/v3/projects/a6f7355e880a49fe98d39910177c7ca7/users/16eab9353d4c4efca16bd29e72db6414/roles/8daabcb6b7394e39b06a3453e33e32db` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:01.254523 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e17693-8f0b-49cf-914e-62703b6a2156 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6f7355e880a49fe98d39910177c7ca7, user_id=16eab9353d4c4efca16bd29e72db6414, role_id=8daabcb6b7394e39b06a3453e33e32db)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:01.257510 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e17693-8f0b-49cf-914e-62703b6a2156 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:01.273837 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1003/1999] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:04:01 2022] PUT /identity/v3/projects/a6f7355e880a49fe98d39910177c7ca7/users/16eab9353d4c4efca16bd29e72db6414/roles/8daabcb6b7394e39b06a3453e33e32db => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:04:01.285094 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1624ed2-48bb-43a0-aa18-8ad17a27e71a None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:01.285647 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1624ed2-48bb-43a0-aa18-8ad17a27e71a None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:01.285926 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1624ed2-48bb-43a0-aa18-8ad17a27e71a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:01.293540 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:04:01.325378 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-e1624ed2-48bb-43a0-aa18-8ad17a27e71a None None] MFA Rules not processed for user `16eab9353d4c4efca16bd29e72db6414`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:04:01.326670 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-e1624ed2-48bb-43a0-aa18-8ad17a27e71a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:01.413041 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 997/2000] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:04:01 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 10:04:01.428534 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e17693-8f0b-49cf-914e-62703b6a2156 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:01.431946 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-68e17693-8f0b-49cf-914e-62703b6a2156 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:01.514650 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e17693-8f0b-49cf-914e-62703b6a2156 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:01.519229 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af0813e-5b03-43af-a811-fc02768cf629 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf8e725cbe0403d943b136235eac057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:01.522886 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af0813e-5b03-43af-a811-fc02768cf629 service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:01.523245 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af0813e-5b03-43af-a811-fc02768cf629 service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:01.523764 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af0813e-5b03-43af-a811-fc02768cf629 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:01.545301 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af0813e-5b03-43af-a811-fc02768cf629 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:01.546455 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af0813e-5b03-43af-a811-fc02768cf629 service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:01.557398 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1004/2001] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:04:01 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:04:01.588862 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1624ed2-48bb-43a0-aa18-8ad17a27e71a None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:01.665159 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1624ed2-48bb-43a0-aa18-8ad17a27e71a None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:01.670142 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b37c82d-14ca-48f0-a2b5-02747eabcf96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:01.670781 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b37c82d-14ca-48f0-a2b5-02747eabcf96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:01.671057 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b37c82d-14ca-48f0-a2b5-02747eabcf96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:01.671456 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b37c82d-14ca-48f0-a2b5-02747eabcf96 admin admin] PATH_INFO: `/v3/users/16eab9353d4c4efca16bd29e72db6414` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:01.672604 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b37c82d-14ca-48f0-a2b5-02747eabcf96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16eab9353d4c4efca16bd29e72db6414)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:01.674692 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b37c82d-14ca-48f0-a2b5-02747eabcf96 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:01.741420 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-0b37c82d-14ca-48f0-a2b5-02747eabcf96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16eab9353d4c4efca16bd29e72db6414'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:01.750482 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-0b37c82d-14ca-48f0-a2b5-02747eabcf96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16eab9353d4c4efca16bd29e72db6414'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:01.762057 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-0b37c82d-14ca-48f0-a2b5-02747eabcf96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16eab9353d4c4efca16bd29e72db6414'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:01.762902 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-0b37c82d-14ca-48f0-a2b5-02747eabcf96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16eab9353d4c4efca16bd29e72db6414'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:01.763683 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-0b37c82d-14ca-48f0-a2b5-02747eabcf96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16eab9353d4c4efca16bd29e72db6414'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:01.785114 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 998/2002] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 10 10:04:01 2022] DELETE /identity/v3/users/16eab9353d4c4efca16bd29e72db6414 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:04:01.789400 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d061c89f-7690-46e0-b2e5-36d2f966a245 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:01.789932 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d061c89f-7690-46e0-b2e5-36d2f966a245 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:01.790032 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d061c89f-7690-46e0-b2e5-36d2f966a245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:01.814057 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-d061c89f-7690-46e0-b2e5-36d2f966a245 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:04:01.815376 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-d061c89f-7690-46e0-b2e5-36d2f966a245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:01.903402 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1005/2003] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:04:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 10:04:01.914170 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b37c82d-14ca-48f0-a2b5-02747eabcf96 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:01.915781 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-0b37c82d-14ca-48f0-a2b5-02747eabcf96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:01.939577 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:04:01.954424 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d061c89f-7690-46e0-b2e5-36d2f966a245 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:01.956485 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-d061c89f-7690-46e0-b2e5-36d2f966a245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:01.971616 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d061c89f-7690-46e0-b2e5-36d2f966a245 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:01.976724 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f6d067-1a66-437d-b540-2ab3d439fd73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:01.977809 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f6d067-1a66-437d-b540-2ab3d439fd73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:01.978286 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f6d067-1a66-437d-b540-2ab3d439fd73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:01.979115 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f6d067-1a66-437d-b540-2ab3d439fd73 admin admin] PATH_INFO: `/v3/users/8da8f2a50a6149239a0e7cd80558a9dc` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:01.980936 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f6d067-1a66-437d-b540-2ab3d439fd73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8da8f2a50a6149239a0e7cd80558a9dc)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:01.983347 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f6d067-1a66-437d-b540-2ab3d439fd73 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:02.003854 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b37c82d-14ca-48f0-a2b5-02747eabcf96 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:02.008577 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceb47bd-e03a-4479-be26-562883f02eda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4294c170df354fe892831281acd4ea7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:02.009421 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceb47bd-e03a-4479-be26-562883f02eda service neutron] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:02.009714 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceb47bd-e03a-4479-be26-562883f02eda service neutron] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:02.010082 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceb47bd-e03a-4479-be26-562883f02eda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:02.020763 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceb47bd-e03a-4479-be26-562883f02eda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:02.022493 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceb47bd-e03a-4479-be26-562883f02eda service neutron] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:02.035929 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 999/2004] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:04:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:04:02.044123 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-e1f6d067-1a66-437d-b540-2ab3d439fd73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8da8f2a50a6149239a0e7cd80558a9dc'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:02.053721 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-e1f6d067-1a66-437d-b540-2ab3d439fd73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8da8f2a50a6149239a0e7cd80558a9dc'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:02.054358 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-e1f6d067-1a66-437d-b540-2ab3d439fd73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8da8f2a50a6149239a0e7cd80558a9dc'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:02.054975 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-e1f6d067-1a66-437d-b540-2ab3d439fd73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8da8f2a50a6149239a0e7cd80558a9dc'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:02.063287 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-e1f6d067-1a66-437d-b540-2ab3d439fd73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8da8f2a50a6149239a0e7cd80558a9dc'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:02.071866 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:04:02.085251 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1006/2005] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 10 10:04:01 2022] DELETE /identity/v3/users/8da8f2a50a6149239a0e7cd80558a9dc => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:04:02.090729 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f299e74-9df8-4f66-aacd-99d6ab47f7b0 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:02.091091 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f299e74-9df8-4f66-aacd-99d6ab47f7b0 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:02.091468 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f299e74-9df8-4f66-aacd-99d6ab47f7b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:02.114227 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-6f299e74-9df8-4f66-aacd-99d6ab47f7b0 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:04:02.117679 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-6f299e74-9df8-4f66-aacd-99d6ab47f7b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:02.211406 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1000/2006] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:04:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:04:02.222719 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f6d067-1a66-437d-b540-2ab3d439fd73 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:02.224612 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-e1f6d067-1a66-437d-b540-2ab3d439fd73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:02.309376 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f6d067-1a66-437d-b540-2ab3d439fd73 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:02.315512 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843d4d99-07a4-4989-8696-125a75562abd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4294c170df354fe892831281acd4ea7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:02.316150 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843d4d99-07a4-4989-8696-125a75562abd service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:02.316425 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843d4d99-07a4-4989-8696-125a75562abd service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:02.316696 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843d4d99-07a4-4989-8696-125a75562abd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:02.358881 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843d4d99-07a4-4989-8696-125a75562abd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:02.360356 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843d4d99-07a4-4989-8696-125a75562abd service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:02.384745 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1007/2007] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:04:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:04:02.393963 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f299e74-9df8-4f66-aacd-99d6ab47f7b0 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:02.395492 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-6f299e74-9df8-4f66-aacd-99d6ab47f7b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:02.415641 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f299e74-9df8-4f66-aacd-99d6ab47f7b0 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:02.422770 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2174a12-9966-4ca5-8539-c98d3f336e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:02.423688 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2174a12-9966-4ca5-8539-c98d3f336e18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:02.424123 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2174a12-9966-4ca5-8539-c98d3f336e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:02.424550 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2174a12-9966-4ca5-8539-c98d3f336e18 admin admin] PATH_INFO: `/v3/projects/a6f7355e880a49fe98d39910177c7ca7` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:02.426291 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2174a12-9966-4ca5-8539-c98d3f336e18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6f7355e880a49fe98d39910177c7ca7)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:02.429758 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2174a12-9966-4ca5-8539-c98d3f336e18 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:02.510062 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-b2174a12-9966-4ca5-8539-c98d3f336e18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6f7355e880a49fe98d39910177c7ca7', 'request_id': 'req-b2174a12-9966-4ca5-8539-c98d3f336e18'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:02.517944 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-b2174a12-9966-4ca5-8539-c98d3f336e18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6f7355e880a49fe98d39910177c7ca7', 'request_id': 'req-b2174a12-9966-4ca5-8539-c98d3f336e18'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:02.528289 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-b2174a12-9966-4ca5-8539-c98d3f336e18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6f7355e880a49fe98d39910177c7ca7', 'request_id': 'req-b2174a12-9966-4ca5-8539-c98d3f336e18'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:02.543606 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-b2174a12-9966-4ca5-8539-c98d3f336e18 admin admin] The token cache is being invalidate because project a6f7355e880a49fe98d39910177c7ca7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 10:04:02.543969 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-b2174a12-9966-4ca5-8539-c98d3f336e18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:02.544712 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-b2174a12-9966-4ca5-8539-c98d3f336e18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:02.547135 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1001/2008] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 10 10:04:02 2022] DELETE /identity/v3/projects/a6f7355e880a49fe98d39910177c7ca7 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:04:02.553325 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d1d8c7-ff70-4e08-83db-5ae2ea941af9 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:02.553881 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d1d8c7-ff70-4e08-83db-5ae2ea941af9 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:02.554162 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d1d8c7-ff70-4e08-83db-5ae2ea941af9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:02.594923 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-23d1d8c7-ff70-4e08-83db-5ae2ea941af9 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:04:02.596184 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-23d1d8c7-ff70-4e08-83db-5ae2ea941af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:02.702374 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1008/2009] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:04:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:04:02.711692 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29a73ef-be07-4ba3-b103-16258442e203 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:02.711983 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29a73ef-be07-4ba3-b103-16258442e203 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:02.712278 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29a73ef-be07-4ba3-b103-16258442e203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:02.735512 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-b29a73ef-be07-4ba3-b103-16258442e203 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:04:02.736834 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-b29a73ef-be07-4ba3-b103-16258442e203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:02.749995 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d1d8c7-ff70-4e08-83db-5ae2ea941af9 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:02.753212 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1002/2010] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:04:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:04:02.760667 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d1d8c7-ff70-4e08-83db-5ae2ea941af9 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:02.766158 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4226d2-e65e-46a2-9764-9aa2c0abbcf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:02.766893 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4226d2-e65e-46a2-9764-9aa2c0abbcf0 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:02.767241 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4226d2-e65e-46a2-9764-9aa2c0abbcf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:02.767583 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4226d2-e65e-46a2-9764-9aa2c0abbcf0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:02.768445 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4226d2-e65e-46a2-9764-9aa2c0abbcf0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:04:02.768974 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4226d2-e65e-46a2-9764-9aa2c0abbcf0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:02.770904 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4226d2-e65e-46a2-9764-9aa2c0abbcf0 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:02.791694 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1009/2011] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 10 10:04:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:04:02.795949 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29a73ef-be07-4ba3-b103-16258442e203 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:02.810219 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29a73ef-be07-4ba3-b103-16258442e203 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:02.816108 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6604b765-bcd7-416a-93c2-1adc7a0598f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:02.816874 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6604b765-bcd7-416a-93c2-1adc7a0598f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:02.817317 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6604b765-bcd7-416a-93c2-1adc7a0598f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:02.817690 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6604b765-bcd7-416a-93c2-1adc7a0598f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:02.819421 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6604b765-bcd7-416a-93c2-1adc7a0598f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:02.822263 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6604b765-bcd7-416a-93c2-1adc7a0598f8 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:02.875378 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1003/2012] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 10 10:04:02 2022] POST /identity/v3/projects => generated 385 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:04:02.880317 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4226d2-e65e-46a2-9764-9aa2c0abbcf0 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:02.923684 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4226d2-e65e-46a2-9764-9aa2c0abbcf0 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:02.942215 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6604b765-bcd7-416a-93c2-1adc7a0598f8 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:02.944430 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-6604b765-bcd7-416a-93c2-1adc7a0598f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:02.965761 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:04:03.046578 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6604b765-bcd7-416a-93c2-1adc7a0598f8 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:03.053758 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb4f090-8840-4a73-b68b-3c3278735f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:03.054609 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb4f090-8840-4a73-b68b-3c3278735f14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:03.054985 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb4f090-8840-4a73-b68b-3c3278735f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:03.055706 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb4f090-8840-4a73-b68b-3c3278735f14 admin admin] PATH_INFO: `/v3/projects/352c2c1d415346f68277e38e0df33a83` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:03.058670 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb4f090-8840-4a73-b68b-3c3278735f14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=352c2c1d415346f68277e38e0df33a83)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:03.060905 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb4f090-8840-4a73-b68b-3c3278735f14 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:03.115337 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd069499-6a38-4222-ada6-50dc583a2197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:03.115981 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd069499-6a38-4222-ada6-50dc583a2197 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:03.116284 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd069499-6a38-4222-ada6-50dc583a2197 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:03.116557 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd069499-6a38-4222-ada6-50dc583a2197 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:03.120416 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd069499-6a38-4222-ada6-50dc583a2197 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:03.125475 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd069499-6a38-4222-ada6-50dc583a2197 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:03.182680 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-9fb4f090-8840-4a73-b68b-3c3278735f14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '352c2c1d415346f68277e38e0df33a83', 'request_id': 'req-9fb4f090-8840-4a73-b68b-3c3278735f14'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:03.183128 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1010/2013] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 10 10:04:02 2022] POST /identity/v3/users => generated 293 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:04:03.186508 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd069499-6a38-4222-ada6-50dc583a2197 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:03.201329 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-9fb4f090-8840-4a73-b68b-3c3278735f14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '352c2c1d415346f68277e38e0df33a83', 'request_id': 'req-9fb4f090-8840-4a73-b68b-3c3278735f14'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:03.220863 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-9fb4f090-8840-4a73-b68b-3c3278735f14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '352c2c1d415346f68277e38e0df33a83', 'request_id': 'req-9fb4f090-8840-4a73-b68b-3c3278735f14'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:03.229537 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd069499-6a38-4222-ada6-50dc583a2197 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:03.248404 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:04:03.257552 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-9fb4f090-8840-4a73-b68b-3c3278735f14 admin admin] The token cache is being invalidate because project 352c2c1d415346f68277e38e0df33a83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 10:04:03.257746 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-9fb4f090-8840-4a73-b68b-3c3278735f14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:03.258758 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-9fb4f090-8840-4a73-b68b-3c3278735f14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:03.270161 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1004/2014] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 10 10:04:02 2022] DELETE /identity/v3/projects/352c2c1d415346f68277e38e0df33a83 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 10:04:03.271289 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb4f090-8840-4a73-b68b-3c3278735f14 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:03.273780 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-9fb4f090-8840-4a73-b68b-3c3278735f14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:03.412906 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a269f48-3261-4f64-bfd3-ce78f8163356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:03.413591 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a269f48-3261-4f64-bfd3-ce78f8163356 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:03.413900 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a269f48-3261-4f64-bfd3-ce78f8163356 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:03.414187 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a269f48-3261-4f64-bfd3-ce78f8163356 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:03.416355 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a269f48-3261-4f64-bfd3-ce78f8163356 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:03.418702 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a269f48-3261-4f64-bfd3-ce78f8163356 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:03.457250 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1011/2015] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:04:03 2022] GET /identity/v3/roles => generated 1420 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:04:03.460305 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a269f48-3261-4f64-bfd3-ce78f8163356 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:03.464813 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-0a269f48-3261-4f64-bfd3-ce78f8163356 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:03.470457 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb4f090-8840-4a73-b68b-3c3278735f14 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:03.478056 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7cf82c-e7ab-4387-8d34-d3fce085d5d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:03.479166 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7cf82c-e7ab-4387-8d34-d3fce085d5d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:03.479446 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7cf82c-e7ab-4387-8d34-d3fce085d5d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:03.479723 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7cf82c-e7ab-4387-8d34-d3fce085d5d7 admin admin] PATH_INFO: `/v3/users/a5f1ea65bca7451980df77d26068d3dc` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:03.483012 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7cf82c-e7ab-4387-8d34-d3fce085d5d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5f1ea65bca7451980df77d26068d3dc)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:03.485313 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7cf82c-e7ab-4387-8d34-d3fce085d5d7 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:03.574167 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a269f48-3261-4f64-bfd3-ce78f8163356 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:03.579489 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a82c32d-815e-4f0f-92c7-80ce586ad31d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf8e725cbe0403d943b136235eac057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:03.580601 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a82c32d-815e-4f0f-92c7-80ce586ad31d service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:03.581011 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a82c32d-815e-4f0f-92c7-80ce586ad31d service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:03.581744 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a82c32d-815e-4f0f-92c7-80ce586ad31d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:03.585468 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-8a82c32d-815e-4f0f-92c7-80ce586ad31d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:03.595291 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:04:03.606864 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-af7cf82c-e7ab-4387-8d34-d3fce085d5d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5f1ea65bca7451980df77d26068d3dc'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:03.619381 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-af7cf82c-e7ab-4387-8d34-d3fce085d5d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5f1ea65bca7451980df77d26068d3dc'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:03.661175 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-af7cf82c-e7ab-4387-8d34-d3fce085d5d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5f1ea65bca7451980df77d26068d3dc'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:03.662794 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-af7cf82c-e7ab-4387-8d34-d3fce085d5d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5f1ea65bca7451980df77d26068d3dc'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:03.663636 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-af7cf82c-e7ab-4387-8d34-d3fce085d5d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5f1ea65bca7451980df77d26068d3dc'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:03.685211 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a82c32d-815e-4f0f-92c7-80ce586ad31d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:03.686368 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a82c32d-815e-4f0f-92c7-80ce586ad31d service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:03.696919 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1012/2016] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:04:03 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:04:03.697622 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a82c32d-815e-4f0f-92c7-80ce586ad31d service cinder] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:03.698922 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-8a82c32d-815e-4f0f-92c7-80ce586ad31d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:03.713212 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1005/2017] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 10 10:04:03 2022] DELETE /identity/v3/users/a5f1ea65bca7451980df77d26068d3dc => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:04:03.716072 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a82c32d-815e-4f0f-92c7-80ce586ad31d service cinder] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:03.848989 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d690ddfa-a204-4861-a1cf-b4dd439d25b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:03.851139 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d690ddfa-a204-4861-a1cf-b4dd439d25b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:03.851702 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d690ddfa-a204-4861-a1cf-b4dd439d25b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:03.852113 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d690ddfa-a204-4861-a1cf-b4dd439d25b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:03.852939 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d690ddfa-a204-4861-a1cf-b4dd439d25b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:03.855968 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d690ddfa-a204-4861-a1cf-b4dd439d25b7 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:03.859649 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:04:03.873374 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1013/2018] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:04:03 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:04:03.877217 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7cf82c-e7ab-4387-8d34-d3fce085d5d7 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:03.879635 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-af7cf82c-e7ab-4387-8d34-d3fce085d5d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:03.896929 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7cf82c-e7ab-4387-8d34-d3fce085d5d7 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:03.908922 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff54a24-711c-40fc-b675-ec885a13269d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:03.909730 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff54a24-711c-40fc-b675-ec885a13269d admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:03.910843 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff54a24-711c-40fc-b675-ec885a13269d admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:03.910843 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff54a24-711c-40fc-b675-ec885a13269d admin admin] PATH_INFO: `/v3/projects/8b5294d83da24048a9c70882df2320ba/users/e5172b1d41db4f7ea707126469306a64/roles/8daabcb6b7394e39b06a3453e33e32db` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:03.932196 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff54a24-711c-40fc-b675-ec885a13269d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b5294d83da24048a9c70882df2320ba, user_id=e5172b1d41db4f7ea707126469306a64, role_id=8daabcb6b7394e39b06a3453e33e32db)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:03.935766 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff54a24-711c-40fc-b675-ec885a13269d admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:03.963802 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1006/2019] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:04:03 2022] PUT /identity/v3/projects/8b5294d83da24048a9c70882df2320ba/users/e5172b1d41db4f7ea707126469306a64/roles/8daabcb6b7394e39b06a3453e33e32db => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:04:03.966220 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4932fa-d458-4115-9e23-ffb1741de9d0 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:03.966563 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4932fa-d458-4115-9e23-ffb1741de9d0 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:03.966842 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4932fa-d458-4115-9e23-ffb1741de9d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:04.005281 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-6a4932fa-d458-4115-9e23-ffb1741de9d0 None None] MFA Rules not processed for user `e5172b1d41db4f7ea707126469306a64`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:04:04.006556 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-6a4932fa-d458-4115-9e23-ffb1741de9d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:04.111059 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1014/2020] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:04:03 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 10:04:04.116048 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff54a24-711c-40fc-b675-ec885a13269d admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:04.196859 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff54a24-711c-40fc-b675-ec885a13269d admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:04.203048 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2acdbe3-caa5-41d4-80de-fb00956cd4c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:04.203896 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2acdbe3-caa5-41d4-80de-fb00956cd4c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:04.204276 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2acdbe3-caa5-41d4-80de-fb00956cd4c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:04.204644 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2acdbe3-caa5-41d4-80de-fb00956cd4c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:04.205477 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2acdbe3-caa5-41d4-80de-fb00956cd4c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:04.207673 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2acdbe3-caa5-41d4-80de-fb00956cd4c1 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:04.243815 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1007/2021] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 10 10:04:04 2022] POST /identity/v3/projects => generated 383 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:04:04.248023 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4932fa-d458-4115-9e23-ffb1741de9d0 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:04.261227 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4932fa-d458-4115-9e23-ffb1741de9d0 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:04.370761 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a522d20a-6f4e-4ecb-bf68-792b91163ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:04.371947 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a522d20a-6f4e-4ecb-bf68-792b91163ac8 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:04.372460 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a522d20a-6f4e-4ecb-bf68-792b91163ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:04.373408 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a522d20a-6f4e-4ecb-bf68-792b91163ac8 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:04.374266 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a522d20a-6f4e-4ecb-bf68-792b91163ac8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:04.376634 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a522d20a-6f4e-4ecb-bf68-792b91163ac8 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:04.425493 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1015/2022] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 10 10:04:04 2022] POST /identity/v3/users => generated 292 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:04:04.429360 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2acdbe3-caa5-41d4-80de-fb00956cd4c1 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:04.455990 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2acdbe3-caa5-41d4-80de-fb00956cd4c1 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:04.455990 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0f2200-e25e-4941-bf05-dcec7cdc4256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:04.455990 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f2200-e25e-4941-bf05-dcec7cdc4256 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:04.455990 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f2200-e25e-4941-bf05-dcec7cdc4256 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:04.456474 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f2200-e25e-4941-bf05-dcec7cdc4256 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:04.456474 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0f2200-e25e-4941-bf05-dcec7cdc4256 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:04.456474 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0f2200-e25e-4941-bf05-dcec7cdc4256 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:04.468263 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1008/2023] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:04:04 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 10:04:04.473297 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a522d20a-6f4e-4ecb-bf68-792b91163ac8 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:04.487366 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a522d20a-6f4e-4ecb-bf68-792b91163ac8 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:04.498896 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7108322f-9d0b-4521-82d7-6ff30a531780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:04.499506 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7108322f-9d0b-4521-82d7-6ff30a531780 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:04.499789 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7108322f-9d0b-4521-82d7-6ff30a531780 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:04.500062 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7108322f-9d0b-4521-82d7-6ff30a531780 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:04.500727 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7108322f-9d0b-4521-82d7-6ff30a531780 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:04.502359 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7108322f-9d0b-4521-82d7-6ff30a531780 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:04.525379 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1016/2024] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:04:04 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:04:04.533088 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0f2200-e25e-4941-bf05-dcec7cdc4256 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:04.545887 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0f2200-e25e-4941-bf05-dcec7cdc4256 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:04.559945 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16591602-0e47-4ac9-a585-6f0166caccd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:04.560646 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16591602-0e47-4ac9-a585-6f0166caccd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:04.560931 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16591602-0e47-4ac9-a585-6f0166caccd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:04.561240 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16591602-0e47-4ac9-a585-6f0166caccd0 admin admin] PATH_INFO: `/v3/projects/210e7b21e6534787aded9e1d5b2d9d9a/users/f6771eaec9e14ae3b48ded349b6665c5/roles/8daabcb6b7394e39b06a3453e33e32db` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:04.579998 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16591602-0e47-4ac9-a585-6f0166caccd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=210e7b21e6534787aded9e1d5b2d9d9a, user_id=f6771eaec9e14ae3b48ded349b6665c5, role_id=8daabcb6b7394e39b06a3453e33e32db)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:04.587077 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16591602-0e47-4ac9-a585-6f0166caccd0 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:04.620127 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1009/2025] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:04:04 2022] PUT /identity/v3/projects/210e7b21e6534787aded9e1d5b2d9d9a/users/f6771eaec9e14ae3b48ded349b6665c5/roles/8daabcb6b7394e39b06a3453e33e32db => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 10:04:04.631130 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d3022-5d2c-4995-8db3-dcf7250e41af None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:04.631423 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d3022-5d2c-4995-8db3-dcf7250e41af None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:04.631704 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d3022-5d2c-4995-8db3-dcf7250e41af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:04.672868 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-6a6d3022-5d2c-4995-8db3-dcf7250e41af None None] MFA Rules not processed for user `f6771eaec9e14ae3b48ded349b6665c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:04:04.677172 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-6a6d3022-5d2c-4995-8db3-dcf7250e41af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:04.715398 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16591602-0e47-4ac9-a585-6f0166caccd0 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:04.717884 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-16591602-0e47-4ac9-a585-6f0166caccd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:04.812798 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:04:04.833728 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:04:04.850985 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16591602-0e47-4ac9-a585-6f0166caccd0 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:04.856582 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ed666d-3922-41ee-9774-baaa690dda70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:04.857345 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ed666d-3922-41ee-9774-baaa690dda70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:04.857609 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ed666d-3922-41ee-9774-baaa690dda70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:04.857886 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ed666d-3922-41ee-9774-baaa690dda70 admin admin] PATH_INFO: `/v3/projects/32ab71f69b7642c78af2c17dfd8e2373` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:04.859253 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ed666d-3922-41ee-9774-baaa690dda70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32ab71f69b7642c78af2c17dfd8e2373)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:04.861054 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ed666d-3922-41ee-9774-baaa690dda70 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:04.863371 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1017/2026] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:04:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:04:04.868875 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6d3022-5d2c-4995-8db3-dcf7250e41af None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:04.892823 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6d3022-5d2c-4995-8db3-dcf7250e41af None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:04.904508 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2c7719-359e-495b-8eb4-67b69025811d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:04.905209 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2c7719-359e-495b-8eb4-67b69025811d admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:04.905500 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2c7719-359e-495b-8eb4-67b69025811d admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:04.905774 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2c7719-359e-495b-8eb4-67b69025811d admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:04.906856 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2c7719-359e-495b-8eb4-67b69025811d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:04.913120 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2c7719-359e-495b-8eb4-67b69025811d admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:04.946043 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-60ed666d-3922-41ee-9774-baaa690dda70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32ab71f69b7642c78af2c17dfd8e2373', 'request_id': 'req-60ed666d-3922-41ee-9774-baaa690dda70'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:04.952455 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-60ed666d-3922-41ee-9774-baaa690dda70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32ab71f69b7642c78af2c17dfd8e2373', 'request_id': 'req-60ed666d-3922-41ee-9774-baaa690dda70'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:04.963669 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-60ed666d-3922-41ee-9774-baaa690dda70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32ab71f69b7642c78af2c17dfd8e2373', 'request_id': 'req-60ed666d-3922-41ee-9774-baaa690dda70'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:04.981649 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-60ed666d-3922-41ee-9774-baaa690dda70 admin admin] The token cache is being invalidate because project 32ab71f69b7642c78af2c17dfd8e2373 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 10:04:04.981649 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-60ed666d-3922-41ee-9774-baaa690dda70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:04.982417 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-60ed666d-3922-41ee-9774-baaa690dda70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:04.986930 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1010/2027] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 10 10:04:04 2022] DELETE /identity/v3/projects/32ab71f69b7642c78af2c17dfd8e2373 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 10:04:04.991894 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13402e14-85c3-40c5-936a-22129ad7549f None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:04.995223 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13402e14-85c3-40c5-936a-22129ad7549f None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:04.995383 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13402e14-85c3-40c5-936a-22129ad7549f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:05.000966 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1018/2028] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 10 10:04:04 2022] POST /identity/v3/projects => generated 383 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:04:05.002475 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2c7719-359e-495b-8eb4-67b69025811d admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:05.004942 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-af2c7719-359e-495b-8eb4-67b69025811d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:05.018721 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-13402e14-85c3-40c5-936a-22129ad7549f None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:04:05.020226 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-13402e14-85c3-40c5-936a-22129ad7549f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:05.101290 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2c7719-359e-495b-8eb4-67b69025811d admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:05.111557 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcc5ee0-0a2a-43b2-9e13-0396d2118e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:05.112380 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcc5ee0-0a2a-43b2-9e13-0396d2118e43 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:05.112783 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcc5ee0-0a2a-43b2-9e13-0396d2118e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:05.113190 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcc5ee0-0a2a-43b2-9e13-0396d2118e43 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:05.113950 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcc5ee0-0a2a-43b2-9e13-0396d2118e43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:05.116174 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcc5ee0-0a2a-43b2-9e13-0396d2118e43 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:05.127993 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1011/2029] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:04:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:04:05.139605 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b397b2fe-0fe7-4033-bc0d-1a5f342fcf6d None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:05.139985 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b397b2fe-0fe7-4033-bc0d-1a5f342fcf6d None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:05.140273 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b397b2fe-0fe7-4033-bc0d-1a5f342fcf6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:05.166288 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-b397b2fe-0fe7-4033-bc0d-1a5f342fcf6d None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:04:05.169281 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1019/2030] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 10 10:04:05 2022] POST /identity/v3/users => generated 298 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:04:05.172340 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-b397b2fe-0fe7-4033-bc0d-1a5f342fcf6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:05.173945 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcc5ee0-0a2a-43b2-9e13-0396d2118e43 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:05.183455 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1012/2031] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:04:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:04:05.188182 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b397b2fe-0fe7-4033-bc0d-1a5f342fcf6d None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:05.197050 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcc5ee0-0a2a-43b2-9e13-0396d2118e43 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:05.202279 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157b8a81-245d-422b-a177-68231637754b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:05.204168 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b397b2fe-0fe7-4033-bc0d-1a5f342fcf6d None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:05.205260 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b8a81-245d-422b-a177-68231637754b admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:05.205599 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b8a81-245d-422b-a177-68231637754b admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:05.205994 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b8a81-245d-422b-a177-68231637754b admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:05.206790 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157b8a81-245d-422b-a177-68231637754b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:05.208536 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157b8a81-245d-422b-a177-68231637754b admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:05.218127 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0115d4-8bf2-42bf-af80-878e353bb0d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:05.218768 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0115d4-8bf2-42bf-af80-878e353bb0d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:05.219079 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0115d4-8bf2-42bf-af80-878e353bb0d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:05.219354 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0115d4-8bf2-42bf-af80-878e353bb0d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:05.220022 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0115d4-8bf2-42bf-af80-878e353bb0d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:04:05.220327 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0115d4-8bf2-42bf-af80-878e353bb0d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:05.222374 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0115d4-8bf2-42bf-af80-878e353bb0d0 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:05.225867 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1020/2032] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:04:05 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:04:05.229638 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157b8a81-245d-422b-a177-68231637754b admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:05.239525 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1013/2033] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 10 10:04:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:04:05.241946 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157b8a81-245d-422b-a177-68231637754b admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:05.243275 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0115d4-8bf2-42bf-af80-878e353bb0d0 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:05.248525 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc0bd3a-f5bb-4bc8-a735-8f5bbd414f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:05.250001 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc0bd3a-f5bb-4bc8-a735-8f5bbd414f5a admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:05.250001 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc0bd3a-f5bb-4bc8-a735-8f5bbd414f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:05.250822 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc0bd3a-f5bb-4bc8-a735-8f5bbd414f5a admin admin] PATH_INFO: `/v3/projects/fffae5366736479195cbfb5bd4d10e9b/users/5a80e21b90104c2c9a8937e57d0ab1d0/roles/eb04edc46b3742d7a0f0ead26f68bc22` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:05.262092 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0115d4-8bf2-42bf-af80-878e353bb0d0 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:05.270469 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc0bd3a-f5bb-4bc8-a735-8f5bbd414f5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fffae5366736479195cbfb5bd4d10e9b, user_id=5a80e21b90104c2c9a8937e57d0ab1d0, role_id=eb04edc46b3742d7a0f0ead26f68bc22)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:05.271273 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ddc421-a521-4c16-b52c-4118cf636039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:05.272156 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ddc421-a521-4c16-b52c-4118cf636039 admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:05.274003 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc0bd3a-f5bb-4bc8-a735-8f5bbd414f5a admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:05.275875 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ddc421-a521-4c16-b52c-4118cf636039 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:05.276222 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ddc421-a521-4c16-b52c-4118cf636039 admin admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:05.276896 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ddc421-a521-4c16-b52c-4118cf636039 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:05.279196 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ddc421-a521-4c16-b52c-4118cf636039 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:05.294289 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1021/2034] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:04:05 2022] PUT /identity/v3/projects/fffae5366736479195cbfb5bd4d10e9b/users/5a80e21b90104c2c9a8937e57d0ab1d0/roles/eb04edc46b3742d7a0f0ead26f68bc22 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:04:05.297827 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc0bd3a-f5bb-4bc8-a735-8f5bbd414f5a admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:05.319990 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1014/2035] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 10 10:04:05 2022] POST /identity/v3/projects => generated 369 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:04:05.323820 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ddc421-a521-4c16-b52c-4118cf636039 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:05.367930 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:04:05.381845 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc0bd3a-f5bb-4bc8-a735-8f5bbd414f5a admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:05.408812 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ddc421-a521-4c16-b52c-4118cf636039 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:05.415137 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a74aa39-ac13-490f-b583-808b1a9d989d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:05.415883 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a74aa39-ac13-490f-b583-808b1a9d989d admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:05.416282 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a74aa39-ac13-490f-b583-808b1a9d989d admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:05.416825 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a74aa39-ac13-490f-b583-808b1a9d989d admin admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:05.417699 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a74aa39-ac13-490f-b583-808b1a9d989d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:05.419883 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a74aa39-ac13-490f-b583-808b1a9d989d admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:05.437048 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:04:05.470471 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1015/2036] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 10 10:04:05 2022] POST /identity/v3/users => generated 285 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 10:04:05.471485 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a74aa39-ac13-490f-b583-808b1a9d989d admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:05.492164 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a74aa39-ac13-490f-b583-808b1a9d989d admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:05.505626 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2e2686-4cf1-4f87-a9a6-d3ffee4bba60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:05.506315 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e2686-4cf1-4f87-a9a6-d3ffee4bba60 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:05.506532 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e2686-4cf1-4f87-a9a6-d3ffee4bba60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:05.506805 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e2686-4cf1-4f87-a9a6-d3ffee4bba60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:05.509353 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2e2686-4cf1-4f87-a9a6-d3ffee4bba60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:05.513324 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2e2686-4cf1-4f87-a9a6-d3ffee4bba60 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:05.517272 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8188a57e-c717-4ecd-91fa-7df0453384d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:05.518029 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8188a57e-c717-4ecd-91fa-7df0453384d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:05.519467 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8188a57e-c717-4ecd-91fa-7df0453384d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:05.522156 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8188a57e-c717-4ecd-91fa-7df0453384d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:05.523117 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8188a57e-c717-4ecd-91fa-7df0453384d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:05.527209 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8188a57e-c717-4ecd-91fa-7df0453384d0 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:05.534599 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1016/2037] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:04:05 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 10:04:05.539404 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2e2686-4cf1-4f87-a9a6-d3ffee4bba60 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:05.554298 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1022/2038] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:04:05 2022] GET /identity/v3/roles => generated 1420 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 10:04:05.559180 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8188a57e-c717-4ecd-91fa-7df0453384d0 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:05.564371 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2e2686-4cf1-4f87-a9a6-d3ffee4bba60 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:05.570504 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6877fcc-f609-4502-b07f-68079256b923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:05.571216 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6877fcc-f609-4502-b07f-68079256b923 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:05.571566 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6877fcc-f609-4502-b07f-68079256b923 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:05.572067 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6877fcc-f609-4502-b07f-68079256b923 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:05.572800 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6877fcc-f609-4502-b07f-68079256b923 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:05.574787 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6877fcc-f609-4502-b07f-68079256b923 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:05.587995 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1017/2039] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:04:05 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:04:05.593235 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8188a57e-c717-4ecd-91fa-7df0453384d0 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:05.593410 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6877fcc-f609-4502-b07f-68079256b923 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:05.618444 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6877fcc-f609-4502-b07f-68079256b923 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:05.619232 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c5cf38-6bec-44c2-8606-e503ce177743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:05.620111 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c5cf38-6bec-44c2-8606-e503ce177743 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:05.620402 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c5cf38-6bec-44c2-8606-e503ce177743 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:05.620671 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c5cf38-6bec-44c2-8606-e503ce177743 admin admin] PATH_INFO: `/v3/projects/fffae5366736479195cbfb5bd4d10e9b/users/5a80e21b90104c2c9a8937e57d0ab1d0/roles/eb04edc46b3742d7a0f0ead26f68bc22` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:05.627940 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c5cf38-6bec-44c2-8606-e503ce177743 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fffae5366736479195cbfb5bd4d10e9b, user_id=5a80e21b90104c2c9a8937e57d0ab1d0, role_id=eb04edc46b3742d7a0f0ead26f68bc22)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:05.635939 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c5cf38-6bec-44c2-8606-e503ce177743 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:05.651168 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9fe53d-98e5-4a8f-9714-6b687a98b551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:05.652411 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9fe53d-98e5-4a8f-9714-6b687a98b551 admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:05.652858 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9fe53d-98e5-4a8f-9714-6b687a98b551 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:05.653314 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9fe53d-98e5-4a8f-9714-6b687a98b551 admin admin] PATH_INFO: `/v3/projects/8877482e038340e888886276ad127c9a/users/d0f9dd6412c24b37bc7246749f172734/roles/8daabcb6b7394e39b06a3453e33e32db` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:05.676439 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1023/2040] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:04:05 2022] PUT /identity/v3/projects/fffae5366736479195cbfb5bd4d10e9b/users/5a80e21b90104c2c9a8937e57d0ab1d0/roles/eb04edc46b3742d7a0f0ead26f68bc22 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:04:05.677043 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2517ad59-ffc9-4f70-9825-f7799edf64b9 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:05.677350 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2517ad59-ffc9-4f70-9825-f7799edf64b9 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:05.677625 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2517ad59-ffc9-4f70-9825-f7799edf64b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:05.726487 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9fe53d-98e5-4a8f-9714-6b687a98b551 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8877482e038340e888886276ad127c9a, user_id=d0f9dd6412c24b37bc7246749f172734, role_id=8daabcb6b7394e39b06a3453e33e32db)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:05.737600 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9fe53d-98e5-4a8f-9714-6b687a98b551 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:05.760578 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-2517ad59-ffc9-4f70-9825-f7799edf64b9 None None] MFA Rules not processed for user `5a80e21b90104c2c9a8937e57d0ab1d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:04:05.765415 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-2517ad59-ffc9-4f70-9825-f7799edf64b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:05.812582 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1018/2041] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:04:05 2022] PUT /identity/v3/projects/8877482e038340e888886276ad127c9a/users/d0f9dd6412c24b37bc7246749f172734/roles/8daabcb6b7394e39b06a3453e33e32db => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:04:05.823732 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9acc071-faf2-4a97-beef-f759cb4d9320 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:05.824355 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9acc071-faf2-4a97-beef-f759cb4d9320 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:05.825805 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9acc071-faf2-4a97-beef-f759cb4d9320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:05.875322 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-c9acc071-faf2-4a97-beef-f759cb4d9320 None None] MFA Rules not processed for user `d0f9dd6412c24b37bc7246749f172734`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:04:05.876887 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-c9acc071-faf2-4a97-beef-f759cb4d9320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:06.019805 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1024/2042] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:04:05 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:04:06.030615 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1019/2043] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:04:05 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:04:06.033892 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2517ad59-ffc9-4f70-9825-f7799edf64b9 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:06.035472 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9acc071-faf2-4a97-beef-f759cb4d9320 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:06.038195 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-2517ad59-ffc9-4f70-9825-f7799edf64b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:06.204097 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2517ad59-ffc9-4f70-9825-f7799edf64b9 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:06.218042 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaa99dc-33a4-4058-8cf4-32352eb26b5c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf8e725cbe0403d943b136235eac057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:06.219020 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaa99dc-33a4-4058-8cf4-32352eb26b5c service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:06.220488 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaa99dc-33a4-4058-8cf4-32352eb26b5c service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:06.222443 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9acc071-faf2-4a97-beef-f759cb4d9320 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:06.223349 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaa99dc-33a4-4058-8cf4-32352eb26b5c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:06.227358 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-7eaa99dc-33a4-4058-8cf4-32352eb26b5c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:06.238391 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b578e2ff-51f7-4636-9741-609481550806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:06.240199 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b578e2ff-51f7-4636-9741-609481550806 admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:06.240494 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b578e2ff-51f7-4636-9741-609481550806 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:06.240771 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b578e2ff-51f7-4636-9741-609481550806 admin admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:06.241461 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b578e2ff-51f7-4636-9741-609481550806 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:06.246173 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b578e2ff-51f7-4636-9741-609481550806 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:06.284164 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:04:06.325154 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1020/2044] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 10 10:04:06 2022] POST /identity/v3/projects => generated 367 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:04:06.332904 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b578e2ff-51f7-4636-9741-609481550806 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:06.433656 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaa99dc-33a4-4058-8cf4-32352eb26b5c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:06.439542 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaa99dc-33a4-4058-8cf4-32352eb26b5c service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:06.447691 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:04:06.463725 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1025/2045] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:04:06 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:04:06.503272 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b578e2ff-51f7-4636-9741-609481550806 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:06.516818 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ab5e75-22ae-40b9-9406-a93bc5f2c24c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:06.516818 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ab5e75-22ae-40b9-9406-a93bc5f2c24c admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:06.516818 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ab5e75-22ae-40b9-9406-a93bc5f2c24c admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:06.516818 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ab5e75-22ae-40b9-9406-a93bc5f2c24c admin admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:06.517157 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ab5e75-22ae-40b9-9406-a93bc5f2c24c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:06.521103 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ab5e75-22ae-40b9-9406-a93bc5f2c24c admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:06.556584 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1021/2046] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 10 10:04:06 2022] POST /identity/v3/users => generated 290 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:04:06.560542 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaa99dc-33a4-4058-8cf4-32352eb26b5c service cinder] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:06.589938 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaa99dc-33a4-4058-8cf4-32352eb26b5c service cinder] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:06.600777 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de18058-cb31-4214-9c4c-59080ce0ad66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:06.601896 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de18058-cb31-4214-9c4c-59080ce0ad66 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:06.602406 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de18058-cb31-4214-9c4c-59080ce0ad66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:06.603128 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de18058-cb31-4214-9c4c-59080ce0ad66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:06.604017 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de18058-cb31-4214-9c4c-59080ce0ad66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:06.606013 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de18058-cb31-4214-9c4c-59080ce0ad66 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:06.624445 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1026/2047] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:04:06 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 10:04:06.628654 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ab5e75-22ae-40b9-9406-a93bc5f2c24c admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:06.644988 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ab5e75-22ae-40b9-9406-a93bc5f2c24c admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:06.658785 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cebbe87-dff7-41c6-813d-e866c604752d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:06.659414 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cebbe87-dff7-41c6-813d-e866c604752d admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:06.659702 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cebbe87-dff7-41c6-813d-e866c604752d admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:06.659981 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cebbe87-dff7-41c6-813d-e866c604752d admin admin] PATH_INFO: `/v3/projects/8570914b7c904fe78a21c05b38497749/users/0c712ed17f4b4e13ba9628ab54b8d806/roles/eb04edc46b3742d7a0f0ead26f68bc22` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:06.703481 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cebbe87-dff7-41c6-813d-e866c604752d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8570914b7c904fe78a21c05b38497749, user_id=0c712ed17f4b4e13ba9628ab54b8d806, role_id=eb04edc46b3742d7a0f0ead26f68bc22)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:06.706576 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cebbe87-dff7-41c6-813d-e866c604752d admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:06.734439 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1022/2048] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:04:06 2022] PUT /identity/v3/projects/8570914b7c904fe78a21c05b38497749/users/0c712ed17f4b4e13ba9628ab54b8d806/roles/eb04edc46b3742d7a0f0ead26f68bc22 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:04:06.738881 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de18058-cb31-4214-9c4c-59080ce0ad66 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:06.753533 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de18058-cb31-4214-9c4c-59080ce0ad66 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:06.907512 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556283fd-708c-4849-9029-39ef3e7f7aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:06.908153 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556283fd-708c-4849-9029-39ef3e7f7aae admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:06.908432 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556283fd-708c-4849-9029-39ef3e7f7aae admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:06.908708 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556283fd-708c-4849-9029-39ef3e7f7aae admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:06.909400 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556283fd-708c-4849-9029-39ef3e7f7aae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:06.912877 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556283fd-708c-4849-9029-39ef3e7f7aae admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:06.951277 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cebbe87-dff7-41c6-813d-e866c604752d admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:06.954819 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1027/2049] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:04:06 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:04:06.955868 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556283fd-708c-4849-9029-39ef3e7f7aae admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:06.971897 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-4cebbe87-dff7-41c6-813d-e866c604752d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:06.990538 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556283fd-708c-4849-9029-39ef3e7f7aae admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:06.996093 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cebbe87-dff7-41c6-813d-e866c604752d admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:07.002696 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef0d478-4644-4d8c-92b9-67f534426867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:07.004539 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef0d478-4644-4d8c-92b9-67f534426867 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:07.004930 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef0d478-4644-4d8c-92b9-67f534426867 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:07.005230 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef0d478-4644-4d8c-92b9-67f534426867 admin admin] PATH_INFO: `/v3/projects/8570914b7c904fe78a21c05b38497749/users/0c712ed17f4b4e13ba9628ab54b8d806/roles/eb04edc46b3742d7a0f0ead26f68bc22` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:07.005343 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fde0498-e75b-48d6-b07a-7a08e4af3489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:07.006130 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fde0498-e75b-48d6-b07a-7a08e4af3489 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:07.006681 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fde0498-e75b-48d6-b07a-7a08e4af3489 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:07.007113 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fde0498-e75b-48d6-b07a-7a08e4af3489 admin admin] PATH_INFO: `/v3/users/80dbeefbcc5849b1aaf040f02e5cb350` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:07.008733 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fde0498-e75b-48d6-b07a-7a08e4af3489 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80dbeefbcc5849b1aaf040f02e5cb350)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:07.010910 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fde0498-e75b-48d6-b07a-7a08e4af3489 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:07.011142 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef0d478-4644-4d8c-92b9-67f534426867 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8570914b7c904fe78a21c05b38497749, user_id=0c712ed17f4b4e13ba9628ab54b8d806, role_id=eb04edc46b3742d7a0f0ead26f68bc22)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:07.017296 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef0d478-4644-4d8c-92b9-67f534426867 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:07.062088 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1028/2050] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:04:06 2022] PUT /identity/v3/projects/8570914b7c904fe78a21c05b38497749/users/0c712ed17f4b4e13ba9628ab54b8d806/roles/eb04edc46b3742d7a0f0ead26f68bc22 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:04:07.071396 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68468689-8d98-4e1b-b963-a8fb5f4a43d5 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:07.071734 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68468689-8d98-4e1b-b963-a8fb5f4a43d5 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:07.072052 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68468689-8d98-4e1b-b963-a8fb5f4a43d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:07.112865 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-68468689-8d98-4e1b-b963-a8fb5f4a43d5 None None] MFA Rules not processed for user `0c712ed17f4b4e13ba9628ab54b8d806`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:04:07.114424 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-68468689-8d98-4e1b-b963-a8fb5f4a43d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:07.122759 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-8fde0498-e75b-48d6-b07a-7a08e4af3489 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80dbeefbcc5849b1aaf040f02e5cb350'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:07.139257 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-8fde0498-e75b-48d6-b07a-7a08e4af3489 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80dbeefbcc5849b1aaf040f02e5cb350'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:07.155474 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-8fde0498-e75b-48d6-b07a-7a08e4af3489 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80dbeefbcc5849b1aaf040f02e5cb350'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:07.156694 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-8fde0498-e75b-48d6-b07a-7a08e4af3489 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80dbeefbcc5849b1aaf040f02e5cb350'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:07.157846 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-8fde0498-e75b-48d6-b07a-7a08e4af3489 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80dbeefbcc5849b1aaf040f02e5cb350'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:07.179351 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1023/2051] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 10 10:04:06 2022] DELETE /identity/v3/users/80dbeefbcc5849b1aaf040f02e5cb350 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:04:07.184383 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b01342-c8f7-4448-a934-939fa2c569b4 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:07.184820 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b01342-c8f7-4448-a934-939fa2c569b4 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:07.185209 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b01342-c8f7-4448-a934-939fa2c569b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:07.216291 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-71b01342-c8f7-4448-a934-939fa2c569b4 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:04:07.217696 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-71b01342-c8f7-4448-a934-939fa2c569b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:07.225266 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1029/2052] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:04:07 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:04:07.238191 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68468689-8d98-4e1b-b963-a8fb5f4a43d5 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:07.239797 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-68468689-8d98-4e1b-b963-a8fb5f4a43d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:07.252775 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=84,keystone:INSERT=6,keystone:DELETE=10 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:04:07.301574 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1024/2053] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:04:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 10:04:07.311886 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b01342-c8f7-4448-a934-939fa2c569b4 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:07.315071 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68468689-8d98-4e1b-b963-a8fb5f4a43d5 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:07.316407 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-71b01342-c8f7-4448-a934-939fa2c569b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:07.327839 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:04:07.375098 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f84643c-18e8-4d93-8c71-56dd0998bb15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf8e725cbe0403d943b136235eac057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:07.375730 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f84643c-18e8-4d93-8c71-56dd0998bb15 service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:07.375992 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f84643c-18e8-4d93-8c71-56dd0998bb15 service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:07.376265 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f84643c-18e8-4d93-8c71-56dd0998bb15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:07.392662 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b01342-c8f7-4448-a934-939fa2c569b4 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:07.396333 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d5b987-f8df-4674-9d8a-ec7bd2b62314 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4294c170df354fe892831281acd4ea7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:07.396932 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d5b987-f8df-4674-9d8a-ec7bd2b62314 service neutron] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:07.397243 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d5b987-f8df-4674-9d8a-ec7bd2b62314 service neutron] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:07.397512 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d5b987-f8df-4674-9d8a-ec7bd2b62314 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:07.407522 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d5b987-f8df-4674-9d8a-ec7bd2b62314 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:07.409007 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d5b987-f8df-4674-9d8a-ec7bd2b62314 service neutron] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:07.420057 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1025/2054] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:04:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:04:07.440366 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f84643c-18e8-4d93-8c71-56dd0998bb15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:07.441881 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f84643c-18e8-4d93-8c71-56dd0998bb15 service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:07.451835 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1030/2055] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:04:07 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:04:07.506199 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d5b987-f8df-4674-9d8a-ec7bd2b62314 service neutron] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:07.508245 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-25d5b987-f8df-4674-9d8a-ec7bd2b62314 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:07.521447 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d5b987-f8df-4674-9d8a-ec7bd2b62314 service neutron] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:07.525754 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4545e9cc-0bb0-43b9-ab0c-3e9b12756be2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf8e725cbe0403d943b136235eac057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:07.526430 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4545e9cc-0bb0-43b9-ab0c-3e9b12756be2 service cinder] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:07.526709 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4545e9cc-0bb0-43b9-ab0c-3e9b12756be2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:07.526977 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4545e9cc-0bb0-43b9-ab0c-3e9b12756be2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:07.529039 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-4545e9cc-0bb0-43b9-ab0c-3e9b12756be2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:07.598602 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4545e9cc-0bb0-43b9-ab0c-3e9b12756be2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:07.600116 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4545e9cc-0bb0-43b9-ab0c-3e9b12756be2 service cinder] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:07.626540 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1026/2056] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:04:07 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:04:08.293254 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f84643c-18e8-4d93-8c71-56dd0998bb15 service cinder] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:08.294258 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4545e9cc-0bb0-43b9-ab0c-3e9b12756be2 service cinder] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:08.295829 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-4545e9cc-0bb0-43b9-ab0c-3e9b12756be2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:08.303215 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f84643c-18e8-4d93-8c71-56dd0998bb15 service cinder] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:08.307317 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300d68c7-b0a0-47b1-bacb-9a2e7003eb8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf8e725cbe0403d943b136235eac057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:08.307929 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300d68c7-b0a0-47b1-bacb-9a2e7003eb8d service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:08.308212 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300d68c7-b0a0-47b1-bacb-9a2e7003eb8d service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:08.308479 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300d68c7-b0a0-47b1-bacb-9a2e7003eb8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:08.310340 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-300d68c7-b0a0-47b1-bacb-9a2e7003eb8d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:08.310852 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4545e9cc-0bb0-43b9-ab0c-3e9b12756be2 service cinder] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:08.315489 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f807f286-95be-4bf7-8247-5f787b9f3a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:08.316337 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f807f286-95be-4bf7-8247-5f787b9f3a12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:08.316619 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f807f286-95be-4bf7-8247-5f787b9f3a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:08.316889 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f807f286-95be-4bf7-8247-5f787b9f3a12 admin admin] PATH_INFO: `/v3/projects/12c28a5bd27943d0925963c84b4e6d28` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:08.318060 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f807f286-95be-4bf7-8247-5f787b9f3a12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12c28a5bd27943d0925963c84b4e6d28)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:08.320096 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f807f286-95be-4bf7-8247-5f787b9f3a12 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:08.384583 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-f807f286-95be-4bf7-8247-5f787b9f3a12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12c28a5bd27943d0925963c84b4e6d28', 'request_id': 'req-f807f286-95be-4bf7-8247-5f787b9f3a12'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:08.390708 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-f807f286-95be-4bf7-8247-5f787b9f3a12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12c28a5bd27943d0925963c84b4e6d28', 'request_id': 'req-f807f286-95be-4bf7-8247-5f787b9f3a12'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:08.399458 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300d68c7-b0a0-47b1-bacb-9a2e7003eb8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:08.400570 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300d68c7-b0a0-47b1-bacb-9a2e7003eb8d service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:08.408088 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-f807f286-95be-4bf7-8247-5f787b9f3a12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12c28a5bd27943d0925963c84b4e6d28', 'request_id': 'req-f807f286-95be-4bf7-8247-5f787b9f3a12'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:08.410674 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:04:08.411904 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1031/2057] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:04:08 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:04:08.426411 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-f807f286-95be-4bf7-8247-5f787b9f3a12 admin admin] The token cache is being invalidate because project 12c28a5bd27943d0925963c84b4e6d28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 10:04:08.426752 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-f807f286-95be-4bf7-8247-5f787b9f3a12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:08.427599 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-f807f286-95be-4bf7-8247-5f787b9f3a12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:08.429707 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1027/2058] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 10 10:04:08 2022] DELETE /identity/v3/projects/12c28a5bd27943d0925963c84b4e6d28 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:04:08.434277 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300d68c7-b0a0-47b1-bacb-9a2e7003eb8d service cinder] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:08.445898 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300d68c7-b0a0-47b1-bacb-9a2e7003eb8d service cinder] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:08.502874 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5e0853-b0d9-4c21-b63b-387ea7713978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:08.503967 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5e0853-b0d9-4c21-b63b-387ea7713978 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:08.504239 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5e0853-b0d9-4c21-b63b-387ea7713978 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:08.504507 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5e0853-b0d9-4c21-b63b-387ea7713978 admin admin] PATH_INFO: `/v3/users/125a918c795a4a9f8d6516af94ce92b0` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:08.505834 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5e0853-b0d9-4c21-b63b-387ea7713978 admin admin] RBAC: Authorizing `identity:delete_user(user_id=125a918c795a4a9f8d6516af94ce92b0)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:08.507858 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5e0853-b0d9-4c21-b63b-387ea7713978 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:08.510061 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:04:08.577177 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-9b5e0853-b0d9-4c21-b63b-387ea7713978 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '125a918c795a4a9f8d6516af94ce92b0'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:08.586928 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-9b5e0853-b0d9-4c21-b63b-387ea7713978 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '125a918c795a4a9f8d6516af94ce92b0'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:08.588514 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-9b5e0853-b0d9-4c21-b63b-387ea7713978 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '125a918c795a4a9f8d6516af94ce92b0'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:08.591004 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-9b5e0853-b0d9-4c21-b63b-387ea7713978 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '125a918c795a4a9f8d6516af94ce92b0'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:08.599289 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-9b5e0853-b0d9-4c21-b63b-387ea7713978 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '125a918c795a4a9f8d6516af94ce92b0'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:08.617493 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1032/2059] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 10 10:04:08 2022] DELETE /identity/v3/users/125a918c795a4a9f8d6516af94ce92b0 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:04:09.025387 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f807f286-95be-4bf7-8247-5f787b9f3a12 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:09.026964 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-f807f286-95be-4bf7-8247-5f787b9f3a12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:09.041300 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f807f286-95be-4bf7-8247-5f787b9f3a12 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:09.075745 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5e0853-b0d9-4c21-b63b-387ea7713978 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:09.077708 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-9b5e0853-b0d9-4c21-b63b-387ea7713978 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:09.139071 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cdbc9d-87e9-41a6-ba3b-6f157adeb30b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:09.140119 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cdbc9d-87e9-41a6-ba3b-6f157adeb30b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:09.140600 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cdbc9d-87e9-41a6-ba3b-6f157adeb30b admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:09.140968 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cdbc9d-87e9-41a6-ba3b-6f157adeb30b admin admin] PATH_INFO: `/v3/projects/c81f5f013a3e462c81d6cc30aa0775c3` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:09.142153 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cdbc9d-87e9-41a6-ba3b-6f157adeb30b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c81f5f013a3e462c81d6cc30aa0775c3)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:09.145144 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cdbc9d-87e9-41a6-ba3b-6f157adeb30b admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:09.170597 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5e0853-b0d9-4c21-b63b-387ea7713978 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:09.175633 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bec72d2-98b2-4ca5-8487-fd17d6f3b88d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf8e725cbe0403d943b136235eac057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:09.177238 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bec72d2-98b2-4ca5-8487-fd17d6f3b88d service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:09.177689 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bec72d2-98b2-4ca5-8487-fd17d6f3b88d service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:09.178104 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bec72d2-98b2-4ca5-8487-fd17d6f3b88d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:09.180438 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-9bec72d2-98b2-4ca5-8487-fd17d6f3b88d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:09.217936 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-77cdbc9d-87e9-41a6-ba3b-6f157adeb30b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c81f5f013a3e462c81d6cc30aa0775c3', 'request_id': 'req-77cdbc9d-87e9-41a6-ba3b-6f157adeb30b'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:09.225512 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-77cdbc9d-87e9-41a6-ba3b-6f157adeb30b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c81f5f013a3e462c81d6cc30aa0775c3', 'request_id': 'req-77cdbc9d-87e9-41a6-ba3b-6f157adeb30b'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:09.246622 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-77cdbc9d-87e9-41a6-ba3b-6f157adeb30b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c81f5f013a3e462c81d6cc30aa0775c3', 'request_id': 'req-77cdbc9d-87e9-41a6-ba3b-6f157adeb30b'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:09.261709 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-77cdbc9d-87e9-41a6-ba3b-6f157adeb30b admin admin] The token cache is being invalidate because project c81f5f013a3e462c81d6cc30aa0775c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 10:04:09.262339 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-77cdbc9d-87e9-41a6-ba3b-6f157adeb30b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:09.263305 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-77cdbc9d-87e9-41a6-ba3b-6f157adeb30b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:09.265891 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1028/2060] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 10 10:04:09 2022] DELETE /identity/v3/projects/c81f5f013a3e462c81d6cc30aa0775c3 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:04:09.270879 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cdbc9d-87e9-41a6-ba3b-6f157adeb30b admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:09.272700 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-77cdbc9d-87e9-41a6-ba3b-6f157adeb30b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:09.279867 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bec72d2-98b2-4ca5-8487-fd17d6f3b88d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:09.283467 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bec72d2-98b2-4ca5-8487-fd17d6f3b88d service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:09.325227 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1033/2061] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:04:09 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 10:04:09.415720 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cdbc9d-87e9-41a6-ba3b-6f157adeb30b admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:09.440823 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9e9e9a-d889-456c-a84e-f20d9efc92c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:09.441798 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9e9e9a-d889-456c-a84e-f20d9efc92c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:09.442077 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9e9e9a-d889-456c-a84e-f20d9efc92c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:09.442354 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9e9e9a-d889-456c-a84e-f20d9efc92c7 admin admin] PATH_INFO: `/v3/users/ea35b9a390984e9989e4eb9e15b4431e` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:09.444246 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9e9e9a-d889-456c-a84e-f20d9efc92c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea35b9a390984e9989e4eb9e15b4431e)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:09.446456 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9e9e9a-d889-456c-a84e-f20d9efc92c7 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:09.487517 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:04:09.535748 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-ee9e9e9a-d889-456c-a84e-f20d9efc92c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea35b9a390984e9989e4eb9e15b4431e'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:09.547731 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-ee9e9e9a-d889-456c-a84e-f20d9efc92c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea35b9a390984e9989e4eb9e15b4431e'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:09.559890 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-ee9e9e9a-d889-456c-a84e-f20d9efc92c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea35b9a390984e9989e4eb9e15b4431e'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:09.561393 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-ee9e9e9a-d889-456c-a84e-f20d9efc92c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea35b9a390984e9989e4eb9e15b4431e'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:09.562530 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-ee9e9e9a-d889-456c-a84e-f20d9efc92c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea35b9a390984e9989e4eb9e15b4431e'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:09.592078 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1029/2062] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 10 10:04:09 2022] DELETE /identity/v3/users/ea35b9a390984e9989e4eb9e15b4431e => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:04:09.910411 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bec72d2-98b2-4ca5-8487-fd17d6f3b88d service cinder] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:09.911973 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-9bec72d2-98b2-4ca5-8487-fd17d6f3b88d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:09.949776 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bec72d2-98b2-4ca5-8487-fd17d6f3b88d service cinder] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:09.975000 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:04:10.008207 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8c7906-0476-4094-94db-6b47ac72449c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:10.008846 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8c7906-0476-4094-94db-6b47ac72449c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:10.009155 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8c7906-0476-4094-94db-6b47ac72449c admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:10.009450 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8c7906-0476-4094-94db-6b47ac72449c admin admin] PATH_INFO: `/v3/projects/deb3378212f84df6ab5aadb96e4de624` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:10.010693 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8c7906-0476-4094-94db-6b47ac72449c admin admin] RBAC: Authorizing `identity:delete_project(project_id=deb3378212f84df6ab5aadb96e4de624)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:10.012819 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8c7906-0476-4094-94db-6b47ac72449c admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:10.072081 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-1e8c7906-0476-4094-94db-6b47ac72449c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'deb3378212f84df6ab5aadb96e4de624', 'request_id': 'req-1e8c7906-0476-4094-94db-6b47ac72449c'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:10.078060 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-1e8c7906-0476-4094-94db-6b47ac72449c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'deb3378212f84df6ab5aadb96e4de624', 'request_id': 'req-1e8c7906-0476-4094-94db-6b47ac72449c'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:10.086618 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-1e8c7906-0476-4094-94db-6b47ac72449c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'deb3378212f84df6ab5aadb96e4de624', 'request_id': 'req-1e8c7906-0476-4094-94db-6b47ac72449c'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:10.098667 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-1e8c7906-0476-4094-94db-6b47ac72449c admin admin] The token cache is being invalidate because project deb3378212f84df6ab5aadb96e4de624 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 10:04:10.100027 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-1e8c7906-0476-4094-94db-6b47ac72449c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:10.100723 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-1e8c7906-0476-4094-94db-6b47ac72449c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:10.102310 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1034/2063] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 10 10:04:09 2022] DELETE /identity/v3/projects/deb3378212f84df6ab5aadb96e4de624 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:04:10.108739 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab27a123-4d21-4bd3-b4e3-f6b057eeb05e None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:10.109030 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab27a123-4d21-4bd3-b4e3-f6b057eeb05e None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:10.109337 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab27a123-4d21-4bd3-b4e3-f6b057eeb05e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:10.130041 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-ab27a123-4d21-4bd3-b4e3-f6b057eeb05e None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:04:10.131280 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-ab27a123-4d21-4bd3-b4e3-f6b057eeb05e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:10.194460 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1030/2064] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:04:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:04:10.203302 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9129dd-b544-415c-9e7e-81dacd890c6d None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:10.203590 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9129dd-b544-415c-9e7e-81dacd890c6d None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:10.203894 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9129dd-b544-415c-9e7e-81dacd890c6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:10.224997 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-3e9129dd-b544-415c-9e7e-81dacd890c6d None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:04:10.226347 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-3e9129dd-b544-415c-9e7e-81dacd890c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:10.236251 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1035/2065] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:04:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:04:10.240682 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab27a123-4d21-4bd3-b4e3-f6b057eeb05e None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:10.251632 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab27a123-4d21-4bd3-b4e3-f6b057eeb05e None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:10.257239 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2249ce70-2974-4734-b7c3-91395d8fa060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:10.257857 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2249ce70-2974-4734-b7c3-91395d8fa060 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:10.258130 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2249ce70-2974-4734-b7c3-91395d8fa060 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:10.258393 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2249ce70-2974-4734-b7c3-91395d8fa060 admin admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:10.259048 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2249ce70-2974-4734-b7c3-91395d8fa060 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:04:10.259345 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2249ce70-2974-4734-b7c3-91395d8fa060 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:10.261005 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2249ce70-2974-4734-b7c3-91395d8fa060 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:10.273687 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1031/2066] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 10 10:04:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:04:10.278757 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9129dd-b544-415c-9e7e-81dacd890c6d None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:10.288030 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9129dd-b544-415c-9e7e-81dacd890c6d None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:10.293395 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e48fef-b93d-4661-9a68-958b1129c7b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:10.294005 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e48fef-b93d-4661-9a68-958b1129c7b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:10.294307 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e48fef-b93d-4661-9a68-958b1129c7b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:10.294571 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e48fef-b93d-4661-9a68-958b1129c7b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:10.295206 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e48fef-b93d-4661-9a68-958b1129c7b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:10.297212 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e48fef-b93d-4661-9a68-958b1129c7b0 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:10.329265 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1036/2067] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 10 10:04:10 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 10:04:10.330325 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2249ce70-2974-4734-b7c3-91395d8fa060 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:10.340540 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2249ce70-2974-4734-b7c3-91395d8fa060 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:10.404039 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26128052-1c89-4db3-ae37-64916f414155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:10.404698 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26128052-1c89-4db3-ae37-64916f414155 admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:10.404974 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26128052-1c89-4db3-ae37-64916f414155 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:10.405355 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26128052-1c89-4db3-ae37-64916f414155 admin admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:10.406064 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26128052-1c89-4db3-ae37-64916f414155 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:10.408136 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26128052-1c89-4db3-ae37-64916f414155 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:10.432571 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1032/2068] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 10 10:04:10 2022] POST /identity/v3/users => generated 287 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:04:10.436808 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e48fef-b93d-4661-9a68-958b1129c7b0 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:10.447263 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e48fef-b93d-4661-9a68-958b1129c7b0 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:10.451826 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adf4eae-dfb4-479d-ba25-2585a1c92333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:10.452424 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adf4eae-dfb4-479d-ba25-2585a1c92333 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:10.452698 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adf4eae-dfb4-479d-ba25-2585a1c92333 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:10.452966 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adf4eae-dfb4-479d-ba25-2585a1c92333 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:10.453669 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adf4eae-dfb4-479d-ba25-2585a1c92333 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:10.455267 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adf4eae-dfb4-479d-ba25-2585a1c92333 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:10.465557 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1037/2069] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:04:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:04:10.469893 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26128052-1c89-4db3-ae37-64916f414155 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:10.480682 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26128052-1c89-4db3-ae37-64916f414155 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:10.486211 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a1b480-c5d1-4eb0-b9e9-0b55895eedb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:10.486887 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a1b480-c5d1-4eb0-b9e9-0b55895eedb9 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:10.487233 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a1b480-c5d1-4eb0-b9e9-0b55895eedb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:10.487570 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a1b480-c5d1-4eb0-b9e9-0b55895eedb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:10.488289 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a1b480-c5d1-4eb0-b9e9-0b55895eedb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:10.490029 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a1b480-c5d1-4eb0-b9e9-0b55895eedb9 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:10.501039 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1033/2070] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:04:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:04:10.506383 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adf4eae-dfb4-479d-ba25-2585a1c92333 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:10.517509 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adf4eae-dfb4-479d-ba25-2585a1c92333 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:10.522664 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5779417e-f4bd-401c-930e-510e10972757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:10.523218 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5779417e-f4bd-401c-930e-510e10972757 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:10.523496 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5779417e-f4bd-401c-930e-510e10972757 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:10.523761 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5779417e-f4bd-401c-930e-510e10972757 admin admin] PATH_INFO: `/v3/projects/9f8fd71b353a4fa88bc7e9992a77101c/users/02339e6eaf564cd0b9ee020c9c2d0f3b/roles/8daabcb6b7394e39b06a3453e33e32db` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:10.540713 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5779417e-f4bd-401c-930e-510e10972757 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f8fd71b353a4fa88bc7e9992a77101c, user_id=02339e6eaf564cd0b9ee020c9c2d0f3b, role_id=8daabcb6b7394e39b06a3453e33e32db)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:10.544233 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5779417e-f4bd-401c-930e-510e10972757 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:10.577740 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1038/2071] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:04:10 2022] PUT /identity/v3/projects/9f8fd71b353a4fa88bc7e9992a77101c/users/02339e6eaf564cd0b9ee020c9c2d0f3b/roles/8daabcb6b7394e39b06a3453e33e32db => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:04:10.590258 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798c8ba5-64ed-41ab-8e13-7a1f96954b42 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:10.591289 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798c8ba5-64ed-41ab-8e13-7a1f96954b42 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:10.591913 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798c8ba5-64ed-41ab-8e13-7a1f96954b42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:10.616074 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:04:10.629356 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-798c8ba5-64ed-41ab-8e13-7a1f96954b42 None None] MFA Rules not processed for user `02339e6eaf564cd0b9ee020c9c2d0f3b`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:04:10.631905 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-798c8ba5-64ed-41ab-8e13-7a1f96954b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:10.709424 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1034/2072] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:04:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 10:04:10.723005 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5779417e-f4bd-401c-930e-510e10972757 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:10.724889 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-5779417e-f4bd-401c-930e-510e10972757 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:10.803673 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5779417e-f4bd-401c-930e-510e10972757 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:10.808467 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0ba98e-83c7-441a-a449-f436b5d5761a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf8e725cbe0403d943b136235eac057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:10.809108 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0ba98e-83c7-441a-a449-f436b5d5761a service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:10.809450 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0ba98e-83c7-441a-a449-f436b5d5761a service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:10.809781 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0ba98e-83c7-441a-a449-f436b5d5761a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:10.820925 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0ba98e-83c7-441a-a449-f436b5d5761a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:10.822582 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0ba98e-83c7-441a-a449-f436b5d5761a service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:10.827283 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:04:10.845165 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1039/2073] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:04:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:04:11.441289 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798c8ba5-64ed-41ab-8e13-7a1f96954b42 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:11.442892 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-798c8ba5-64ed-41ab-8e13-7a1f96954b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:11.508873 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798c8ba5-64ed-41ab-8e13-7a1f96954b42 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:11.513420 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8c5fe1-e369-4a11-815a-6db2fb61ab5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:11.514042 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8c5fe1-e369-4a11-815a-6db2fb61ab5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:11.514318 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8c5fe1-e369-4a11-815a-6db2fb61ab5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:11.514589 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8c5fe1-e369-4a11-815a-6db2fb61ab5b admin admin] PATH_INFO: `/v3/users/d0f9dd6412c24b37bc7246749f172734` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:11.515706 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8c5fe1-e369-4a11-815a-6db2fb61ab5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0f9dd6412c24b37bc7246749f172734)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:11.517685 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8c5fe1-e369-4a11-815a-6db2fb61ab5b admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:11.564174 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-1f8c5fe1-e369-4a11-815a-6db2fb61ab5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0f9dd6412c24b37bc7246749f172734'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:11.571434 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-1f8c5fe1-e369-4a11-815a-6db2fb61ab5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0f9dd6412c24b37bc7246749f172734'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:11.579901 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-1f8c5fe1-e369-4a11-815a-6db2fb61ab5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0f9dd6412c24b37bc7246749f172734'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:11.580479 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-1f8c5fe1-e369-4a11-815a-6db2fb61ab5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0f9dd6412c24b37bc7246749f172734'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:11.581093 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-1f8c5fe1-e369-4a11-815a-6db2fb61ab5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0f9dd6412c24b37bc7246749f172734'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:11.598807 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1035/2074] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 10 10:04:11 2022] DELETE /identity/v3/users/d0f9dd6412c24b37bc7246749f172734 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:04:11.603559 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8407fe-eba8-4361-8672-f12d3230671d None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:11.604071 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8407fe-eba8-4361-8672-f12d3230671d None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:11.604169 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8407fe-eba8-4361-8672-f12d3230671d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:11.624740 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-be8407fe-eba8-4361-8672-f12d3230671d None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:04:11.626425 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-be8407fe-eba8-4361-8672-f12d3230671d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:11.698650 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1040/2075] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:04:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:04:11.708906 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8c5fe1-e369-4a11-815a-6db2fb61ab5b admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:11.710472 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-1f8c5fe1-e369-4a11-815a-6db2fb61ab5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:11.739081 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:04:11.778138 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8c5fe1-e369-4a11-815a-6db2fb61ab5b admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:11.781821 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a522eaa7-925f-4760-8348-e5fda90fb861 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4294c170df354fe892831281acd4ea7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:11.782425 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a522eaa7-925f-4760-8348-e5fda90fb861 service neutron] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:11.782707 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a522eaa7-925f-4760-8348-e5fda90fb861 service neutron] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:11.782975 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a522eaa7-925f-4760-8348-e5fda90fb861 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:11.792098 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a522eaa7-925f-4760-8348-e5fda90fb861 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:11.793656 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a522eaa7-925f-4760-8348-e5fda90fb861 service neutron] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:11.807624 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1036/2076] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:04:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:04:12.159478 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8407fe-eba8-4361-8672-f12d3230671d None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:12.164685 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-be8407fe-eba8-4361-8672-f12d3230671d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:12.182111 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8407fe-eba8-4361-8672-f12d3230671d None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:12.192580 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a1d72b-98f9-4208-98e5-e7d1805fa422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:12.193512 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a1d72b-98f9-4208-98e5-e7d1805fa422 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:12.193816 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a1d72b-98f9-4208-98e5-e7d1805fa422 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:12.194188 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a1d72b-98f9-4208-98e5-e7d1805fa422 admin admin] PATH_INFO: `/v3/projects/8877482e038340e888886276ad127c9a` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:12.195606 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a1d72b-98f9-4208-98e5-e7d1805fa422 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8877482e038340e888886276ad127c9a)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:12.197996 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a1d72b-98f9-4208-98e5-e7d1805fa422 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:12.273218 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-38a1d72b-98f9-4208-98e5-e7d1805fa422 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8877482e038340e888886276ad127c9a', 'request_id': 'req-38a1d72b-98f9-4208-98e5-e7d1805fa422'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:12.280052 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-38a1d72b-98f9-4208-98e5-e7d1805fa422 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8877482e038340e888886276ad127c9a', 'request_id': 'req-38a1d72b-98f9-4208-98e5-e7d1805fa422'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:12.289713 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-38a1d72b-98f9-4208-98e5-e7d1805fa422 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8877482e038340e888886276ad127c9a', 'request_id': 'req-38a1d72b-98f9-4208-98e5-e7d1805fa422'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:12.304795 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-38a1d72b-98f9-4208-98e5-e7d1805fa422 admin admin] The token cache is being invalidate because project 8877482e038340e888886276ad127c9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 10:04:12.305497 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-38a1d72b-98f9-4208-98e5-e7d1805fa422 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:12.306154 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-38a1d72b-98f9-4208-98e5-e7d1805fa422 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:12.307996 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1041/2077] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 10 10:04:12 2022] DELETE /identity/v3/projects/8877482e038340e888886276ad127c9a => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:04:12.312445 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a522eaa7-925f-4760-8348-e5fda90fb861 service neutron] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:12.323806 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a522eaa7-925f-4760-8348-e5fda90fb861 service neutron] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:12.394301 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c761ea5-b70f-478c-9f04-388cda4caf00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:12.394988 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c761ea5-b70f-478c-9f04-388cda4caf00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:12.395269 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c761ea5-b70f-478c-9f04-388cda4caf00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:12.395542 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c761ea5-b70f-478c-9f04-388cda4caf00 admin admin] PATH_INFO: `/v3/users/0c712ed17f4b4e13ba9628ab54b8d806` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:12.396699 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c761ea5-b70f-478c-9f04-388cda4caf00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c712ed17f4b4e13ba9628ab54b8d806)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:12.398700 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c761ea5-b70f-478c-9f04-388cda4caf00 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:12.449571 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-7c761ea5-b70f-478c-9f04-388cda4caf00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c712ed17f4b4e13ba9628ab54b8d806'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:12.456884 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-7c761ea5-b70f-478c-9f04-388cda4caf00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c712ed17f4b4e13ba9628ab54b8d806'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:12.465267 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-7c761ea5-b70f-478c-9f04-388cda4caf00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c712ed17f4b4e13ba9628ab54b8d806'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:12.465925 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-7c761ea5-b70f-478c-9f04-388cda4caf00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c712ed17f4b4e13ba9628ab54b8d806'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:12.466546 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-7c761ea5-b70f-478c-9f04-388cda4caf00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c712ed17f4b4e13ba9628ab54b8d806'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:12.484581 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1037/2078] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 10 10:04:12 2022] DELETE /identity/v3/users/0c712ed17f4b4e13ba9628ab54b8d806 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:04:12.793292 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a1d72b-98f9-4208-98e5-e7d1805fa422 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:12.795472 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-38a1d72b-98f9-4208-98e5-e7d1805fa422 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:12.813212 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a1d72b-98f9-4208-98e5-e7d1805fa422 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:12.875611 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a651c8-aa66-4dcf-a518-34e7e90ae0d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:12.875772 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a651c8-aa66-4dcf-a518-34e7e90ae0d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:12.876012 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a651c8-aa66-4dcf-a518-34e7e90ae0d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:12.876274 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a651c8-aa66-4dcf-a518-34e7e90ae0d0 admin admin] PATH_INFO: `/v3/projects/8570914b7c904fe78a21c05b38497749` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:12.877553 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a651c8-aa66-4dcf-a518-34e7e90ae0d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8570914b7c904fe78a21c05b38497749)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:12.879530 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a651c8-aa66-4dcf-a518-34e7e90ae0d0 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:12.909159 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:04:12.939857 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-79a651c8-aa66-4dcf-a518-34e7e90ae0d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8570914b7c904fe78a21c05b38497749', 'request_id': 'req-79a651c8-aa66-4dcf-a518-34e7e90ae0d0'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:12.945763 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-79a651c8-aa66-4dcf-a518-34e7e90ae0d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8570914b7c904fe78a21c05b38497749', 'request_id': 'req-79a651c8-aa66-4dcf-a518-34e7e90ae0d0'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:12.956175 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-79a651c8-aa66-4dcf-a518-34e7e90ae0d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8570914b7c904fe78a21c05b38497749', 'request_id': 'req-79a651c8-aa66-4dcf-a518-34e7e90ae0d0'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:12.968495 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-79a651c8-aa66-4dcf-a518-34e7e90ae0d0 admin admin] The token cache is being invalidate because project 8570914b7c904fe78a21c05b38497749 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 10:04:12.968796 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-79a651c8-aa66-4dcf-a518-34e7e90ae0d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:12.969482 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-79a651c8-aa66-4dcf-a518-34e7e90ae0d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:12.971080 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1042/2079] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 10 10:04:12 2022] DELETE /identity/v3/projects/8570914b7c904fe78a21c05b38497749 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:04:12.976058 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae259b1c-d088-446b-bc1f-cdee82798392 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:12.976413 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae259b1c-d088-446b-bc1f-cdee82798392 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:12.976675 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae259b1c-d088-446b-bc1f-cdee82798392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:12.996209 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-ae259b1c-d088-446b-bc1f-cdee82798392 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:04:12.997446 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-ae259b1c-d088-446b-bc1f-cdee82798392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:13.029626 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:04:13.057125 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1038/2080] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:04:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 10:04:13.065401 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2569b30-2169-435f-bfd6-1efdf0b0c305 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:13.065687 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2569b30-2169-435f-bfd6-1efdf0b0c305 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:13.065963 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2569b30-2169-435f-bfd6-1efdf0b0c305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:13.087771 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-d2569b30-2169-435f-bfd6-1efdf0b0c305 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:04:13.089029 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-d2569b30-2169-435f-bfd6-1efdf0b0c305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:13.098003 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1043/2081] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:04:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:04:13.103050 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae259b1c-d088-446b-bc1f-cdee82798392 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:13.112853 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae259b1c-d088-446b-bc1f-cdee82798392 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:13.117891 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643c449e-3736-4d0f-901d-6e0ea0e8a5e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:13.118485 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643c449e-3736-4d0f-901d-6e0ea0e8a5e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:13.118758 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643c449e-3736-4d0f-901d-6e0ea0e8a5e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:13.119026 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643c449e-3736-4d0f-901d-6e0ea0e8a5e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:13.119697 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643c449e-3736-4d0f-901d-6e0ea0e8a5e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:04:13.119996 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643c449e-3736-4d0f-901d-6e0ea0e8a5e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:13.121613 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643c449e-3736-4d0f-901d-6e0ea0e8a5e5 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:13.133484 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1039/2082] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 10 10:04:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:04:13.137878 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2569b30-2169-435f-bfd6-1efdf0b0c305 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:13.147589 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2569b30-2169-435f-bfd6-1efdf0b0c305 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:13.152502 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4c0a25-3919-492b-b9d7-d521069ef19c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:13.153144 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c0a25-3919-492b-b9d7-d521069ef19c admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:13.153423 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c0a25-3919-492b-b9d7-d521069ef19c admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:13.153692 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c0a25-3919-492b-b9d7-d521069ef19c admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:13.154338 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4c0a25-3919-492b-b9d7-d521069ef19c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:13.156219 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4c0a25-3919-492b-b9d7-d521069ef19c admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:13.188908 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1044/2083] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 10 10:04:13 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:04:13.194134 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643c449e-3736-4d0f-901d-6e0ea0e8a5e5 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:13.205051 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643c449e-3736-4d0f-901d-6e0ea0e8a5e5 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:13.283790 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbc8b6e-727e-412e-ad7a-9e6a35107dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:13.284601 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbc8b6e-727e-412e-ad7a-9e6a35107dfe admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:13.285044 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbc8b6e-727e-412e-ad7a-9e6a35107dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:13.285371 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbc8b6e-727e-412e-ad7a-9e6a35107dfe admin admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:13.286357 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbc8b6e-727e-412e-ad7a-9e6a35107dfe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:13.288481 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbc8b6e-727e-412e-ad7a-9e6a35107dfe admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:13.315106 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1040/2084] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 10 10:04:13 2022] POST /identity/v3/users => generated 293 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:04:13.319453 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4c0a25-3919-492b-b9d7-d521069ef19c admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:13.332197 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4c0a25-3919-492b-b9d7-d521069ef19c admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:13.337274 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8c6020-1359-4fb0-9266-f770b892a02a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:13.337880 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8c6020-1359-4fb0-9266-f770b892a02a admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:13.339732 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8c6020-1359-4fb0-9266-f770b892a02a admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:13.340141 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8c6020-1359-4fb0-9266-f770b892a02a admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:13.341849 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8c6020-1359-4fb0-9266-f770b892a02a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:13.344162 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8c6020-1359-4fb0-9266-f770b892a02a admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:13.359444 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1045/2085] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:04:13 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:04:13.364403 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbc8b6e-727e-412e-ad7a-9e6a35107dfe admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:13.379086 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbc8b6e-727e-412e-ad7a-9e6a35107dfe admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:13.386335 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1de682d-644e-4b55-9c0d-b89d4bdaf809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:13.387686 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1de682d-644e-4b55-9c0d-b89d4bdaf809 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:13.388132 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1de682d-644e-4b55-9c0d-b89d4bdaf809 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:13.388572 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1de682d-644e-4b55-9c0d-b89d4bdaf809 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:13.389427 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1de682d-644e-4b55-9c0d-b89d4bdaf809 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:13.392311 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1de682d-644e-4b55-9c0d-b89d4bdaf809 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:13.406810 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1041/2086] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:04:13 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:04:13.416425 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8c6020-1359-4fb0-9266-f770b892a02a admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:13.427110 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8c6020-1359-4fb0-9266-f770b892a02a admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:13.436734 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ed3ab5-bd2d-4d97-baa7-cbdf23099d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:13.438876 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ed3ab5-bd2d-4d97-baa7-cbdf23099d41 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:13.439184 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ed3ab5-bd2d-4d97-baa7-cbdf23099d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:13.439562 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ed3ab5-bd2d-4d97-baa7-cbdf23099d41 admin admin] PATH_INFO: `/v3/projects/6f0ac72a70754f199adb0ec4a849ad5b/users/7a9341aa7ada4ad9bb110cafe9b9d04e/roles/8daabcb6b7394e39b06a3453e33e32db` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:13.467132 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ed3ab5-bd2d-4d97-baa7-cbdf23099d41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f0ac72a70754f199adb0ec4a849ad5b, user_id=7a9341aa7ada4ad9bb110cafe9b9d04e, role_id=8daabcb6b7394e39b06a3453e33e32db)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:13.470296 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ed3ab5-bd2d-4d97-baa7-cbdf23099d41 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:13.482681 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1de682d-644e-4b55-9c0d-b89d4bdaf809 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:13.485978 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-d1de682d-644e-4b55-9c0d-b89d4bdaf809 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:13.500098 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1de682d-644e-4b55-9c0d-b89d4bdaf809 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:13.500778 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1046/2087] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:04:13 2022] PUT /identity/v3/projects/6f0ac72a70754f199adb0ec4a849ad5b/users/7a9341aa7ada4ad9bb110cafe9b9d04e/roles/8daabcb6b7394e39b06a3453e33e32db => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:04:13.502404 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42e5246-4086-451e-a5f3-52a495cdf0dc None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:13.502691 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42e5246-4086-451e-a5f3-52a495cdf0dc None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:13.502977 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42e5246-4086-451e-a5f3-52a495cdf0dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:13.538508 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-c42e5246-4086-451e-a5f3-52a495cdf0dc None None] MFA Rules not processed for user `7a9341aa7ada4ad9bb110cafe9b9d04e`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:04:13.539838 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-c42e5246-4086-451e-a5f3-52a495cdf0dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:13.591160 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f37eb3-8fb1-4fde-8272-27260b69b7cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:13.593475 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f37eb3-8fb1-4fde-8272-27260b69b7cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:13.594455 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f37eb3-8fb1-4fde-8272-27260b69b7cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:13.594944 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f37eb3-8fb1-4fde-8272-27260b69b7cd admin admin] PATH_INFO: `/v3/users/e5172b1d41db4f7ea707126469306a64` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:13.596759 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f37eb3-8fb1-4fde-8272-27260b69b7cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5172b1d41db4f7ea707126469306a64)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:13.599695 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f37eb3-8fb1-4fde-8272-27260b69b7cd admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:13.636822 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1047/2088] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:04:13 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:04:13.641563 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42e5246-4086-451e-a5f3-52a495cdf0dc None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:13.653720 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42e5246-4086-451e-a5f3-52a495cdf0dc None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:13.659008 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f27acdc-b4d0-4090-aa72-4014d2ffffab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:13.659784 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f27acdc-b4d0-4090-aa72-4014d2ffffab admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:13.660126 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f27acdc-b4d0-4090-aa72-4014d2ffffab admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:13.660458 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f27acdc-b4d0-4090-aa72-4014d2ffffab admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:13.661223 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f27acdc-b4d0-4090-aa72-4014d2ffffab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:13.663851 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f27acdc-b4d0-4090-aa72-4014d2ffffab admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:13.676711 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-d9f37eb3-8fb1-4fde-8272-27260b69b7cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5172b1d41db4f7ea707126469306a64'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:13.681216 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:04:13.693446 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-d9f37eb3-8fb1-4fde-8272-27260b69b7cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5172b1d41db4f7ea707126469306a64'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:13.705888 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-d9f37eb3-8fb1-4fde-8272-27260b69b7cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5172b1d41db4f7ea707126469306a64'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:13.708062 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-d9f37eb3-8fb1-4fde-8272-27260b69b7cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5172b1d41db4f7ea707126469306a64'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:13.708742 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-d9f37eb3-8fb1-4fde-8272-27260b69b7cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5172b1d41db4f7ea707126469306a64'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:13.709719 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1048/2089] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 10 10:04:13 2022] POST /identity/v3/projects => generated 387 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 10:04:13.713731 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f27acdc-b4d0-4090-aa72-4014d2ffffab admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:13.715390 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-9f27acdc-b4d0-4090-aa72-4014d2ffffab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:13.733986 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1042/2090] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 10 10:04:13 2022] DELETE /identity/v3/users/e5172b1d41db4f7ea707126469306a64 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:04:13.738824 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6285682e-9363-4b9e-aa2c-69d9f72de4d7 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:13.739380 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6285682e-9363-4b9e-aa2c-69d9f72de4d7 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:13.739792 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6285682e-9363-4b9e-aa2c-69d9f72de4d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:13.759970 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:04:13.767399 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-6285682e-9363-4b9e-aa2c-69d9f72de4d7 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:04:13.768854 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-6285682e-9363-4b9e-aa2c-69d9f72de4d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:13.821555 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f27acdc-b4d0-4090-aa72-4014d2ffffab admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:13.860704 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1043/2091] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:04:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:04:13.874953 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6285682e-9363-4b9e-aa2c-69d9f72de4d7 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:13.876681 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-6285682e-9363-4b9e-aa2c-69d9f72de4d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:13.895739 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55077d4-3a75-453f-8ab7-cc0da2128a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:13.897100 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55077d4-3a75-453f-8ab7-cc0da2128a33 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:13.897559 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55077d4-3a75-453f-8ab7-cc0da2128a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:13.897830 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55077d4-3a75-453f-8ab7-cc0da2128a33 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:13.898473 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55077d4-3a75-453f-8ab7-cc0da2128a33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:13.900399 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55077d4-3a75-453f-8ab7-cc0da2128a33 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:13.924117 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1049/2092] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 10 10:04:13 2022] POST /identity/v3/users => generated 300 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 10:04:13.928874 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55077d4-3a75-453f-8ab7-cc0da2128a33 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:13.940392 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55077d4-3a75-453f-8ab7-cc0da2128a33 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:13.945727 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0cc1fa-132d-40c7-a791-efe7f216831c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:13.946351 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0cc1fa-132d-40c7-a791-efe7f216831c admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:13.946631 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0cc1fa-132d-40c7-a791-efe7f216831c admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:13.947043 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0cc1fa-132d-40c7-a791-efe7f216831c admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:13.947766 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0cc1fa-132d-40c7-a791-efe7f216831c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:13.949827 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0cc1fa-132d-40c7-a791-efe7f216831c admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:13.950615 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6285682e-9363-4b9e-aa2c-69d9f72de4d7 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:13.956900 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14a5b94-5496-4a6d-8006-58a08cd9cd7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4294c170df354fe892831281acd4ea7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:13.958472 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14a5b94-5496-4a6d-8006-58a08cd9cd7c service neutron] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:13.958858 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14a5b94-5496-4a6d-8006-58a08cd9cd7c service neutron] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:13.959354 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14a5b94-5496-4a6d-8006-58a08cd9cd7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:13.960964 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1050/2093] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:04:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:04:13.965162 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0cc1fa-132d-40c7-a791-efe7f216831c admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:13.971390 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14a5b94-5496-4a6d-8006-58a08cd9cd7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:13.974298 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14a5b94-5496-4a6d-8006-58a08cd9cd7c service neutron] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:13.975586 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0cc1fa-132d-40c7-a791-efe7f216831c admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:13.982572 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aca479-42e9-4338-87d3-dc2f1ee1a84a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:13.983239 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aca479-42e9-4338-87d3-dc2f1ee1a84a admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:13.983575 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aca479-42e9-4338-87d3-dc2f1ee1a84a admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:13.983851 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aca479-42e9-4338-87d3-dc2f1ee1a84a admin admin] PATH_INFO: `/v3/projects/7e83a05cedad4b1eaefeb8f37e3b9cb8/users/dc53c7c168194c55a781ec36cd1399a9/roles/eb04edc46b3742d7a0f0ead26f68bc22` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:13.985898 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1044/2094] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:04:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 10:04:14.002334 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aca479-42e9-4338-87d3-dc2f1ee1a84a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e83a05cedad4b1eaefeb8f37e3b9cb8, user_id=dc53c7c168194c55a781ec36cd1399a9, role_id=eb04edc46b3742d7a0f0ead26f68bc22)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:14.005336 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aca479-42e9-4338-87d3-dc2f1ee1a84a admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:14.019718 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14a5b94-5496-4a6d-8006-58a08cd9cd7c service neutron] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:14.021474 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-b14a5b94-5496-4a6d-8006-58a08cd9cd7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:14.030045 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1051/2095] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:04:13 2022] PUT /identity/v3/projects/7e83a05cedad4b1eaefeb8f37e3b9cb8/users/dc53c7c168194c55a781ec36cd1399a9/roles/eb04edc46b3742d7a0f0ead26f68bc22 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 10:04:14.031301 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aca479-42e9-4338-87d3-dc2f1ee1a84a admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:14.035074 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14a5b94-5496-4a6d-8006-58a08cd9cd7c service neutron] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:14.117048 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1c16d7-ccf3-46ca-b73e-59c3f4cf916c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:14.117741 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1c16d7-ccf3-46ca-b73e-59c3f4cf916c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:14.118024 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1c16d7-ccf3-46ca-b73e-59c3f4cf916c admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:14.118293 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1c16d7-ccf3-46ca-b73e-59c3f4cf916c admin admin] PATH_INFO: `/v3/users/02339e6eaf564cd0b9ee020c9c2d0f3b` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:14.119947 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1c16d7-ccf3-46ca-b73e-59c3f4cf916c admin admin] RBAC: Authorizing `identity:delete_user(user_id=02339e6eaf564cd0b9ee020c9c2d0f3b)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:14.121817 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1c16d7-ccf3-46ca-b73e-59c3f4cf916c admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:14.133226 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aca479-42e9-4338-87d3-dc2f1ee1a84a admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:14.135128 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:04:14.139667 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ab8d9b-86b3-472f-ac09-acacc60fff61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:14.140617 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ab8d9b-86b3-472f-ac09-acacc60fff61 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:14.140901 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ab8d9b-86b3-472f-ac09-acacc60fff61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:14.141342 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ab8d9b-86b3-472f-ac09-acacc60fff61 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:14.143429 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ab8d9b-86b3-472f-ac09-acacc60fff61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:14.145166 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ab8d9b-86b3-472f-ac09-acacc60fff61 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:14.161125 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1052/2096] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:04:14 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:04:14.167120 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ab8d9b-86b3-472f-ac09-acacc60fff61 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:14.178713 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ab8d9b-86b3-472f-ac09-acacc60fff61 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:14.185315 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01e366d-0a03-46e4-81f1-18ab8bc6f6c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:14.186231 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e366d-0a03-46e4-81f1-18ab8bc6f6c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:14.186579 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e366d-0a03-46e4-81f1-18ab8bc6f6c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:14.186966 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e366d-0a03-46e4-81f1-18ab8bc6f6c0 admin admin] PATH_INFO: `/v3/projects/7e83a05cedad4b1eaefeb8f37e3b9cb8/users/dc53c7c168194c55a781ec36cd1399a9/roles/eb04edc46b3742d7a0f0ead26f68bc22` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:14.189193 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01e366d-0a03-46e4-81f1-18ab8bc6f6c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e83a05cedad4b1eaefeb8f37e3b9cb8, user_id=dc53c7c168194c55a781ec36cd1399a9, role_id=eb04edc46b3742d7a0f0ead26f68bc22)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:14.192323 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01e366d-0a03-46e4-81f1-18ab8bc6f6c0 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:14.201030 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:04:14.207059 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1053/2097] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:04:14 2022] PUT /identity/v3/projects/7e83a05cedad4b1eaefeb8f37e3b9cb8/users/dc53c7c168194c55a781ec36cd1399a9/roles/eb04edc46b3742d7a0f0ead26f68bc22 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:04:14.216103 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-8a1c16d7-ccf3-46ca-b73e-59c3f4cf916c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02339e6eaf564cd0b9ee020c9c2d0f3b'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:14.216103 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-8a1c16d7-ccf3-46ca-b73e-59c3f4cf916c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02339e6eaf564cd0b9ee020c9c2d0f3b'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:14.218004 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20b61f3-d9d7-40fe-9a48-43da297fb3be None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:14.218361 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20b61f3-d9d7-40fe-9a48-43da297fb3be None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:14.218895 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20b61f3-d9d7-40fe-9a48-43da297fb3be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:14.229208 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-8a1c16d7-ccf3-46ca-b73e-59c3f4cf916c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02339e6eaf564cd0b9ee020c9c2d0f3b'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:14.230440 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-8a1c16d7-ccf3-46ca-b73e-59c3f4cf916c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02339e6eaf564cd0b9ee020c9c2d0f3b'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:14.231098 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-8a1c16d7-ccf3-46ca-b73e-59c3f4cf916c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02339e6eaf564cd0b9ee020c9c2d0f3b'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:14.254647 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-b20b61f3-d9d7-40fe-9a48-43da297fb3be None None] MFA Rules not processed for user `dc53c7c168194c55a781ec36cd1399a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:04:14.255889 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-b20b61f3-d9d7-40fe-9a48-43da297fb3be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:14.261353 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1045/2098] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 10 10:04:14 2022] DELETE /identity/v3/users/02339e6eaf564cd0b9ee020c9c2d0f3b => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 10:04:14.263825 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b4d081-1f86-413a-8e9b-85014f6522f9 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:14.264112 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b4d081-1f86-413a-8e9b-85014f6522f9 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:14.264386 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b4d081-1f86-413a-8e9b-85014f6522f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:14.285882 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-80b4d081-1f86-413a-8e9b-85014f6522f9 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:04:14.287116 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-80b4d081-1f86-413a-8e9b-85014f6522f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:14.375018 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1054/2099] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:04:14 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:04:14.375018 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20b61f3-d9d7-40fe-9a48-43da297fb3be None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:14.375018 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-b20b61f3-d9d7-40fe-9a48-43da297fb3be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:14.390484 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1046/2100] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:04:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 10:04:14.391953 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b4d081-1f86-413a-8e9b-85014f6522f9 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:14.393405 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-80b4d081-1f86-413a-8e9b-85014f6522f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:14.467516 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20b61f3-d9d7-40fe-9a48-43da297fb3be None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:14.473781 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea4360e-4d74-4079-aa5a-f3a63cba6f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:14.474426 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea4360e-4d74-4079-aa5a-f3a63cba6f53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:14.474703 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea4360e-4d74-4079-aa5a-f3a63cba6f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:14.474980 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea4360e-4d74-4079-aa5a-f3a63cba6f53 admin admin] PATH_INFO: `/v3/projects/8b5294d83da24048a9c70882df2320ba` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:14.475858 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b4d081-1f86-413a-8e9b-85014f6522f9 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:14.476349 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea4360e-4d74-4079-aa5a-f3a63cba6f53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b5294d83da24048a9c70882df2320ba)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:14.478337 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea4360e-4d74-4079-aa5a-f3a63cba6f53 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:14.480888 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde5e9fa-1185-4ce5-b248-a12a92711be3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf8e725cbe0403d943b136235eac057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:14.481611 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde5e9fa-1185-4ce5-b248-a12a92711be3 service cinder] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:14.481886 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde5e9fa-1185-4ce5-b248-a12a92711be3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:14.482379 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde5e9fa-1185-4ce5-b248-a12a92711be3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:14.533731 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:04:14.547949 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-9ea4360e-4d74-4079-aa5a-f3a63cba6f53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b5294d83da24048a9c70882df2320ba', 'request_id': 'req-9ea4360e-4d74-4079-aa5a-f3a63cba6f53'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:14.555606 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-9ea4360e-4d74-4079-aa5a-f3a63cba6f53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b5294d83da24048a9c70882df2320ba', 'request_id': 'req-9ea4360e-4d74-4079-aa5a-f3a63cba6f53'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:14.564588 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde5e9fa-1185-4ce5-b248-a12a92711be3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:14.565808 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-9ea4360e-4d74-4079-aa5a-f3a63cba6f53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b5294d83da24048a9c70882df2320ba', 'request_id': 'req-9ea4360e-4d74-4079-aa5a-f3a63cba6f53'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:14.566970 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde5e9fa-1185-4ce5-b248-a12a92711be3 service cinder] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:14.580806 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-9ea4360e-4d74-4079-aa5a-f3a63cba6f53 admin admin] The token cache is being invalidate because project 8b5294d83da24048a9c70882df2320ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 10:04:14.581196 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-9ea4360e-4d74-4079-aa5a-f3a63cba6f53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:14.582154 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-9ea4360e-4d74-4079-aa5a-f3a63cba6f53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:14.583833 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1055/2101] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 10 10:04:14 2022] DELETE /identity/v3/projects/8b5294d83da24048a9c70882df2320ba => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:04:14.584456 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea4360e-4d74-4079-aa5a-f3a63cba6f53 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:14.585955 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-9ea4360e-4d74-4079-aa5a-f3a63cba6f53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:14.594936 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1047/2102] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:04:14 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:04:14.596365 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde5e9fa-1185-4ce5-b248-a12a92711be3 service cinder] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:14.609603 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:04:14.619641 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde5e9fa-1185-4ce5-b248-a12a92711be3 service cinder] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:14.690456 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea4360e-4d74-4079-aa5a-f3a63cba6f53 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:14.695013 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b36e6d-2b83-4559-8ec3-9ae7d83b094f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4294c170df354fe892831281acd4ea7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:14.695798 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b36e6d-2b83-4559-8ec3-9ae7d83b094f service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:14.696086 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b36e6d-2b83-4559-8ec3-9ae7d83b094f service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:14.696362 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b36e6d-2b83-4559-8ec3-9ae7d83b094f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:14.699229 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-35b36e6d-2b83-4559-8ec3-9ae7d83b094f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:14.727840 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7627393c-2396-4e69-803b-642e5e99bf5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:14.728488 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7627393c-2396-4e69-803b-642e5e99bf5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:14.728765 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7627393c-2396-4e69-803b-642e5e99bf5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:14.729090 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7627393c-2396-4e69-803b-642e5e99bf5a admin admin] PATH_INFO: `/v3/users/f6771eaec9e14ae3b48ded349b6665c5` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:14.731009 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7627393c-2396-4e69-803b-642e5e99bf5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6771eaec9e14ae3b48ded349b6665c5)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:14.738649 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7627393c-2396-4e69-803b-642e5e99bf5a admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:14.796194 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b36e6d-2b83-4559-8ec3-9ae7d83b094f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:14.800146 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b36e6d-2b83-4559-8ec3-9ae7d83b094f service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:14.812173 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1056/2103] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:04:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:04:14.813271 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b36e6d-2b83-4559-8ec3-9ae7d83b094f service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:14.814721 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-35b36e6d-2b83-4559-8ec3-9ae7d83b094f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:14.824502 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-7627393c-2396-4e69-803b-642e5e99bf5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6771eaec9e14ae3b48ded349b6665c5'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:14.829370 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b36e6d-2b83-4559-8ec3-9ae7d83b094f service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:14.834597 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-7627393c-2396-4e69-803b-642e5e99bf5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6771eaec9e14ae3b48ded349b6665c5'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:14.835108 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2cd099-1369-4101-b253-fab67dda6bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:14.836200 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2cd099-1369-4101-b253-fab67dda6bd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:14.836200 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2cd099-1369-4101-b253-fab67dda6bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:14.836401 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2cd099-1369-4101-b253-fab67dda6bd8 admin admin] PATH_INFO: `/v3/users/7a9341aa7ada4ad9bb110cafe9b9d04e` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:14.837444 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2cd099-1369-4101-b253-fab67dda6bd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a9341aa7ada4ad9bb110cafe9b9d04e)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:14.839579 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2cd099-1369-4101-b253-fab67dda6bd8 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:14.850362 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-7627393c-2396-4e69-803b-642e5e99bf5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6771eaec9e14ae3b48ded349b6665c5'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:14.852378 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-7627393c-2396-4e69-803b-642e5e99bf5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6771eaec9e14ae3b48ded349b6665c5'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:14.853113 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-7627393c-2396-4e69-803b-642e5e99bf5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6771eaec9e14ae3b48ded349b6665c5'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:14.883655 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1048/2104] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 10 10:04:14 2022] DELETE /identity/v3/users/f6771eaec9e14ae3b48ded349b6665c5 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:04:14.905422 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-ab2cd099-1369-4101-b253-fab67dda6bd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a9341aa7ada4ad9bb110cafe9b9d04e'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:14.915031 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-ab2cd099-1369-4101-b253-fab67dda6bd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a9341aa7ada4ad9bb110cafe9b9d04e'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:14.915831 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-ab2cd099-1369-4101-b253-fab67dda6bd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a9341aa7ada4ad9bb110cafe9b9d04e'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:14.916540 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-ab2cd099-1369-4101-b253-fab67dda6bd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a9341aa7ada4ad9bb110cafe9b9d04e'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:14.926796 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-ab2cd099-1369-4101-b253-fab67dda6bd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a9341aa7ada4ad9bb110cafe9b9d04e'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:14.949286 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1057/2105] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 10 10:04:14 2022] DELETE /identity/v3/users/7a9341aa7ada4ad9bb110cafe9b9d04e => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:04:14.954724 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d449ff9c-bc0a-4039-9620-50f68008070c None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:14.954724 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d449ff9c-bc0a-4039-9620-50f68008070c None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:14.954724 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d449ff9c-bc0a-4039-9620-50f68008070c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:14.980475 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-d449ff9c-bc0a-4039-9620-50f68008070c None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:04:14.981828 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-d449ff9c-bc0a-4039-9620-50f68008070c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:15.062998 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:04:15.081710 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1049/2106] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:04:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:04:15.098325 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2cd099-1369-4101-b253-fab67dda6bd8 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:15.100110 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-ab2cd099-1369-4101-b253-fab67dda6bd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:15.151562 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:04:15.177737 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2cd099-1369-4101-b253-fab67dda6bd8 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:15.182211 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d040ed-f372-4859-a499-151a30704bf8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4294c170df354fe892831281acd4ea7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:15.183094 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d040ed-f372-4859-a499-151a30704bf8 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:15.183593 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d040ed-f372-4859-a499-151a30704bf8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:15.183948 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d040ed-f372-4859-a499-151a30704bf8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:15.195350 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d040ed-f372-4859-a499-151a30704bf8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:15.196918 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d040ed-f372-4859-a499-151a30704bf8 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:15.208157 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1058/2107] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:04:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:04:15.356316 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d449ff9c-bc0a-4039-9620-50f68008070c None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:15.358271 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-d449ff9c-bc0a-4039-9620-50f68008070c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:15.389371 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d449ff9c-bc0a-4039-9620-50f68008070c None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:15.408586 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eae974a-e4ab-4823-adf8-866551c47dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:15.409563 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eae974a-e4ab-4823-adf8-866551c47dbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:15.410453 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eae974a-e4ab-4823-adf8-866551c47dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:15.414661 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eae974a-e4ab-4823-adf8-866551c47dbe admin admin] PATH_INFO: `/v3/projects/9f8fd71b353a4fa88bc7e9992a77101c` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:15.416170 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eae974a-e4ab-4823-adf8-866551c47dbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f8fd71b353a4fa88bc7e9992a77101c)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:15.421290 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eae974a-e4ab-4823-adf8-866551c47dbe admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:15.450162 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d040ed-f372-4859-a499-151a30704bf8 service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:15.452084 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-26d040ed-f372-4859-a499-151a30704bf8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:15.478298 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d040ed-f372-4859-a499-151a30704bf8 service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:15.491530 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a62a65b-5e10-4ecc-bcde-03a8de4c76d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:15.495835 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a62a65b-5e10-4ecc-bcde-03a8de4c76d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:15.496927 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a62a65b-5e10-4ecc-bcde-03a8de4c76d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:15.497431 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a62a65b-5e10-4ecc-bcde-03a8de4c76d6 admin admin] PATH_INFO: `/v3/projects/210e7b21e6534787aded9e1d5b2d9d9a` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:15.500190 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a62a65b-5e10-4ecc-bcde-03a8de4c76d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=210e7b21e6534787aded9e1d5b2d9d9a)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:15.502450 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a62a65b-5e10-4ecc-bcde-03a8de4c76d6 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:15.562608 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-3eae974a-e4ab-4823-adf8-866551c47dbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f8fd71b353a4fa88bc7e9992a77101c', 'request_id': 'req-3eae974a-e4ab-4823-adf8-866551c47dbe'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:15.576881 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-3eae974a-e4ab-4823-adf8-866551c47dbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f8fd71b353a4fa88bc7e9992a77101c', 'request_id': 'req-3eae974a-e4ab-4823-adf8-866551c47dbe'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:15.589055 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-4a62a65b-5e10-4ecc-bcde-03a8de4c76d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '210e7b21e6534787aded9e1d5b2d9d9a', 'request_id': 'req-4a62a65b-5e10-4ecc-bcde-03a8de4c76d6'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:15.596016 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-3eae974a-e4ab-4823-adf8-866551c47dbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f8fd71b353a4fa88bc7e9992a77101c', 'request_id': 'req-3eae974a-e4ab-4823-adf8-866551c47dbe'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:15.604916 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-4a62a65b-5e10-4ecc-bcde-03a8de4c76d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '210e7b21e6534787aded9e1d5b2d9d9a', 'request_id': 'req-4a62a65b-5e10-4ecc-bcde-03a8de4c76d6'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:15.608860 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-3eae974a-e4ab-4823-adf8-866551c47dbe admin admin] The token cache is being invalidate because project 9f8fd71b353a4fa88bc7e9992a77101c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 10:04:15.609195 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-3eae974a-e4ab-4823-adf8-866551c47dbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:15.609896 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-3eae974a-e4ab-4823-adf8-866551c47dbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:15.612006 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1050/2108] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 10 10:04:15 2022] DELETE /identity/v3/projects/9f8fd71b353a4fa88bc7e9992a77101c => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 10:04:15.620025 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-4a62a65b-5e10-4ecc-bcde-03a8de4c76d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '210e7b21e6534787aded9e1d5b2d9d9a', 'request_id': 'req-4a62a65b-5e10-4ecc-bcde-03a8de4c76d6'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:15.621191 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08b7f0d-2fe3-4539-bc7f-14f3f97b8912 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:15.621606 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08b7f0d-2fe3-4539-bc7f-14f3f97b8912 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:15.622329 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08b7f0d-2fe3-4539-bc7f-14f3f97b8912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:15.641717 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-4a62a65b-5e10-4ecc-bcde-03a8de4c76d6 admin admin] The token cache is being invalidate because project 210e7b21e6534787aded9e1d5b2d9d9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 10:04:15.642466 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-4a62a65b-5e10-4ecc-bcde-03a8de4c76d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:15.643403 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-4a62a65b-5e10-4ecc-bcde-03a8de4c76d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:15.645997 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-a08b7f0d-2fe3-4539-bc7f-14f3f97b8912 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:04:15.647325 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-a08b7f0d-2fe3-4539-bc7f-14f3f97b8912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:15.650578 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1059/2109] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 10 10:04:15 2022] DELETE /identity/v3/projects/210e7b21e6534787aded9e1d5b2d9d9a => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:04:15.652541 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a62a65b-5e10-4ecc-bcde-03a8de4c76d6 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:15.657309 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-4a62a65b-5e10-4ecc-bcde-03a8de4c76d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:15.748103 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1051/2110] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:04:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 10:04:15.755813 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4eeac1-68b5-48fa-852f-5e6854d42b27 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:15.756300 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4eeac1-68b5-48fa-852f-5e6854d42b27 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:15.757240 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4eeac1-68b5-48fa-852f-5e6854d42b27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:15.777445 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a62a65b-5e10-4ecc-bcde-03a8de4c76d6 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:15.784769 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf34d49e-e580-412d-a2bb-30bc403ff64f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:15.785692 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf34d49e-e580-412d-a2bb-30bc403ff64f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:15.786102 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf34d49e-e580-412d-a2bb-30bc403ff64f admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:15.786478 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf34d49e-e580-412d-a2bb-30bc403ff64f admin admin] PATH_INFO: `/v3/users/5a80e21b90104c2c9a8937e57d0ab1d0` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:15.787750 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf34d49e-e580-412d-a2bb-30bc403ff64f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a80e21b90104c2c9a8937e57d0ab1d0)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:15.789648 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-3b4eeac1-68b5-48fa-852f-5e6854d42b27 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:04:15.790512 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf34d49e-e580-412d-a2bb-30bc403ff64f admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:15.791335 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-3b4eeac1-68b5-48fa-852f-5e6854d42b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:15.833262 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1052/2111] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:04:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:04:15.834248 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4eeac1-68b5-48fa-852f-5e6854d42b27 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:15.836369 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-3b4eeac1-68b5-48fa-852f-5e6854d42b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:15.852403 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4eeac1-68b5-48fa-852f-5e6854d42b27 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:15.859772 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323a5aaf-5063-418b-b6df-c4f75cf15ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:15.860537 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323a5aaf-5063-418b-b6df-c4f75cf15ce9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:15.861675 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323a5aaf-5063-418b-b6df-c4f75cf15ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:15.861976 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323a5aaf-5063-418b-b6df-c4f75cf15ce9 admin admin] PATH_INFO: `/v3/projects/6f0ac72a70754f199adb0ec4a849ad5b` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:15.863294 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323a5aaf-5063-418b-b6df-c4f75cf15ce9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f0ac72a70754f199adb0ec4a849ad5b)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:15.865365 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323a5aaf-5063-418b-b6df-c4f75cf15ce9 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:15.902314 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-cf34d49e-e580-412d-a2bb-30bc403ff64f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a80e21b90104c2c9a8937e57d0ab1d0'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:15.912289 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-cf34d49e-e580-412d-a2bb-30bc403ff64f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a80e21b90104c2c9a8937e57d0ab1d0'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:15.913264 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-cf34d49e-e580-412d-a2bb-30bc403ff64f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a80e21b90104c2c9a8937e57d0ab1d0'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:15.914084 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-cf34d49e-e580-412d-a2bb-30bc403ff64f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a80e21b90104c2c9a8937e57d0ab1d0'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:15.927352 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-cf34d49e-e580-412d-a2bb-30bc403ff64f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a80e21b90104c2c9a8937e57d0ab1d0'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:15.931076 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:04:15.942910 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-323a5aaf-5063-418b-b6df-c4f75cf15ce9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f0ac72a70754f199adb0ec4a849ad5b', 'request_id': 'req-323a5aaf-5063-418b-b6df-c4f75cf15ce9'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:15.955271 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-323a5aaf-5063-418b-b6df-c4f75cf15ce9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f0ac72a70754f199adb0ec4a849ad5b', 'request_id': 'req-323a5aaf-5063-418b-b6df-c4f75cf15ce9'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:15.966045 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-323a5aaf-5063-418b-b6df-c4f75cf15ce9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f0ac72a70754f199adb0ec4a849ad5b', 'request_id': 'req-323a5aaf-5063-418b-b6df-c4f75cf15ce9'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:15.976905 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1060/2112] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 10 10:04:15 2022] DELETE /identity/v3/users/5a80e21b90104c2c9a8937e57d0ab1d0 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:04:15.978411 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf34d49e-e580-412d-a2bb-30bc403ff64f admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:15.980018 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-cf34d49e-e580-412d-a2bb-30bc403ff64f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:15.991032 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:04:16.001890 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-323a5aaf-5063-418b-b6df-c4f75cf15ce9 admin admin] The token cache is being invalidate because project 6f0ac72a70754f199adb0ec4a849ad5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 10:04:16.002175 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-323a5aaf-5063-418b-b6df-c4f75cf15ce9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:16.007045 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-323a5aaf-5063-418b-b6df-c4f75cf15ce9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:16.011060 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1053/2113] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 10 10:04:15 2022] DELETE /identity/v3/projects/6f0ac72a70754f199adb0ec4a849ad5b => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:04:16.015402 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323a5aaf-5063-418b-b6df-c4f75cf15ce9 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:16.016907 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-323a5aaf-5063-418b-b6df-c4f75cf15ce9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:16.075415 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf34d49e-e580-412d-a2bb-30bc403ff64f admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:16.082926 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1bd72f-165d-4191-be74-b9d46cb8075e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:16.083873 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1bd72f-165d-4191-be74-b9d46cb8075e admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:16.085105 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1bd72f-165d-4191-be74-b9d46cb8075e admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:16.086332 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1bd72f-165d-4191-be74-b9d46cb8075e admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:16.091034 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1bd72f-165d-4191-be74-b9d46cb8075e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:04:16.091630 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1bd72f-165d-4191-be74-b9d46cb8075e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:16.094029 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1bd72f-165d-4191-be74-b9d46cb8075e admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:16.109727 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1061/2114] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 10 10:04:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:04:16.114713 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1bd72f-165d-4191-be74-b9d46cb8075e admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:16.116581 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-be1bd72f-165d-4191-be74-b9d46cb8075e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:16.135429 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1bd72f-165d-4191-be74-b9d46cb8075e admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:16.143239 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c388c2ae-25b7-49bd-9150-1ad7a10ab927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:16.144433 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c388c2ae-25b7-49bd-9150-1ad7a10ab927 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:16.144778 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c388c2ae-25b7-49bd-9150-1ad7a10ab927 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:16.145168 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c388c2ae-25b7-49bd-9150-1ad7a10ab927 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:16.146458 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c388c2ae-25b7-49bd-9150-1ad7a10ab927 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:16.149187 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c388c2ae-25b7-49bd-9150-1ad7a10ab927 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:16.162360 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323a5aaf-5063-418b-b6df-c4f75cf15ce9 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:16.171958 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4048c2b6-bab3-4736-bd2e-0c97a36bd225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:16.172683 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4048c2b6-bab3-4736-bd2e-0c97a36bd225 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:16.173346 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4048c2b6-bab3-4736-bd2e-0c97a36bd225 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:16.173460 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4048c2b6-bab3-4736-bd2e-0c97a36bd225 admin admin] PATH_INFO: `/v3/users/dc53c7c168194c55a781ec36cd1399a9` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:16.175254 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4048c2b6-bab3-4736-bd2e-0c97a36bd225 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc53c7c168194c55a781ec36cd1399a9)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:16.177200 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4048c2b6-bab3-4736-bd2e-0c97a36bd225 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:16.194748 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1062/2115] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 10 10:04:16 2022] POST /identity/v3/projects => generated 373 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:04:16.197904 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c388c2ae-25b7-49bd-9150-1ad7a10ab927 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:16.246650 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-4048c2b6-bab3-4736-bd2e-0c97a36bd225 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc53c7c168194c55a781ec36cd1399a9'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:16.255500 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-4048c2b6-bab3-4736-bd2e-0c97a36bd225 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc53c7c168194c55a781ec36cd1399a9'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:16.285028 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c388c2ae-25b7-49bd-9150-1ad7a10ab927 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:16.285607 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-4048c2b6-bab3-4736-bd2e-0c97a36bd225 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc53c7c168194c55a781ec36cd1399a9'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:16.286265 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-4048c2b6-bab3-4736-bd2e-0c97a36bd225 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc53c7c168194c55a781ec36cd1399a9'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:16.287021 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-4048c2b6-bab3-4736-bd2e-0c97a36bd225 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc53c7c168194c55a781ec36cd1399a9'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:16.297908 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c7ee55-f3ac-4956-8072-000dad468829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:16.298533 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c7ee55-f3ac-4956-8072-000dad468829 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:16.298818 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c7ee55-f3ac-4956-8072-000dad468829 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:16.299095 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c7ee55-f3ac-4956-8072-000dad468829 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:16.300282 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c7ee55-f3ac-4956-8072-000dad468829 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:16.302636 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c7ee55-f3ac-4956-8072-000dad468829 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:16.318948 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1054/2116] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 10 10:04:16 2022] DELETE /identity/v3/users/dc53c7c168194c55a781ec36cd1399a9 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 10:04:16.337124 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1063/2117] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 10 10:04:16 2022] POST /identity/v3/users => generated 287 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:04:16.339411 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4048c2b6-bab3-4736-bd2e-0c97a36bd225 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:16.341605 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-4048c2b6-bab3-4736-bd2e-0c97a36bd225 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:16.375818 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c7ee55-f3ac-4956-8072-000dad468829 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:16.377697 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-c8c7ee55-f3ac-4956-8072-000dad468829 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:16.393053 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c7ee55-f3ac-4956-8072-000dad468829 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:16.442720 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4048c2b6-bab3-4736-bd2e-0c97a36bd225 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:16.448593 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4e5897-f5e9-431f-aefd-e21e9812a8bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:16.449372 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4e5897-f5e9-431f-aefd-e21e9812a8bb admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:16.449725 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4e5897-f5e9-431f-aefd-e21e9812a8bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:16.450058 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4e5897-f5e9-431f-aefd-e21e9812a8bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:16.450797 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4e5897-f5e9-431f-aefd-e21e9812a8bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:16.452533 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4e5897-f5e9-431f-aefd-e21e9812a8bb admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:16.472643 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1055/2118] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:04:16 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:04:16.474399 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4e5897-f5e9-431f-aefd-e21e9812a8bb admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:16.488533 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:04:16.490591 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4e5897-f5e9-431f-aefd-e21e9812a8bb admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:16.511887 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9f5d13-6da9-4a12-8ead-e77119b436a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:16.511887 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f5d13-6da9-4a12-8ead-e77119b436a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:16.512185 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f5d13-6da9-4a12-8ead-e77119b436a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:16.514646 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f5d13-6da9-4a12-8ead-e77119b436a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:16.515957 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9f5d13-6da9-4a12-8ead-e77119b436a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:16.533824 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9f5d13-6da9-4a12-8ead-e77119b436a0 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:16.544320 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a71175-28d0-4586-b58a-cd810bc017d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:16.545007 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a71175-28d0-4586-b58a-cd810bc017d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:16.545316 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a71175-28d0-4586-b58a-cd810bc017d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:16.545592 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a71175-28d0-4586-b58a-cd810bc017d9 admin admin] PATH_INFO: `/v3/projects/fffae5366736479195cbfb5bd4d10e9b` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:16.552270 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a71175-28d0-4586-b58a-cd810bc017d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fffae5366736479195cbfb5bd4d10e9b)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:16.554423 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a71175-28d0-4586-b58a-cd810bc017d9 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:16.559332 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1056/2119] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:04:16 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:04:16.561786 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9f5d13-6da9-4a12-8ead-e77119b436a0 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:16.590487 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:04:16.603369 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9f5d13-6da9-4a12-8ead-e77119b436a0 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:16.629562 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95b7179-78de-44c3-9fb6-eae5ccd3b40f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:16.630598 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95b7179-78de-44c3-9fb6-eae5ccd3b40f admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:16.631058 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95b7179-78de-44c3-9fb6-eae5ccd3b40f admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:16.631500 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95b7179-78de-44c3-9fb6-eae5ccd3b40f admin admin] PATH_INFO: `/v3/projects/b7afd31fc374430dbe553e741a64f39e/users/aa2ab6f847474115865121773c96ea0c/roles/8daabcb6b7394e39b06a3453e33e32db` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:16.682790 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95b7179-78de-44c3-9fb6-eae5ccd3b40f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7afd31fc374430dbe553e741a64f39e, user_id=aa2ab6f847474115865121773c96ea0c, role_id=8daabcb6b7394e39b06a3453e33e32db)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:16.688867 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95b7179-78de-44c3-9fb6-eae5ccd3b40f admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:16.705582 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-63a71175-28d0-4586-b58a-cd810bc017d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fffae5366736479195cbfb5bd4d10e9b', 'request_id': 'req-63a71175-28d0-4586-b58a-cd810bc017d9'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:16.709364 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1057/2120] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:04:16 2022] PUT /identity/v3/projects/b7afd31fc374430dbe553e741a64f39e/users/aa2ab6f847474115865121773c96ea0c/roles/8daabcb6b7394e39b06a3453e33e32db => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:04:16.717198 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-63a71175-28d0-4586-b58a-cd810bc017d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fffae5366736479195cbfb5bd4d10e9b', 'request_id': 'req-63a71175-28d0-4586-b58a-cd810bc017d9'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:16.726968 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fb9337-70ba-4199-9777-485eebc995f6 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:16.727584 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fb9337-70ba-4199-9777-485eebc995f6 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:16.728110 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fb9337-70ba-4199-9777-485eebc995f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:16.738905 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-63a71175-28d0-4586-b58a-cd810bc017d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fffae5366736479195cbfb5bd4d10e9b', 'request_id': 'req-63a71175-28d0-4586-b58a-cd810bc017d9'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:16.760506 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-63a71175-28d0-4586-b58a-cd810bc017d9 admin admin] The token cache is being invalidate because project fffae5366736479195cbfb5bd4d10e9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 10:04:16.761463 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-63a71175-28d0-4586-b58a-cd810bc017d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:16.776258 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-63a71175-28d0-4586-b58a-cd810bc017d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:16.781296 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1064/2121] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 10 10:04:16 2022] DELETE /identity/v3/projects/fffae5366736479195cbfb5bd4d10e9b => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:04:16.792576 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914cab23-ef3c-4cf9-b80f-f8e447f19e86 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:16.792783 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-15fb9337-70ba-4199-9777-485eebc995f6 None None] MFA Rules not processed for user `aa2ab6f847474115865121773c96ea0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:04:16.792873 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914cab23-ef3c-4cf9-b80f-f8e447f19e86 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:16.792873 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914cab23-ef3c-4cf9-b80f-f8e447f19e86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:16.805764 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-15fb9337-70ba-4199-9777-485eebc995f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:16.824406 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-914cab23-ef3c-4cf9-b80f-f8e447f19e86 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:04:16.826008 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-914cab23-ef3c-4cf9-b80f-f8e447f19e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:16.967573 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1065/2122] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:04:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:04:16.975049 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914cab23-ef3c-4cf9-b80f-f8e447f19e86 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:16.983841 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-914cab23-ef3c-4cf9-b80f-f8e447f19e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:16.992671 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1058/2123] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:04:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:04:16.992671 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f1fa29-d68f-463a-9a80-5e5e9718ee0d None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:16.993636 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f1fa29-d68f-463a-9a80-5e5e9718ee0d None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:16.994743 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f1fa29-d68f-463a-9a80-5e5e9718ee0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:17.002745 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914cab23-ef3c-4cf9-b80f-f8e447f19e86 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:17.018422 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e7cd5d-01a7-4fa3-93ca-d913cf183f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:17.019098 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e7cd5d-01a7-4fa3-93ca-d913cf183f29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:17.019372 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e7cd5d-01a7-4fa3-93ca-d913cf183f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:17.019650 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e7cd5d-01a7-4fa3-93ca-d913cf183f29 admin admin] PATH_INFO: `/v3/projects/7e83a05cedad4b1eaefeb8f37e3b9cb8` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:17.020922 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e7cd5d-01a7-4fa3-93ca-d913cf183f29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e83a05cedad4b1eaefeb8f37e3b9cb8)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:17.022987 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e7cd5d-01a7-4fa3-93ca-d913cf183f29 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:17.032826 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-34f1fa29-d68f-463a-9a80-5e5e9718ee0d None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:04:17.036178 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-34f1fa29-d68f-463a-9a80-5e5e9718ee0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:17.052719 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1059/2124] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:04:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:04:17.054822 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f1fa29-d68f-463a-9a80-5e5e9718ee0d None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:17.058054 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-34f1fa29-d68f-463a-9a80-5e5e9718ee0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:17.150601 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-25e7cd5d-01a7-4fa3-93ca-d913cf183f29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e83a05cedad4b1eaefeb8f37e3b9cb8', 'request_id': 'req-25e7cd5d-01a7-4fa3-93ca-d913cf183f29'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:17.167679 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-25e7cd5d-01a7-4fa3-93ca-d913cf183f29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e83a05cedad4b1eaefeb8f37e3b9cb8', 'request_id': 'req-25e7cd5d-01a7-4fa3-93ca-d913cf183f29'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:17.190151 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f1fa29-d68f-463a-9a80-5e5e9718ee0d None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:17.190506 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-25e7cd5d-01a7-4fa3-93ca-d913cf183f29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e83a05cedad4b1eaefeb8f37e3b9cb8', 'request_id': 'req-25e7cd5d-01a7-4fa3-93ca-d913cf183f29'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:17.200887 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:04:17.205890 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-25e7cd5d-01a7-4fa3-93ca-d913cf183f29 admin admin] The token cache is being invalidate because project 7e83a05cedad4b1eaefeb8f37e3b9cb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 10:04:17.206269 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-25e7cd5d-01a7-4fa3-93ca-d913cf183f29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:17.208038 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-25e7cd5d-01a7-4fa3-93ca-d913cf183f29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:17.210134 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1066/2125] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 10 10:04:16 2022] DELETE /identity/v3/projects/7e83a05cedad4b1eaefeb8f37e3b9cb8 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:04:17.214749 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e7cd5d-01a7-4fa3-93ca-d913cf183f29 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:17.216910 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-25e7cd5d-01a7-4fa3-93ca-d913cf183f29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:17.287622 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71064fa3-4090-4fa7-a088-51b37405a3c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf8e725cbe0403d943b136235eac057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:17.288556 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71064fa3-4090-4fa7-a088-51b37405a3c9 service cinder] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:17.288798 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71064fa3-4090-4fa7-a088-51b37405a3c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:17.289242 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71064fa3-4090-4fa7-a088-51b37405a3c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:17.291668 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-71064fa3-4090-4fa7-a088-51b37405a3c9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:17.338739 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e7cd5d-01a7-4fa3-93ca-d913cf183f29 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:17.343764 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:04:17.350378 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10e044c-4721-4019-9027-0816d32a3473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:17.351120 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10e044c-4721-4019-9027-0816d32a3473 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:17.351714 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10e044c-4721-4019-9027-0816d32a3473 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:17.360046 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10e044c-4721-4019-9027-0816d32a3473 admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:17.363290 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10e044c-4721-4019-9027-0816d32a3473 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:04:17.364708 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10e044c-4721-4019-9027-0816d32a3473 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:17.366639 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10e044c-4721-4019-9027-0816d32a3473 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:17.411782 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1067/2126] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 10 10:04:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:04:17.413385 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd48a823-6b11-43b3-a695-c23d7e363bed None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:17.415191 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd48a823-6b11-43b3-a695-c23d7e363bed None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:17.417102 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd48a823-6b11-43b3-a695-c23d7e363bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:17.419895 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71064fa3-4090-4fa7-a088-51b37405a3c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:17.422196 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71064fa3-4090-4fa7-a088-51b37405a3c9 service cinder] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:17.437465 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1060/2127] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:04:17 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:04:17.438688 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71064fa3-4090-4fa7-a088-51b37405a3c9 service cinder] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:17.444911 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-cd48a823-6b11-43b3-a695-c23d7e363bed None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:04:17.446941 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-cd48a823-6b11-43b3-a695-c23d7e363bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:17.452087 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71064fa3-4090-4fa7-a088-51b37405a3c9 service cinder] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:17.456435 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1068/2128] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:04:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:04:17.460881 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9193576-b471-4b43-922e-17a78cff6157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:17.461728 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9193576-b471-4b43-922e-17a78cff6157 admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:17.462107 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9193576-b471-4b43-922e-17a78cff6157 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:17.462468 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9193576-b471-4b43-922e-17a78cff6157 admin admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:17.463290 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9193576-b471-4b43-922e-17a78cff6157 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:17.465591 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9193576-b471-4b43-922e-17a78cff6157 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:17.466017 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371230cc-8626-4af6-8f75-3c92ce0463e6 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:17.466242 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371230cc-8626-4af6-8f75-3c92ce0463e6 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:17.466520 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371230cc-8626-4af6-8f75-3c92ce0463e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:17.496644 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-371230cc-8626-4af6-8f75-3c92ce0463e6 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:04:17.498208 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-371230cc-8626-4af6-8f75-3c92ce0463e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:17.510587 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1069/2129] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:04:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 10:04:17.515880 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371230cc-8626-4af6-8f75-3c92ce0463e6 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:17.520040 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1061/2130] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 10 10:04:17 2022] POST /identity/v3/projects => generated 391 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:04:17.521051 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9193576-b471-4b43-922e-17a78cff6157 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:17.528882 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371230cc-8626-4af6-8f75-3c92ce0463e6 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:17.642026 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe97093-f751-4c26-97a3-ec42bef4b98b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:17.642370 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9193576-b471-4b43-922e-17a78cff6157 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:17.643010 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe97093-f751-4c26-97a3-ec42bef4b98b admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:17.643441 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe97093-f751-4c26-97a3-ec42bef4b98b admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:17.644746 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe97093-f751-4c26-97a3-ec42bef4b98b admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:17.645592 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe97093-f751-4c26-97a3-ec42bef4b98b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:04:17.646202 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe97093-f751-4c26-97a3-ec42bef4b98b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:17.647829 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dff7b0-aa08-4ec1-81cc-3f0933115dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:17.648590 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dff7b0-aa08-4ec1-81cc-3f0933115dbf admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:17.648722 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe97093-f751-4c26-97a3-ec42bef4b98b admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:17.648982 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dff7b0-aa08-4ec1-81cc-3f0933115dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:17.649340 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dff7b0-aa08-4ec1-81cc-3f0933115dbf admin admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:17.650113 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dff7b0-aa08-4ec1-81cc-3f0933115dbf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:17.652526 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dff7b0-aa08-4ec1-81cc-3f0933115dbf admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:17.669107 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1070/2131] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 10 10:04:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:04:17.674108 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe97093-f751-4c26-97a3-ec42bef4b98b admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:17.693995 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe97093-f751-4c26-97a3-ec42bef4b98b admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:17.698059 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1062/2132] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 10 10:04:17 2022] POST /identity/v3/users => generated 296 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:04:17.702272 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dff7b0-aa08-4ec1-81cc-3f0933115dbf admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:17.704404 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415976c2-b978-4856-981d-9f46b101c40d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:17.705180 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415976c2-b978-4856-981d-9f46b101c40d admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:17.705566 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415976c2-b978-4856-981d-9f46b101c40d admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:17.706336 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415976c2-b978-4856-981d-9f46b101c40d admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:17.707119 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415976c2-b978-4856-981d-9f46b101c40d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:17.709392 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415976c2-b978-4856-981d-9f46b101c40d admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:17.727321 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dff7b0-aa08-4ec1-81cc-3f0933115dbf admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:17.735016 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fb9a20-1749-474b-bb09-be492c20c9bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:17.735733 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fb9a20-1749-474b-bb09-be492c20c9bf admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:17.736012 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fb9a20-1749-474b-bb09-be492c20c9bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:17.736282 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fb9a20-1749-474b-bb09-be492c20c9bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:17.737043 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fb9a20-1749-474b-bb09-be492c20c9bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:17.740482 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fb9a20-1749-474b-bb09-be492c20c9bf admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:17.760800 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1063/2133] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:04:17 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:04:17.774723 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fb9a20-1749-474b-bb09-be492c20c9bf admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:17.787855 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1071/2134] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 10 10:04:17 2022] POST /identity/v3/projects => generated 401 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:04:17.789486 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415976c2-b978-4856-981d-9f46b101c40d admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:17.805980 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fb9a20-1749-474b-bb09-be492c20c9bf admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:17.897885 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:04:17.925693 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415976c2-b978-4856-981d-9f46b101c40d admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:17.935278 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2b2385-08ad-4c6a-9be0-9a36ea38282a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:17.936075 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2b2385-08ad-4c6a-9be0-9a36ea38282a admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:17.936530 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2b2385-08ad-4c6a-9be0-9a36ea38282a admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:17.937270 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2b2385-08ad-4c6a-9be0-9a36ea38282a admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:17.937975 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2b2385-08ad-4c6a-9be0-9a36ea38282a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:17.940007 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2b2385-08ad-4c6a-9be0-9a36ea38282a admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:17.941403 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aec86b-3436-4e7c-8c6e-ac3297aa1673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:17.942041 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aec86b-3436-4e7c-8c6e-ac3297aa1673 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:17.942327 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aec86b-3436-4e7c-8c6e-ac3297aa1673 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:17.942882 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aec86b-3436-4e7c-8c6e-ac3297aa1673 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:17.943800 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77aec86b-3436-4e7c-8c6e-ac3297aa1673 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:17.945886 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77aec86b-3436-4e7c-8c6e-ac3297aa1673 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:17.955331 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1064/2135] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:04:17 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:04:17.959614 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2b2385-08ad-4c6a-9be0-9a36ea38282a admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:17.975610 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2b2385-08ad-4c6a-9be0-9a36ea38282a admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:17.989021 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1072/2136] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 10 10:04:17 2022] POST /identity/v3/users => generated 301 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:04:17.990089 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e412da48-e364-4e04-96fb-e5ddc0d16650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:17.990846 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e412da48-e364-4e04-96fb-e5ddc0d16650 admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:17.992234 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e412da48-e364-4e04-96fb-e5ddc0d16650 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:17.992596 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e412da48-e364-4e04-96fb-e5ddc0d16650 admin admin] PATH_INFO: `/v3/projects/60d2587e64784b6a86e0afd2a5d20535/users/bf4df90d708844b5bcb454927bb2297b/roles/8daabcb6b7394e39b06a3453e33e32db` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:17.993403 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aec86b-3436-4e7c-8c6e-ac3297aa1673 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:18.006504 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aec86b-3436-4e7c-8c6e-ac3297aa1673 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:18.016278 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01947e1-a4ad-4d99-a333-ed3e46e81536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:18.018894 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01947e1-a4ad-4d99-a333-ed3e46e81536 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:18.019188 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01947e1-a4ad-4d99-a333-ed3e46e81536 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:18.019525 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01947e1-a4ad-4d99-a333-ed3e46e81536 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:18.020249 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01947e1-a4ad-4d99-a333-ed3e46e81536 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:18.022769 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01947e1-a4ad-4d99-a333-ed3e46e81536 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:18.026383 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e412da48-e364-4e04-96fb-e5ddc0d16650 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60d2587e64784b6a86e0afd2a5d20535, user_id=bf4df90d708844b5bcb454927bb2297b, role_id=8daabcb6b7394e39b06a3453e33e32db)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:18.029245 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e412da48-e364-4e04-96fb-e5ddc0d16650 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:18.048983 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:04:18.050995 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1073/2137] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:04:17 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 10:04:18.057979 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01947e1-a4ad-4d99-a333-ed3e46e81536 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:18.060763 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1065/2138] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:04:17 2022] PUT /identity/v3/projects/60d2587e64784b6a86e0afd2a5d20535/users/bf4df90d708844b5bcb454927bb2297b/roles/8daabcb6b7394e39b06a3453e33e32db => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:04:18.073472 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01947e1-a4ad-4d99-a333-ed3e46e81536 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:18.074917 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1114c00-1478-4063-8fa2-3e5bbfab9afa None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:18.075244 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1114c00-1478-4063-8fa2-3e5bbfab9afa None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:18.075498 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1114c00-1478-4063-8fa2-3e5bbfab9afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:18.144789 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-f1114c00-1478-4063-8fa2-3e5bbfab9afa None None] MFA Rules not processed for user `bf4df90d708844b5bcb454927bb2297b`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:04:18.149098 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-f1114c00-1478-4063-8fa2-3e5bbfab9afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:18.208001 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a6a26e-dac8-4ae4-a0dd-c8bde604f0ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:18.208699 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a6a26e-dac8-4ae4-a0dd-c8bde604f0ec admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:18.209098 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a6a26e-dac8-4ae4-a0dd-c8bde604f0ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:18.209430 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a6a26e-dac8-4ae4-a0dd-c8bde604f0ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:18.210282 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a6a26e-dac8-4ae4-a0dd-c8bde604f0ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:18.212415 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a6a26e-dac8-4ae4-a0dd-c8bde604f0ec admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:18.228263 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1074/2139] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:04:18 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 10:04:18.229419 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a6a26e-dac8-4ae4-a0dd-c8bde604f0ec admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:18.244502 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a6a26e-dac8-4ae4-a0dd-c8bde604f0ec admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:18.253317 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d168cfe-90fe-4c1c-b1ce-5dec5965987b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:18.254203 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d168cfe-90fe-4c1c-b1ce-5dec5965987b admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:18.254747 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d168cfe-90fe-4c1c-b1ce-5dec5965987b admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:18.255484 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d168cfe-90fe-4c1c-b1ce-5dec5965987b admin admin] PATH_INFO: `/v3/projects/dc825f14ff394cd1a6a359804fa8b32e/users/13495993a2f947c383c0445aca2e57da/roles/8daabcb6b7394e39b06a3453e33e32db` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:18.277950 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d168cfe-90fe-4c1c-b1ce-5dec5965987b admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc825f14ff394cd1a6a359804fa8b32e, user_id=13495993a2f947c383c0445aca2e57da, role_id=8daabcb6b7394e39b06a3453e33e32db)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:18.280381 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d168cfe-90fe-4c1c-b1ce-5dec5965987b admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:18.286256 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1066/2140] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:04:18 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:04:18.297773 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1075/2141] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:04:18 2022] PUT /identity/v3/projects/dc825f14ff394cd1a6a359804fa8b32e/users/13495993a2f947c383c0445aca2e57da/roles/8daabcb6b7394e39b06a3453e33e32db => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:04:18.297992 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1114c00-1478-4063-8fa2-3e5bbfab9afa None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:18.299374 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-f1114c00-1478-4063-8fa2-3e5bbfab9afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:18.310585 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efae5269-d841-4461-a818-f27c133f4b4c None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:18.310585 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efae5269-d841-4461-a818-f27c133f4b4c None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:18.310780 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efae5269-d841-4461-a818-f27c133f4b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:18.347569 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-efae5269-d841-4461-a818-f27c133f4b4c None None] MFA Rules not processed for user `13495993a2f947c383c0445aca2e57da`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:04:18.349085 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-efae5269-d841-4461-a818-f27c133f4b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:18.379082 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1114c00-1478-4063-8fa2-3e5bbfab9afa None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:18.419772 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1076/2142] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:04:18 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:04:18.420640 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efae5269-d841-4461-a818-f27c133f4b4c None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:18.422002 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-efae5269-d841-4461-a818-f27c133f4b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:18.434448 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25d8abd-a2af-429e-991a-3488dc97c6dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf8e725cbe0403d943b136235eac057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:18.435381 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25d8abd-a2af-429e-991a-3488dc97c6dc service cinder] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:18.435381 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25d8abd-a2af-429e-991a-3488dc97c6dc service cinder] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:18.435570 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25d8abd-a2af-429e-991a-3488dc97c6dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:18.460212 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:04:18.497608 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25d8abd-a2af-429e-991a-3488dc97c6dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:18.498915 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efae5269-d841-4461-a818-f27c133f4b4c None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:18.499062 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25d8abd-a2af-429e-991a-3488dc97c6dc service cinder] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:18.503615 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:04:18.504258 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaea65a-5ec4-4937-a25f-94b3bada9e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:18.504974 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaea65a-5ec4-4937-a25f-94b3bada9e3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:18.505380 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaea65a-5ec4-4937-a25f-94b3bada9e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:18.505613 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaea65a-5ec4-4937-a25f-94b3bada9e3f admin admin] PATH_INFO: `/v3/users/ec9393db1a3841098f79ff5a6a493dc4` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:18.506895 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaea65a-5ec4-4937-a25f-94b3bada9e3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec9393db1a3841098f79ff5a6a493dc4)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:18.508932 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaea65a-5ec4-4937-a25f-94b3bada9e3f admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:18.509699 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1067/2143] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:04:18 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 10:04:18.511277 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25d8abd-a2af-429e-991a-3488dc97c6dc service cinder] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:18.527116 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25d8abd-a2af-429e-991a-3488dc97c6dc service cinder] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:18.534000 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbb4c1e-09e8-4d17-874e-99de5df8ada9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:18.535263 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbb4c1e-09e8-4d17-874e-99de5df8ada9 admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:18.535584 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbb4c1e-09e8-4d17-874e-99de5df8ada9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:18.536167 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbb4c1e-09e8-4d17-874e-99de5df8ada9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:18.536916 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbb4c1e-09e8-4d17-874e-99de5df8ada9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:18.539166 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbb4c1e-09e8-4d17-874e-99de5df8ada9 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:18.563509 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-abaea65a-5ec4-4937-a25f-94b3bada9e3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec9393db1a3841098f79ff5a6a493dc4'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:18.571592 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-abaea65a-5ec4-4937-a25f-94b3bada9e3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec9393db1a3841098f79ff5a6a493dc4'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:18.572226 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-abaea65a-5ec4-4937-a25f-94b3bada9e3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec9393db1a3841098f79ff5a6a493dc4'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:18.572989 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-abaea65a-5ec4-4937-a25f-94b3bada9e3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec9393db1a3841098f79ff5a6a493dc4'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:18.576617 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1068/2144] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 10 10:04:18 2022] POST /identity/v3/projects => generated 401 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:04:18.578041 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbb4c1e-09e8-4d17-874e-99de5df8ada9 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:18.580819 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-5cbb4c1e-09e8-4d17-874e-99de5df8ada9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:18.581774 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-abaea65a-5ec4-4937-a25f-94b3bada9e3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec9393db1a3841098f79ff5a6a493dc4'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:18.605494 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1077/2145] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 10 10:04:18 2022] DELETE /identity/v3/users/ec9393db1a3841098f79ff5a6a493dc4 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:04:18.630765 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaea65a-5ec4-4937-a25f-94b3bada9e3f admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:18.632499 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-abaea65a-5ec4-4937-a25f-94b3bada9e3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:18.705895 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbb4c1e-09e8-4d17-874e-99de5df8ada9 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:18.760823 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaea65a-5ec4-4937-a25f-94b3bada9e3f admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:18.767827 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e932458-ec9c-48ac-899c-8eb542386405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:18.768795 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e932458-ec9c-48ac-899c-8eb542386405 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:18.772013 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e932458-ec9c-48ac-899c-8eb542386405 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:18.772297 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e932458-ec9c-48ac-899c-8eb542386405 admin admin] PATH_INFO: `/v3/users/5c3130ab850d4586859b0ca7fd1516c6` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:18.773592 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e932458-ec9c-48ac-899c-8eb542386405 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c3130ab850d4586859b0ca7fd1516c6)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:18.775527 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e932458-ec9c-48ac-899c-8eb542386405 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:18.801188 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b3ecba-5adf-4f9c-a46b-45a61ba8d5b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:18.801891 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b3ecba-5adf-4f9c-a46b-45a61ba8d5b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:18.802285 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b3ecba-5adf-4f9c-a46b-45a61ba8d5b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:18.802524 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b3ecba-5adf-4f9c-a46b-45a61ba8d5b2 admin admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:18.803208 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b3ecba-5adf-4f9c-a46b-45a61ba8d5b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:18.806034 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b3ecba-5adf-4f9c-a46b-45a61ba8d5b2 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:18.838067 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-1e932458-ec9c-48ac-899c-8eb542386405 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c3130ab850d4586859b0ca7fd1516c6'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:18.840457 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1069/2146] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 10 10:04:18 2022] POST /identity/v3/users => generated 307 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:04:18.843052 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:04:18.845159 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b3ecba-5adf-4f9c-a46b-45a61ba8d5b2 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:18.854351 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-1e932458-ec9c-48ac-899c-8eb542386405 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c3130ab850d4586859b0ca7fd1516c6'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:18.854918 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-1e932458-ec9c-48ac-899c-8eb542386405 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c3130ab850d4586859b0ca7fd1516c6'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:18.856363 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-1e932458-ec9c-48ac-899c-8eb542386405 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c3130ab850d4586859b0ca7fd1516c6'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:18.859876 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b3ecba-5adf-4f9c-a46b-45a61ba8d5b2 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:18.866489 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de069b8-9e8a-4b69-ae4f-5962334840d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:18.867127 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de069b8-9e8a-4b69-ae4f-5962334840d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:18.867525 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de069b8-9e8a-4b69-ae4f-5962334840d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:18.868103 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de069b8-9e8a-4b69-ae4f-5962334840d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:18.868673 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de069b8-9e8a-4b69-ae4f-5962334840d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:18.870890 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de069b8-9e8a-4b69-ae4f-5962334840d7 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:18.873547 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-1e932458-ec9c-48ac-899c-8eb542386405 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c3130ab850d4586859b0ca7fd1516c6'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:18.885190 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1070/2147] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:04:18 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:04:18.888595 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de069b8-9e8a-4b69-ae4f-5962334840d7 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:18.890973 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-1de069b8-9e8a-4b69-ae4f-5962334840d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:18.899246 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1078/2148] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 10 10:04:18 2022] DELETE /identity/v3/users/5c3130ab850d4586859b0ca7fd1516c6 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 10:04:18.904549 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14206e7e-360d-43d5-b15a-dca2c1b7eeb0 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:18.906045 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14206e7e-360d-43d5-b15a-dca2c1b7eeb0 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:18.906045 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14206e7e-360d-43d5-b15a-dca2c1b7eeb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:18.912578 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de069b8-9e8a-4b69-ae4f-5962334840d7 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:18.969319 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-14206e7e-360d-43d5-b15a-dca2c1b7eeb0 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:04:18.970686 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-14206e7e-360d-43d5-b15a-dca2c1b7eeb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:19.000088 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eb33c3-b1a7-4068-bab2-d5c6baf43e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:19.001094 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eb33c3-b1a7-4068-bab2-d5c6baf43e3e admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:19.001562 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eb33c3-b1a7-4068-bab2-d5c6baf43e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:19.002059 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eb33c3-b1a7-4068-bab2-d5c6baf43e3e admin admin] PATH_INFO: `/v3/projects/56b6c17ce05b42f489f28619bc24b949/users/d84a5c9f87d7445ab4e9c572f08b967f/roles/eb04edc46b3742d7a0f0ead26f68bc22` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:19.014263 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:04:19.025001 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eb33c3-b1a7-4068-bab2-d5c6baf43e3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=56b6c17ce05b42f489f28619bc24b949, user_id=d84a5c9f87d7445ab4e9c572f08b967f, role_id=eb04edc46b3742d7a0f0ead26f68bc22)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:19.027983 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eb33c3-b1a7-4068-bab2-d5c6baf43e3e admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:19.044382 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1071/2149] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:04:18 2022] PUT /identity/v3/projects/56b6c17ce05b42f489f28619bc24b949/users/d84a5c9f87d7445ab4e9c572f08b967f/roles/eb04edc46b3742d7a0f0ead26f68bc22 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:04:19.048832 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eb33c3-b1a7-4068-bab2-d5c6baf43e3e admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:19.050849 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-30eb33c3-b1a7-4068-bab2-d5c6baf43e3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:19.059869 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1079/2150] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:04:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:04:19.060718 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14206e7e-360d-43d5-b15a-dca2c1b7eeb0 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:19.070398 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14206e7e-360d-43d5-b15a-dca2c1b7eeb0 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:19.117512 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eb33c3-b1a7-4068-bab2-d5c6baf43e3e admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:19.122265 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e6fe99-a8cd-45e0-97be-e611898dfdd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:19.122892 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e6fe99-a8cd-45e0-97be-e611898dfdd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:19.123179 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e6fe99-a8cd-45e0-97be-e611898dfdd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:19.123455 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e6fe99-a8cd-45e0-97be-e611898dfdd9 admin admin] PATH_INFO: `/v3/projects/a23a65853a7f427c923d0ee40079b9ec` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:19.124567 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e6fe99-a8cd-45e0-97be-e611898dfdd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a23a65853a7f427c923d0ee40079b9ec)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:19.126563 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e6fe99-a8cd-45e0-97be-e611898dfdd9 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:19.126895 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda516ee-257b-4ca9-ae91-a729d0605cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:19.127510 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda516ee-257b-4ca9-ae91-a729d0605cbb admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:19.127794 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda516ee-257b-4ca9-ae91-a729d0605cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:19.128127 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda516ee-257b-4ca9-ae91-a729d0605cbb admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:19.128910 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda516ee-257b-4ca9-ae91-a729d0605cbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:19.130494 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda516ee-257b-4ca9-ae91-a729d0605cbb admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:19.141707 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1080/2151] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:04:19 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:04:19.142638 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda516ee-257b-4ca9-ae91-a729d0605cbb admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:19.145274 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-eda516ee-257b-4ca9-ae91-a729d0605cbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:19.182001 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-13e6fe99-a8cd-45e0-97be-e611898dfdd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a23a65853a7f427c923d0ee40079b9ec', 'request_id': 'req-13e6fe99-a8cd-45e0-97be-e611898dfdd9'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:19.187696 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-13e6fe99-a8cd-45e0-97be-e611898dfdd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a23a65853a7f427c923d0ee40079b9ec', 'request_id': 'req-13e6fe99-a8cd-45e0-97be-e611898dfdd9'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:19.195796 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-13e6fe99-a8cd-45e0-97be-e611898dfdd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a23a65853a7f427c923d0ee40079b9ec', 'request_id': 'req-13e6fe99-a8cd-45e0-97be-e611898dfdd9'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:19.205853 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda516ee-257b-4ca9-ae91-a729d0605cbb admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:19.210207 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-13e6fe99-a8cd-45e0-97be-e611898dfdd9 admin admin] The token cache is being invalidate because project a23a65853a7f427c923d0ee40079b9ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 10:04:19.210584 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-13e6fe99-a8cd-45e0-97be-e611898dfdd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:19.211613 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-13e6fe99-a8cd-45e0-97be-e611898dfdd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:19.213412 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1072/2152] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 10 10:04:19 2022] DELETE /identity/v3/projects/a23a65853a7f427c923d0ee40079b9ec => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:04:19.217739 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e6fe99-a8cd-45e0-97be-e611898dfdd9 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:19.219190 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-13e6fe99-a8cd-45e0-97be-e611898dfdd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:19.228585 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:04:19.262350 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684aa2d9-f4e8-4085-8a51-e72d5703edba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4294c170df354fe892831281acd4ea7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:19.262964 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684aa2d9-f4e8-4085-8a51-e72d5703edba service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:19.263253 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684aa2d9-f4e8-4085-8a51-e72d5703edba service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:19.263525 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684aa2d9-f4e8-4085-8a51-e72d5703edba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:19.267383 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-684aa2d9-f4e8-4085-8a51-e72d5703edba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:19.302461 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e6fe99-a8cd-45e0-97be-e611898dfdd9 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:19.307730 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8725acb-872e-46ca-9833-dbb6860e4482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:19.308389 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8725acb-872e-46ca-9833-dbb6860e4482 admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:19.308686 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8725acb-872e-46ca-9833-dbb6860e4482 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:19.308927 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8725acb-872e-46ca-9833-dbb6860e4482 admin admin] PATH_INFO: `/v3/projects/56b6c17ce05b42f489f28619bc24b949/users/d84a5c9f87d7445ab4e9c572f08b967f/roles/eb04edc46b3742d7a0f0ead26f68bc22` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:19.310833 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8725acb-872e-46ca-9833-dbb6860e4482 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56b6c17ce05b42f489f28619bc24b949, user_id=d84a5c9f87d7445ab4e9c572f08b967f, role_id=eb04edc46b3742d7a0f0ead26f68bc22)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:19.313529 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8725acb-872e-46ca-9833-dbb6860e4482 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:19.329631 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1073/2153] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:04:19 2022] PUT /identity/v3/projects/56b6c17ce05b42f489f28619bc24b949/users/d84a5c9f87d7445ab4e9c572f08b967f/roles/eb04edc46b3742d7a0f0ead26f68bc22 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:04:19.329631 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88366d7d-c426-4d5c-9b72-7eeebbcfa51b None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:19.329631 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88366d7d-c426-4d5c-9b72-7eeebbcfa51b None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:19.329631 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88366d7d-c426-4d5c-9b72-7eeebbcfa51b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:19.352062 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684aa2d9-f4e8-4085-8a51-e72d5703edba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:19.354035 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684aa2d9-f4e8-4085-8a51-e72d5703edba service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:19.354149 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-88366d7d-c426-4d5c-9b72-7eeebbcfa51b None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:04:19.355297 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-88366d7d-c426-4d5c-9b72-7eeebbcfa51b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:19.362321 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:04:19.367409 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1081/2154] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:04:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:04:19.369013 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b4f2b-2669-47d1-900d-31c458539988 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:19.369329 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b4f2b-2669-47d1-900d-31c458539988 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:19.369714 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b4f2b-2669-47d1-900d-31c458539988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:19.409423 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-769b4f2b-2669-47d1-900d-31c458539988 None None] MFA Rules not processed for user `d84a5c9f87d7445ab4e9c572f08b967f`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:04:19.411020 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-769b4f2b-2669-47d1-900d-31c458539988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:19.433691 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1074/2155] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:04:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:04:19.443643 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3376a9e-e6d9-49eb-aa68-492a20bdf905 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:19.443930 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3376a9e-e6d9-49eb-aa68-492a20bdf905 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:19.444206 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3376a9e-e6d9-49eb-aa68-492a20bdf905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:19.468685 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-e3376a9e-e6d9-49eb-aa68-492a20bdf905 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:04:19.470479 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-e3376a9e-e6d9-49eb-aa68-492a20bdf905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:19.482027 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1075/2156] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:04:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:04:19.486566 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3376a9e-e6d9-49eb-aa68-492a20bdf905 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:19.498546 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3376a9e-e6d9-49eb-aa68-492a20bdf905 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:19.504728 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b628e6-9f11-4af2-84b5-038cf4cc6d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:19.505620 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b628e6-9f11-4af2-84b5-038cf4cc6d32 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:19.505934 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b628e6-9f11-4af2-84b5-038cf4cc6d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:19.506308 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b628e6-9f11-4af2-84b5-038cf4cc6d32 admin admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:19.507817 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b628e6-9f11-4af2-84b5-038cf4cc6d32 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:04:19.508167 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b628e6-9f11-4af2-84b5-038cf4cc6d32 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:19.510487 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b628e6-9f11-4af2-84b5-038cf4cc6d32 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:19.526779 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1076/2157] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 10 10:04:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:04:19.531896 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b628e6-9f11-4af2-84b5-038cf4cc6d32 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:19.545264 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1082/2158] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:04:19 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:04:19.547559 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b628e6-9f11-4af2-84b5-038cf4cc6d32 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:19.553085 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38571610-9aa7-4279-b920-4ac85846ced1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:19.554421 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38571610-9aa7-4279-b920-4ac85846ced1 admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:19.554421 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38571610-9aa7-4279-b920-4ac85846ced1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:19.554708 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38571610-9aa7-4279-b920-4ac85846ced1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:19.555763 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38571610-9aa7-4279-b920-4ac85846ced1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:19.558207 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38571610-9aa7-4279-b920-4ac85846ced1 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:19.558332 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769b4f2b-2669-47d1-900d-31c458539988 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:19.564314 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-769b4f2b-2669-47d1-900d-31c458539988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:19.600180 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1077/2159] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 10 10:04:19 2022] POST /identity/v3/projects => generated 393 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:04:19.604349 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38571610-9aa7-4279-b920-4ac85846ced1 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:19.691307 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769b4f2b-2669-47d1-900d-31c458539988 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:19.698085 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38571610-9aa7-4279-b920-4ac85846ced1 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:19.705528 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573e48e1-b18e-4659-a930-10a277a0caaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:19.706269 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573e48e1-b18e-4659-a930-10a277a0caaa admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:19.706865 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573e48e1-b18e-4659-a930-10a277a0caaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:19.706865 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573e48e1-b18e-4659-a930-10a277a0caaa admin admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:19.707459 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573e48e1-b18e-4659-a930-10a277a0caaa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:19.709627 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573e48e1-b18e-4659-a930-10a277a0caaa admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:19.711320 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:04:19.737706 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1078/2160] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 10 10:04:19 2022] POST /identity/v3/users => generated 297 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 10:04:19.740606 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573e48e1-b18e-4659-a930-10a277a0caaa admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:19.757477 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573e48e1-b18e-4659-a930-10a277a0caaa admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:19.762672 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78864696-c863-4178-945e-5373011e9d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:19.763295 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78864696-c863-4178-945e-5373011e9d82 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:19.763580 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78864696-c863-4178-945e-5373011e9d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:19.763887 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78864696-c863-4178-945e-5373011e9d82 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:19.764503 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78864696-c863-4178-945e-5373011e9d82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:19.767062 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78864696-c863-4178-945e-5373011e9d82 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:19.771739 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b02790-4440-4568-9f2f-934d87be46bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf8e725cbe0403d943b136235eac057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:19.772535 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b02790-4440-4568-9f2f-934d87be46bd service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:19.772912 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b02790-4440-4568-9f2f-934d87be46bd service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:19.773323 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b02790-4440-4568-9f2f-934d87be46bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:19.780280 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1079/2161] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:04:19 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:04:19.780280 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78864696-c863-4178-945e-5373011e9d82 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:19.780554 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-78864696-c863-4178-945e-5373011e9d82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:19.793931 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78864696-c863-4178-945e-5373011e9d82 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:19.798742 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4eacbb-190a-4644-a45a-5e6d4fe89cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:19.799367 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4eacbb-190a-4644-a45a-5e6d4fe89cc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:19.799647 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4eacbb-190a-4644-a45a-5e6d4fe89cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:19.799921 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4eacbb-190a-4644-a45a-5e6d4fe89cc5 admin admin] PATH_INFO: `/v3/projects/3f0c9fa63f5e4519be1e4665269617e6` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:19.801055 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4eacbb-190a-4644-a45a-5e6d4fe89cc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f0c9fa63f5e4519be1e4665269617e6)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:19.803006 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4eacbb-190a-4644-a45a-5e6d4fe89cc5 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:19.844384 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b02790-4440-4568-9f2f-934d87be46bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:19.845912 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b02790-4440-4568-9f2f-934d87be46bd service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:19.849086 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:04:19.853292 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-3e4eacbb-190a-4644-a45a-5e6d4fe89cc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f0c9fa63f5e4519be1e4665269617e6', 'request_id': 'req-3e4eacbb-190a-4644-a45a-5e6d4fe89cc5'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:19.856346 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1083/2162] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:04:19 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:04:19.857371 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b02790-4440-4568-9f2f-934d87be46bd service cinder] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:19.863004 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-3e4eacbb-190a-4644-a45a-5e6d4fe89cc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f0c9fa63f5e4519be1e4665269617e6', 'request_id': 'req-3e4eacbb-190a-4644-a45a-5e6d4fe89cc5'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:19.868061 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b02790-4440-4568-9f2f-934d87be46bd service cinder] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:19.872387 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-3e4eacbb-190a-4644-a45a-5e6d4fe89cc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f0c9fa63f5e4519be1e4665269617e6', 'request_id': 'req-3e4eacbb-190a-4644-a45a-5e6d4fe89cc5'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:19.884823 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-3e4eacbb-190a-4644-a45a-5e6d4fe89cc5 admin admin] The token cache is being invalidate because project 3f0c9fa63f5e4519be1e4665269617e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 10:04:19.885258 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-3e4eacbb-190a-4644-a45a-5e6d4fe89cc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:19.885890 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-3e4eacbb-190a-4644-a45a-5e6d4fe89cc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:19.894295 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1080/2163] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 10 10:04:19 2022] DELETE /identity/v3/projects/3f0c9fa63f5e4519be1e4665269617e6 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:04:19.896041 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbddbf78-0a16-48a5-9354-f48848f1d79f None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:19.896453 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbddbf78-0a16-48a5-9354-f48848f1d79f None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:19.896789 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbddbf78-0a16-48a5-9354-f48848f1d79f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:19.916454 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-dbddbf78-0a16-48a5-9354-f48848f1d79f None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:04:19.917835 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-dbddbf78-0a16-48a5-9354-f48848f1d79f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:19.937148 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba1e79c-2083-48b2-8060-f7e39e30fc28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:19.937776 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba1e79c-2083-48b2-8060-f7e39e30fc28 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:19.938060 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba1e79c-2083-48b2-8060-f7e39e30fc28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:19.938336 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba1e79c-2083-48b2-8060-f7e39e30fc28 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:19.938988 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba1e79c-2083-48b2-8060-f7e39e30fc28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:19.940583 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba1e79c-2083-48b2-8060-f7e39e30fc28 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:19.954262 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1084/2164] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:04:19 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:04:19.954262 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba1e79c-2083-48b2-8060-f7e39e30fc28 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:19.954262 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-8ba1e79c-2083-48b2-8060-f7e39e30fc28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:19.983904 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1081/2165] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:04:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:04:19.984916 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbddbf78-0a16-48a5-9354-f48848f1d79f None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:19.986479 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-dbddbf78-0a16-48a5-9354-f48848f1d79f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:19.998470 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbddbf78-0a16-48a5-9354-f48848f1d79f None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:20.003045 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f61c637-d4df-4c1b-8062-8b8cb3ec8acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:20.003686 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f61c637-d4df-4c1b-8062-8b8cb3ec8acb admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:20.003964 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f61c637-d4df-4c1b-8062-8b8cb3ec8acb admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:20.004233 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f61c637-d4df-4c1b-8062-8b8cb3ec8acb admin admin] PATH_INFO: `/v3/projects/884ebbe7226a46a5becc3dcbef80b3a4/users/60fc756c67ea44ccba82a37edae56586/roles/8daabcb6b7394e39b06a3453e33e32db` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:20.009273 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba1e79c-2083-48b2-8060-f7e39e30fc28 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:20.013507 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c223ca-67d4-4aef-b863-178fadcacfb9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf8e725cbe0403d943b136235eac057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:20.014191 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c223ca-67d4-4aef-b863-178fadcacfb9 service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:20.014492 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c223ca-67d4-4aef-b863-178fadcacfb9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:20.014769 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c223ca-67d4-4aef-b863-178fadcacfb9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:20.016572 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-46c223ca-67d4-4aef-b863-178fadcacfb9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:20.019753 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f61c637-d4df-4c1b-8062-8b8cb3ec8acb admin admin] RBAC: Authorizing `identity:create_grant(project_id=884ebbe7226a46a5becc3dcbef80b3a4, user_id=60fc756c67ea44ccba82a37edae56586, role_id=8daabcb6b7394e39b06a3453e33e32db)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:20.022536 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f61c637-d4df-4c1b-8062-8b8cb3ec8acb admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:20.029843 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:04:20.044396 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1082/2166] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:04:19 2022] PUT /identity/v3/projects/884ebbe7226a46a5becc3dcbef80b3a4/users/60fc756c67ea44ccba82a37edae56586/roles/8daabcb6b7394e39b06a3453e33e32db => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:04:20.049097 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16892885-ee14-4586-89c2-f0005e6b058e None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:20.049451 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16892885-ee14-4586-89c2-f0005e6b058e None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:20.049796 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16892885-ee14-4586-89c2-f0005e6b058e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:20.071457 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-16892885-ee14-4586-89c2-f0005e6b058e None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:04:20.072818 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-16892885-ee14-4586-89c2-f0005e6b058e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:20.090271 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c223ca-67d4-4aef-b863-178fadcacfb9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:20.091730 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c223ca-67d4-4aef-b863-178fadcacfb9 service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:20.106079 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1085/2167] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:04:19 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:04:20.107680 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5e0541-9e8a-4126-9121-fc48a94870df None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:20.108280 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5e0541-9e8a-4126-9121-fc48a94870df None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:20.109133 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5e0541-9e8a-4126-9121-fc48a94870df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:20.133944 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-3c5e0541-9e8a-4126-9121-fc48a94870df None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:04:20.135988 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-3c5e0541-9e8a-4126-9121-fc48a94870df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:20.143224 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1083/2168] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:04:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:04:20.148362 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1086/2169] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:04:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:04:20.148529 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16892885-ee14-4586-89c2-f0005e6b058e None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:20.155654 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5e0541-9e8a-4126-9121-fc48a94870df None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:20.157337 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-3c5e0541-9e8a-4126-9121-fc48a94870df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:20.158743 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16892885-ee14-4586-89c2-f0005e6b058e None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:20.165816 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d77ae9-17c9-466e-9901-5ff3a33343eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:20.166562 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d77ae9-17c9-466e-9901-5ff3a33343eb admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:20.166731 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d77ae9-17c9-466e-9901-5ff3a33343eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:20.167002 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d77ae9-17c9-466e-9901-5ff3a33343eb admin admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:20.167663 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d77ae9-17c9-466e-9901-5ff3a33343eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:04:20.168004 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d77ae9-17c9-466e-9901-5ff3a33343eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:20.169729 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d77ae9-17c9-466e-9901-5ff3a33343eb admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:20.188352 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1084/2170] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 10 10:04:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 10:04:20.189553 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d77ae9-17c9-466e-9901-5ff3a33343eb admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:20.202227 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d77ae9-17c9-466e-9901-5ff3a33343eb admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:20.209234 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca006c7-437b-4cbb-8926-37cdceae1731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:20.210097 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca006c7-437b-4cbb-8926-37cdceae1731 admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:20.210522 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca006c7-437b-4cbb-8926-37cdceae1731 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:20.210933 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca006c7-437b-4cbb-8926-37cdceae1731 admin admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:20.211801 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca006c7-437b-4cbb-8926-37cdceae1731 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:20.214370 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca006c7-437b-4cbb-8926-37cdceae1731 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:20.247652 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5e0541-9e8a-4126-9121-fc48a94870df None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:20.249767 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1085/2171] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 10 10:04:20 2022] POST /identity/v3/projects => generated 385 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:04:20.250736 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca006c7-437b-4cbb-8926-37cdceae1731 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:20.279358 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:04:20.338232 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0692dc7-4b6a-40a1-bec9-9c9c4dc8923e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4294c170df354fe892831281acd4ea7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:20.338857 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0692dc7-4b6a-40a1-bec9-9c9c4dc8923e service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:20.339179 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0692dc7-4b6a-40a1-bec9-9c9c4dc8923e service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:20.339541 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0692dc7-4b6a-40a1-bec9-9c9c4dc8923e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:20.359235 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca006c7-437b-4cbb-8926-37cdceae1731 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:20.365859 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c091ac-d406-40ec-b3a7-3e1864281f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:20.366476 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c091ac-d406-40ec-b3a7-3e1864281f58 admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:20.366853 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c091ac-d406-40ec-b3a7-3e1864281f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:20.367175 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c091ac-d406-40ec-b3a7-3e1864281f58 admin admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:20.368416 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c091ac-d406-40ec-b3a7-3e1864281f58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:20.371113 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c091ac-d406-40ec-b3a7-3e1864281f58 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:20.397037 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1086/2172] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 10 10:04:20 2022] POST /identity/v3/users => generated 293 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:04:20.401334 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c091ac-d406-40ec-b3a7-3e1864281f58 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:20.410177 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0692dc7-4b6a-40a1-bec9-9c9c4dc8923e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:20.412059 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0692dc7-4b6a-40a1-bec9-9c9c4dc8923e service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:20.413975 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c091ac-d406-40ec-b3a7-3e1864281f58 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:20.429137 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80427ea6-eb6e-478d-8885-450559329649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:20.429757 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80427ea6-eb6e-478d-8885-450559329649 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:20.430491 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80427ea6-eb6e-478d-8885-450559329649 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:20.430665 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80427ea6-eb6e-478d-8885-450559329649 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:20.431491 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80427ea6-eb6e-478d-8885-450559329649 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:20.432897 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1087/2173] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:04:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:04:20.438031 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80427ea6-eb6e-478d-8885-450559329649 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:20.453721 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1087/2174] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:04:20 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:04:20.455310 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0692dc7-4b6a-40a1-bec9-9c9c4dc8923e service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:20.467550 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0692dc7-4b6a-40a1-bec9-9c9c4dc8923e service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:20.476083 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded76196-1f90-45a2-a024-2ed1106bf80b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:20.476728 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded76196-1f90-45a2-a024-2ed1106bf80b admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:20.476990 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded76196-1f90-45a2-a024-2ed1106bf80b admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:20.479771 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded76196-1f90-45a2-a024-2ed1106bf80b admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:20.480480 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded76196-1f90-45a2-a024-2ed1106bf80b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:20.485979 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded76196-1f90-45a2-a024-2ed1106bf80b admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:20.502241 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1088/2175] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:04:20 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:04:20.506825 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80427ea6-eb6e-478d-8885-450559329649 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:20.517157 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80427ea6-eb6e-478d-8885-450559329649 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:20.524696 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefef4a7-45d3-4c77-8046-cd18eaf68306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:20.525533 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefef4a7-45d3-4c77-8046-cd18eaf68306 admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:20.525992 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefef4a7-45d3-4c77-8046-cd18eaf68306 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:20.526366 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefef4a7-45d3-4c77-8046-cd18eaf68306 admin admin] PATH_INFO: `/v3/projects/d1a3ac6a9c094dcab6c151b98499ff3a/users/d41372e4bfd2439291ab0a979fecc160/roles/8daabcb6b7394e39b06a3453e33e32db` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:20.544262 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefef4a7-45d3-4c77-8046-cd18eaf68306 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1a3ac6a9c094dcab6c151b98499ff3a, user_id=d41372e4bfd2439291ab0a979fecc160, role_id=8daabcb6b7394e39b06a3453e33e32db)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:20.547009 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefef4a7-45d3-4c77-8046-cd18eaf68306 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:20.563855 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1088/2176] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:04:20 2022] PUT /identity/v3/projects/d1a3ac6a9c094dcab6c151b98499ff3a/users/d41372e4bfd2439291ab0a979fecc160/roles/8daabcb6b7394e39b06a3453e33e32db => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:04:20.568983 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceae5b49-b67b-4e7e-b05e-c250d976f38a None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:20.569373 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceae5b49-b67b-4e7e-b05e-c250d976f38a None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:20.569719 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceae5b49-b67b-4e7e-b05e-c250d976f38a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:20.577195 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:04:20.591720 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-ceae5b49-b67b-4e7e-b05e-c250d976f38a None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:04:20.592948 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-ceae5b49-b67b-4e7e-b05e-c250d976f38a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:20.659205 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1089/2177] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:04:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:04:20.669180 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefef4a7-45d3-4c77-8046-cd18eaf68306 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:20.671226 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-eefef4a7-45d3-4c77-8046-cd18eaf68306 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:20.740974 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefef4a7-45d3-4c77-8046-cd18eaf68306 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:20.751974 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73b6952-9069-4699-9351-3ed87c6e4c60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4294c170df354fe892831281acd4ea7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:20.752595 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b6952-9069-4699-9351-3ed87c6e4c60 service neutron] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:20.752877 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b6952-9069-4699-9351-3ed87c6e4c60 service neutron] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:20.753187 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b6952-9069-4699-9351-3ed87c6e4c60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:20.763405 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73b6952-9069-4699-9351-3ed87c6e4c60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:20.765491 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73b6952-9069-4699-9351-3ed87c6e4c60 service neutron] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:20.777672 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1089/2178] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:04:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:04:25.024320 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceae5b49-b67b-4e7e-b05e-c250d976f38a None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:25.025961 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-ceae5b49-b67b-4e7e-b05e-c250d976f38a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:25.045110 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceae5b49-b67b-4e7e-b05e-c250d976f38a None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:25.056181 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502b2f08-55f5-4747-9a04-ddd2cb91f9c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:25.057170 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502b2f08-55f5-4747-9a04-ddd2cb91f9c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:25.057617 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502b2f08-55f5-4747-9a04-ddd2cb91f9c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:25.059145 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502b2f08-55f5-4747-9a04-ddd2cb91f9c2 admin admin] PATH_INFO: `/v3/users/13495993a2f947c383c0445aca2e57da` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:25.061857 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502b2f08-55f5-4747-9a04-ddd2cb91f9c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13495993a2f947c383c0445aca2e57da)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:25.064033 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502b2f08-55f5-4747-9a04-ddd2cb91f9c2 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:25.181777 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-502b2f08-55f5-4747-9a04-ddd2cb91f9c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13495993a2f947c383c0445aca2e57da'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:25.200352 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-502b2f08-55f5-4747-9a04-ddd2cb91f9c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13495993a2f947c383c0445aca2e57da'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:25.201104 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-502b2f08-55f5-4747-9a04-ddd2cb91f9c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13495993a2f947c383c0445aca2e57da'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:25.202003 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-502b2f08-55f5-4747-9a04-ddd2cb91f9c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13495993a2f947c383c0445aca2e57da'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:25.212811 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-502b2f08-55f5-4747-9a04-ddd2cb91f9c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13495993a2f947c383c0445aca2e57da'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:25.252172 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1090/2179] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 10 10:04:25 2022] DELETE /identity/v3/users/13495993a2f947c383c0445aca2e57da => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:04:25.256731 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2298421f-2a6e-4573-be24-0704b2fb4e1d None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:25.257347 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2298421f-2a6e-4573-be24-0704b2fb4e1d None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:25.257347 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2298421f-2a6e-4573-be24-0704b2fb4e1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:25.303599 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-2298421f-2a6e-4573-be24-0704b2fb4e1d None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:04:25.305452 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-2298421f-2a6e-4573-be24-0704b2fb4e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:25.462130 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1090/2180] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:04:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:04:25.517088 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502b2f08-55f5-4747-9a04-ddd2cb91f9c2 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:25.518026 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-502b2f08-55f5-4747-9a04-ddd2cb91f9c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:25.646485 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502b2f08-55f5-4747-9a04-ddd2cb91f9c2 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:25.657141 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a4ab8e-6274-40c6-91a1-918ed73b8680 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4294c170df354fe892831281acd4ea7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:25.657961 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a4ab8e-6274-40c6-91a1-918ed73b8680 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:25.658891 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a4ab8e-6274-40c6-91a1-918ed73b8680 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:25.659492 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a4ab8e-6274-40c6-91a1-918ed73b8680 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:25.686022 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a4ab8e-6274-40c6-91a1-918ed73b8680 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:25.692051 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a4ab8e-6274-40c6-91a1-918ed73b8680 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:25.720532 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1091/2181] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:04:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:04:26.911383 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2298421f-2a6e-4573-be24-0704b2fb4e1d None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:26.913531 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-2298421f-2a6e-4573-be24-0704b2fb4e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:26.938118 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2298421f-2a6e-4573-be24-0704b2fb4e1d None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:26.955831 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9de7d5f-b3d3-4534-a392-b44f4e7bd5a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:26.956565 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9de7d5f-b3d3-4534-a392-b44f4e7bd5a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:26.956852 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9de7d5f-b3d3-4534-a392-b44f4e7bd5a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:26.957155 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9de7d5f-b3d3-4534-a392-b44f4e7bd5a4 admin admin] PATH_INFO: `/v3/projects/dc825f14ff394cd1a6a359804fa8b32e` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:26.962086 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9de7d5f-b3d3-4534-a392-b44f4e7bd5a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc825f14ff394cd1a6a359804fa8b32e)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:26.964288 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9de7d5f-b3d3-4534-a392-b44f4e7bd5a4 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:26.992435 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:04:27.085357 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-d9de7d5f-b3d3-4534-a392-b44f4e7bd5a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc825f14ff394cd1a6a359804fa8b32e', 'request_id': 'req-d9de7d5f-b3d3-4534-a392-b44f4e7bd5a4'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:27.094194 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-d9de7d5f-b3d3-4534-a392-b44f4e7bd5a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc825f14ff394cd1a6a359804fa8b32e', 'request_id': 'req-d9de7d5f-b3d3-4534-a392-b44f4e7bd5a4'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:27.109323 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-d9de7d5f-b3d3-4534-a392-b44f4e7bd5a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc825f14ff394cd1a6a359804fa8b32e', 'request_id': 'req-d9de7d5f-b3d3-4534-a392-b44f4e7bd5a4'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:27.124893 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-d9de7d5f-b3d3-4534-a392-b44f4e7bd5a4 admin admin] The token cache is being invalidate because project dc825f14ff394cd1a6a359804fa8b32e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 10:04:27.125452 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-d9de7d5f-b3d3-4534-a392-b44f4e7bd5a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:27.126406 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-d9de7d5f-b3d3-4534-a392-b44f4e7bd5a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:27.128506 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1091/2182] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 10 10:04:26 2022] DELETE /identity/v3/projects/dc825f14ff394cd1a6a359804fa8b32e => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:04:27.132805 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a4ab8e-6274-40c6-91a1-918ed73b8680 service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:27.148855 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a4ab8e-6274-40c6-91a1-918ed73b8680 service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:27.208328 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:04:27.342355 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f2540b-de92-4618-85ef-fbb8183f7520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:27.343094 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f2540b-de92-4618-85ef-fbb8183f7520 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:27.343373 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f2540b-de92-4618-85ef-fbb8183f7520 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:27.343700 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f2540b-de92-4618-85ef-fbb8183f7520 admin admin] PATH_INFO: `/v3/users/d84a5c9f87d7445ab4e9c572f08b967f` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:27.345387 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f2540b-de92-4618-85ef-fbb8183f7520 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d84a5c9f87d7445ab4e9c572f08b967f)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:27.347522 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f2540b-de92-4618-85ef-fbb8183f7520 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:27.434553 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-07f2540b-de92-4618-85ef-fbb8183f7520 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd84a5c9f87d7445ab4e9c572f08b967f'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:27.451874 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-07f2540b-de92-4618-85ef-fbb8183f7520 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd84a5c9f87d7445ab4e9c572f08b967f'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:27.452573 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-07f2540b-de92-4618-85ef-fbb8183f7520 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd84a5c9f87d7445ab4e9c572f08b967f'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:27.453658 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-07f2540b-de92-4618-85ef-fbb8183f7520 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd84a5c9f87d7445ab4e9c572f08b967f'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:27.464074 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-07f2540b-de92-4618-85ef-fbb8183f7520 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd84a5c9f87d7445ab4e9c572f08b967f'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:27.503663 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31364288-2383-4935-aa5b-6d992f066d30 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:27.503958 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31364288-2383-4935-aa5b-6d992f066d30 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:27.504232 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31364288-2383-4935-aa5b-6d992f066d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:27.514578 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1092/2183] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 10 10:04:27 2022] DELETE /identity/v3/users/d84a5c9f87d7445ab4e9c572f08b967f => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:04:27.543545 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-31364288-2383-4935-aa5b-6d992f066d30 None None] MFA Rules not processed for user `60fc756c67ea44ccba82a37edae56586`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:04:27.548058 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-31364288-2383-4935-aa5b-6d992f066d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:27.716028 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dda070-e514-469c-9cc5-87cf4747727f None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:27.716428 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dda070-e514-469c-9cc5-87cf4747727f None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:27.716940 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dda070-e514-469c-9cc5-87cf4747727f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:27.731137 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1092/2184] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:04:27 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:04:27.770204 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-c7dda070-e514-469c-9cc5-87cf4747727f None None] MFA Rules not processed for user `60fc756c67ea44ccba82a37edae56586`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:04:27.771772 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-c7dda070-e514-469c-9cc5-87cf4747727f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:27.794947 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1093/2185] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:04:27 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:04:27.807147 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31364288-2383-4935-aa5b-6d992f066d30 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:27.809216 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-31364288-2383-4935-aa5b-6d992f066d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:27.984891 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31364288-2383-4935-aa5b-6d992f066d30 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:27.991255 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0820d4-f0cd-45b4-ae10-6c7ee0e897d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd8580888cba41a88566da4540b1130c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:27.992499 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0820d4-f0cd-45b4-ae10-6c7ee0e897d7 service nova] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:27.992880 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0820d4-f0cd-45b4-ae10-6c7ee0e897d7 service nova] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:27.993295 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0820d4-f0cd-45b4-ae10-6c7ee0e897d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:28.008383 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0820d4-f0cd-45b4-ae10-6c7ee0e897d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:28.013633 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0820d4-f0cd-45b4-ae10-6c7ee0e897d7 service nova] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:28.032686 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1093/2186] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:04:27 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:04:28.191112 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dda070-e514-469c-9cc5-87cf4747727f None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:28.192647 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-c7dda070-e514-469c-9cc5-87cf4747727f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:28.383219 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dda070-e514-469c-9cc5-87cf4747727f None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:28.391640 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3df8b47-a932-4c58-982a-2e5aac563cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:28.392773 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3df8b47-a932-4c58-982a-2e5aac563cde admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:28.393347 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3df8b47-a932-4c58-982a-2e5aac563cde admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:28.393874 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3df8b47-a932-4c58-982a-2e5aac563cde admin admin] PATH_INFO: `/v3/projects/56b6c17ce05b42f489f28619bc24b949` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:28.395932 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3df8b47-a932-4c58-982a-2e5aac563cde admin admin] RBAC: Authorizing `identity:delete_project(project_id=56b6c17ce05b42f489f28619bc24b949)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:28.398518 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3df8b47-a932-4c58-982a-2e5aac563cde admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:28.490446 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:04:28.519068 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-a3df8b47-a932-4c58-982a-2e5aac563cde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56b6c17ce05b42f489f28619bc24b949', 'request_id': 'req-a3df8b47-a932-4c58-982a-2e5aac563cde'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:28.543552 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-a3df8b47-a932-4c58-982a-2e5aac563cde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56b6c17ce05b42f489f28619bc24b949', 'request_id': 'req-a3df8b47-a932-4c58-982a-2e5aac563cde'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:28.555790 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-a3df8b47-a932-4c58-982a-2e5aac563cde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56b6c17ce05b42f489f28619bc24b949', 'request_id': 'req-a3df8b47-a932-4c58-982a-2e5aac563cde'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:28.592649 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-a3df8b47-a932-4c58-982a-2e5aac563cde admin admin] The token cache is being invalidate because project 56b6c17ce05b42f489f28619bc24b949 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 10:04:28.595723 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-a3df8b47-a932-4c58-982a-2e5aac563cde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:28.603121 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-a3df8b47-a932-4c58-982a-2e5aac563cde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:28.609443 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1094/2187] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 10 10:04:28 2022] DELETE /identity/v3/projects/56b6c17ce05b42f489f28619bc24b949 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:04:28.617887 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cebc4fd-1cf5-418e-b67a-e56c294003ad None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:28.623976 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cebc4fd-1cf5-418e-b67a-e56c294003ad None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:28.625142 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cebc4fd-1cf5-418e-b67a-e56c294003ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:28.691997 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-1cebc4fd-1cf5-418e-b67a-e56c294003ad None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:04:28.694066 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-1cebc4fd-1cf5-418e-b67a-e56c294003ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:28.708784 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:04:28.853039 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1094/2188] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:04:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:04:28.855889 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aa6f61-aeb3-44c4-b743-5c429c9bab07 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:28.856383 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aa6f61-aeb3-44c4-b743-5c429c9bab07 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:28.856818 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aa6f61-aeb3-44c4-b743-5c429c9bab07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:28.896919 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5ac2af-0dff-4645-b59c-3a97f684a50f None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:28.897528 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5ac2af-0dff-4645-b59c-3a97f684a50f None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:28.898713 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5ac2af-0dff-4645-b59c-3a97f684a50f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:28.918845 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-86aa6f61-aeb3-44c4-b743-5c429c9bab07 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:04:28.921643 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-86aa6f61-aeb3-44c4-b743-5c429c9bab07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:28.944989 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1095/2189] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:04:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:04:28.946722 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aa6f61-aeb3-44c4-b743-5c429c9bab07 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:28.962673 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aa6f61-aeb3-44c4-b743-5c429c9bab07 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:28.991549 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1375f46-fa21-441d-b1c2-832890986fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:28.993357 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1375f46-fa21-441d-b1c2-832890986fa5 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:28.993660 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1375f46-fa21-441d-b1c2-832890986fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:28.993929 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1375f46-fa21-441d-b1c2-832890986fa5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:28.996527 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1375f46-fa21-441d-b1c2-832890986fa5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:04:28.996899 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1375f46-fa21-441d-b1c2-832890986fa5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:29.000057 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1375f46-fa21-441d-b1c2-832890986fa5 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:29.021526 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-3c5ac2af-0dff-4645-b59c-3a97f684a50f None None] MFA Rules not processed for user `d41372e4bfd2439291ab0a979fecc160`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:04:29.027652 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-3c5ac2af-0dff-4645-b59c-3a97f684a50f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:29.031668 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1096/2190] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 10 10:04:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 10:04:29.032831 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1375f46-fa21-441d-b1c2-832890986fa5 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:29.059494 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1375f46-fa21-441d-b1c2-832890986fa5 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:29.076927 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ccc068-1e3c-492f-ae06-a463dad3e475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:29.078853 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ccc068-1e3c-492f-ae06-a463dad3e475 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:29.079139 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ccc068-1e3c-492f-ae06-a463dad3e475 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:29.079424 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ccc068-1e3c-492f-ae06-a463dad3e475 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:29.082153 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ccc068-1e3c-492f-ae06-a463dad3e475 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:29.090160 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ccc068-1e3c-492f-ae06-a463dad3e475 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:29.169489 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1097/2191] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 10 10:04:29 2022] POST /identity/v3/projects => generated 373 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:04:29.172150 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ccc068-1e3c-492f-ae06-a463dad3e475 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:29.240810 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1095/2192] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:04:28 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:04:29.247766 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5ac2af-0dff-4645-b59c-3a97f684a50f None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:29.262520 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-3c5ac2af-0dff-4645-b59c-3a97f684a50f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:29.282520 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5ac2af-0dff-4645-b59c-3a97f684a50f None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:29.360906 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ccc068-1e3c-492f-ae06-a463dad3e475 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:29.389526 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea74d88-7256-418f-8ca1-c21b1511afa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:29.389526 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea74d88-7256-418f-8ca1-c21b1511afa4 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:29.389526 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea74d88-7256-418f-8ca1-c21b1511afa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:29.389526 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea74d88-7256-418f-8ca1-c21b1511afa4 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:29.389807 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea74d88-7256-418f-8ca1-c21b1511afa4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:29.389807 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea74d88-7256-418f-8ca1-c21b1511afa4 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:29.418433 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a329b54-1bc7-4c29-b2b7-e2ac972c0a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:29.419221 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a329b54-1bc7-4c29-b2b7-e2ac972c0a23 admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:29.420052 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a329b54-1bc7-4c29-b2b7-e2ac972c0a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:29.420551 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a329b54-1bc7-4c29-b2b7-e2ac972c0a23 admin admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:29.422259 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a329b54-1bc7-4c29-b2b7-e2ac972c0a23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:29.426253 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a329b54-1bc7-4c29-b2b7-e2ac972c0a23 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:29.432432 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1098/2193] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 10 10:04:29 2022] POST /identity/v3/users => generated 287 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:04:29.433868 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2960d321-81b5-4fa0-9ef7-3664767b14ad None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:29.434202 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2960d321-81b5-4fa0-9ef7-3664767b14ad None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:29.434629 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2960d321-81b5-4fa0-9ef7-3664767b14ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:29.471922 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-2960d321-81b5-4fa0-9ef7-3664767b14ad None None] MFA Rules not processed for user `60fc756c67ea44ccba82a37edae56586`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:04:29.476250 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-2960d321-81b5-4fa0-9ef7-3664767b14ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:29.481670 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1096/2194] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 10 10:04:29 2022] POST /identity/v3/projects => generated 383 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:04:29.484919 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a329b54-1bc7-4c29-b2b7-e2ac972c0a23 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:29.524422 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:04:29.581119 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1099/2195] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:04:29 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:04:29.581119 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2960d321-81b5-4fa0-9ef7-3664767b14ad None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:29.597594 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a329b54-1bc7-4c29-b2b7-e2ac972c0a23 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:29.603378 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1386b683-eaee-459b-a8fe-99a73cebacfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:29.604121 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1386b683-eaee-459b-a8fe-99a73cebacfc admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:29.604451 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1386b683-eaee-459b-a8fe-99a73cebacfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:29.604846 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1386b683-eaee-459b-a8fe-99a73cebacfc admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:29.606290 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1386b683-eaee-459b-a8fe-99a73cebacfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:29.608268 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1386b683-eaee-459b-a8fe-99a73cebacfc admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:29.624212 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:04:29.628580 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1097/2196] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:04:29 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:04:29.635731 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1386b683-eaee-459b-a8fe-99a73cebacfc admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:29.672710 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1386b683-eaee-459b-a8fe-99a73cebacfc admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:29.686165 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79333eef-2d9b-4fc7-a207-f64b3fc37e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:29.686508 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79333eef-2d9b-4fc7-a207-f64b3fc37e89 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:29.686787 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79333eef-2d9b-4fc7-a207-f64b3fc37e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:29.687055 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79333eef-2d9b-4fc7-a207-f64b3fc37e89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:29.687819 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79333eef-2d9b-4fc7-a207-f64b3fc37e89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:29.690631 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79333eef-2d9b-4fc7-a207-f64b3fc37e89 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:29.718213 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1098/2197] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:04:29 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 10:04:29.721747 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79333eef-2d9b-4fc7-a207-f64b3fc37e89 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:29.739420 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79333eef-2d9b-4fc7-a207-f64b3fc37e89 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:29.764001 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27c2a06-f561-446f-b22a-103aba51f6a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:29.764001 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c2a06-f561-446f-b22a-103aba51f6a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:29.764001 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c2a06-f561-446f-b22a-103aba51f6a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:29.764001 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c2a06-f561-446f-b22a-103aba51f6a9 admin admin] PATH_INFO: `/v3/projects/14c96c519eae4d9ca1ae8e76a3e8fc4d/users/009901cb7b2141cfbed6147d502d9e9a/roles/8daabcb6b7394e39b06a3453e33e32db` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:29.783219 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27c2a06-f561-446f-b22a-103aba51f6a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14c96c519eae4d9ca1ae8e76a3e8fc4d, user_id=009901cb7b2141cfbed6147d502d9e9a, role_id=8daabcb6b7394e39b06a3453e33e32db)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:29.786343 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2960d321-81b5-4fa0-9ef7-3664767b14ad None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:29.786476 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27c2a06-f561-446f-b22a-103aba51f6a9 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:29.796959 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7caeea-8ed6-4cab-b47b-7de3c9e60b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:29.797780 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7caeea-8ed6-4cab-b47b-7de3c9e60b92 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:29.798397 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7caeea-8ed6-4cab-b47b-7de3c9e60b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:29.798789 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7caeea-8ed6-4cab-b47b-7de3c9e60b92 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:29.799661 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7caeea-8ed6-4cab-b47b-7de3c9e60b92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:29.801900 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7caeea-8ed6-4cab-b47b-7de3c9e60b92 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:29.820845 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1099/2198] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:04:29 2022] PUT /identity/v3/projects/14c96c519eae4d9ca1ae8e76a3e8fc4d/users/009901cb7b2141cfbed6147d502d9e9a/roles/8daabcb6b7394e39b06a3453e33e32db => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:04:29.836844 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2165946d-f9c8-447f-ae09-609a890f58ae None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:29.837218 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2165946d-f9c8-447f-ae09-609a890f58ae None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:29.837445 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2165946d-f9c8-447f-ae09-609a890f58ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:29.858282 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1100/2199] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 10 10:04:29 2022] POST /identity/v3/users => generated 298 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:04:29.862283 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7caeea-8ed6-4cab-b47b-7de3c9e60b92 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:29.872087 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-2165946d-f9c8-447f-ae09-609a890f58ae None None] MFA Rules not processed for user `009901cb7b2141cfbed6147d502d9e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:04:29.873692 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-2165946d-f9c8-447f-ae09-609a890f58ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:29.874344 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7caeea-8ed6-4cab-b47b-7de3c9e60b92 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:29.985691 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1100/2200] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:04:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:04:30.000754 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2165946d-f9c8-447f-ae09-609a890f58ae None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:30.004775 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-2165946d-f9c8-447f-ae09-609a890f58ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:30.006117 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74177332-1adb-4251-aaa8-ff6070673cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:30.006981 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74177332-1adb-4251-aaa8-ff6070673cbe admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:30.007511 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74177332-1adb-4251-aaa8-ff6070673cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:30.007965 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74177332-1adb-4251-aaa8-ff6070673cbe admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:30.008943 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74177332-1adb-4251-aaa8-ff6070673cbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:30.011015 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74177332-1adb-4251-aaa8-ff6070673cbe admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:30.032429 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1101/2201] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:04:29 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:04:30.039771 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74177332-1adb-4251-aaa8-ff6070673cbe admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:30.059281 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74177332-1adb-4251-aaa8-ff6070673cbe admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:30.065845 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50b5c86-ef25-49bd-b759-802abc099a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:30.067015 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50b5c86-ef25-49bd-b759-802abc099a5d admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:30.067407 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50b5c86-ef25-49bd-b759-802abc099a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:30.067775 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50b5c86-ef25-49bd-b759-802abc099a5d admin admin] PATH_INFO: `/v3/projects/e32cd240966d49a7b3636a6500f63915/users/e4de640d5e9e41d8b276e6ae941a979c/roles/eb04edc46b3742d7a0f0ead26f68bc22` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:30.098931 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50b5c86-ef25-49bd-b759-802abc099a5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e32cd240966d49a7b3636a6500f63915, user_id=e4de640d5e9e41d8b276e6ae941a979c, role_id=eb04edc46b3742d7a0f0ead26f68bc22)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:30.104485 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50b5c86-ef25-49bd-b759-802abc099a5d admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:30.127074 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1102/2202] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:04:30 2022] PUT /identity/v3/projects/e32cd240966d49a7b3636a6500f63915/users/e4de640d5e9e41d8b276e6ae941a979c/roles/eb04edc46b3742d7a0f0ead26f68bc22 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:04:30.128579 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50b5c86-ef25-49bd-b759-802abc099a5d admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:30.131866 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-e50b5c86-ef25-49bd-b759-802abc099a5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:30.169460 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2165946d-f9c8-447f-ae09-609a890f58ae None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:30.233286 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50b5c86-ef25-49bd-b759-802abc099a5d admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:30.233501 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:04:30.240727 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da20f36c-9a13-43f2-87a5-d538ce92abaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:30.241696 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da20f36c-9a13-43f2-87a5-d538ce92abaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:30.242087 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da20f36c-9a13-43f2-87a5-d538ce92abaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:30.242495 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da20f36c-9a13-43f2-87a5-d538ce92abaf admin admin] PATH_INFO: `/v3/users/aa2ab6f847474115865121773c96ea0c` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:30.244537 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da20f36c-9a13-43f2-87a5-d538ce92abaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa2ab6f847474115865121773c96ea0c)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:30.246684 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da20f36c-9a13-43f2-87a5-d538ce92abaf admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:30.259875 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126e7f4c-c6ba-474e-ad81-e70b015ac033 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf8e725cbe0403d943b136235eac057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:30.260746 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126e7f4c-c6ba-474e-ad81-e70b015ac033 service cinder] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:30.261349 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126e7f4c-c6ba-474e-ad81-e70b015ac033 service cinder] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:30.261971 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126e7f4c-c6ba-474e-ad81-e70b015ac033 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:30.269838 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:04:30.322347 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-da20f36c-9a13-43f2-87a5-d538ce92abaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa2ab6f847474115865121773c96ea0c'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:30.339802 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-da20f36c-9a13-43f2-87a5-d538ce92abaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa2ab6f847474115865121773c96ea0c'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:30.341703 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-da20f36c-9a13-43f2-87a5-d538ce92abaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa2ab6f847474115865121773c96ea0c'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:30.344079 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-da20f36c-9a13-43f2-87a5-d538ce92abaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa2ab6f847474115865121773c96ea0c'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:30.355027 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-da20f36c-9a13-43f2-87a5-d538ce92abaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa2ab6f847474115865121773c96ea0c'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:30.372849 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126e7f4c-c6ba-474e-ad81-e70b015ac033 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:30.375182 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126e7f4c-c6ba-474e-ad81-e70b015ac033 service cinder] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:30.388565 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1103/2203] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 10 10:04:30 2022] DELETE /identity/v3/users/aa2ab6f847474115865121773c96ea0c => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:04:30.389763 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da20f36c-9a13-43f2-87a5-d538ce92abaf admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:30.393219 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-da20f36c-9a13-43f2-87a5-d538ce92abaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:30.419006 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1101/2204] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:04:29 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 10:04:30.420176 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126e7f4c-c6ba-474e-ad81-e70b015ac033 service cinder] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:30.430802 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-126e7f4c-c6ba-474e-ad81-e70b015ac033 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:30.458423 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126e7f4c-c6ba-474e-ad81-e70b015ac033 service cinder] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:30.485142 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da20f36c-9a13-43f2-87a5-d538ce92abaf admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:30.491083 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b71758-9de4-4a3a-9e33-b745921326ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:30.492103 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b71758-9de4-4a3a-9e33-b745921326ac admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:30.492389 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b71758-9de4-4a3a-9e33-b745921326ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:30.492662 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b71758-9de4-4a3a-9e33-b745921326ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:30.493462 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b71758-9de4-4a3a-9e33-b745921326ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:30.495801 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b71758-9de4-4a3a-9e33-b745921326ac admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:30.513384 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1104/2205] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:04:30 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:04:30.514841 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd5f5c4-48f8-487c-a646-4aef1201bd43 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:30.515520 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd5f5c4-48f8-487c-a646-4aef1201bd43 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:30.515520 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd5f5c4-48f8-487c-a646-4aef1201bd43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:30.582838 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8542048f-0b43-4fcd-8cf5-db1658d7f4ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:30.583628 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8542048f-0b43-4fcd-8cf5-db1658d7f4ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:30.583914 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8542048f-0b43-4fcd-8cf5-db1658d7f4ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:30.584493 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8542048f-0b43-4fcd-8cf5-db1658d7f4ad admin admin] PATH_INFO: `/v3/users/bf4df90d708844b5bcb454927bb2297b` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:30.585420 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8542048f-0b43-4fcd-8cf5-db1658d7f4ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf4df90d708844b5bcb454927bb2297b)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:30.587553 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8542048f-0b43-4fcd-8cf5-db1658d7f4ad admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:30.618456 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-0cd5f5c4-48f8-487c-a646-4aef1201bd43 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:04:30.627465 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-0cd5f5c4-48f8-487c-a646-4aef1201bd43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:30.640756 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1105/2206] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:04:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:04:30.644988 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd5f5c4-48f8-487c-a646-4aef1201bd43 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:30.648872 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-0cd5f5c4-48f8-487c-a646-4aef1201bd43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:30.669256 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd5f5c4-48f8-487c-a646-4aef1201bd43 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:30.676436 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8e3d1e-fcf8-44aa-a485-1993791628be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:30.677749 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e3d1e-fcf8-44aa-a485-1993791628be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:30.678169 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e3d1e-fcf8-44aa-a485-1993791628be admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:30.678918 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e3d1e-fcf8-44aa-a485-1993791628be admin admin] PATH_INFO: `/v3/users/009901cb7b2141cfbed6147d502d9e9a` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:30.680955 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8e3d1e-fcf8-44aa-a485-1993791628be admin admin] RBAC: Authorizing `identity:delete_user(user_id=009901cb7b2141cfbed6147d502d9e9a)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:30.684207 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8e3d1e-fcf8-44aa-a485-1993791628be admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:30.702381 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-8542048f-0b43-4fcd-8cf5-db1658d7f4ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf4df90d708844b5bcb454927bb2297b'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:30.714983 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-8542048f-0b43-4fcd-8cf5-db1658d7f4ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf4df90d708844b5bcb454927bb2297b'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:30.727176 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-8542048f-0b43-4fcd-8cf5-db1658d7f4ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf4df90d708844b5bcb454927bb2297b'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:30.727839 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-8542048f-0b43-4fcd-8cf5-db1658d7f4ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf4df90d708844b5bcb454927bb2297b'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:30.729638 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-8542048f-0b43-4fcd-8cf5-db1658d7f4ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf4df90d708844b5bcb454927bb2297b'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:30.771128 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1102/2207] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 10 10:04:30 2022] DELETE /identity/v3/users/bf4df90d708844b5bcb454927bb2297b => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:04:30.772373 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8542048f-0b43-4fcd-8cf5-db1658d7f4ad admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:30.777344 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-8542048f-0b43-4fcd-8cf5-db1658d7f4ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:30.785896 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:04:30.794484 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-ca8e3d1e-fcf8-44aa-a485-1993791628be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '009901cb7b2141cfbed6147d502d9e9a'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:30.821577 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-ca8e3d1e-fcf8-44aa-a485-1993791628be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '009901cb7b2141cfbed6147d502d9e9a'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:30.821834 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-ca8e3d1e-fcf8-44aa-a485-1993791628be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '009901cb7b2141cfbed6147d502d9e9a'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:30.822886 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-ca8e3d1e-fcf8-44aa-a485-1993791628be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '009901cb7b2141cfbed6147d502d9e9a'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:30.832618 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-ca8e3d1e-fcf8-44aa-a485-1993791628be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '009901cb7b2141cfbed6147d502d9e9a'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:30.852922 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:DELETE=19,keystone:SELECT=79,keystone:INSERT=2 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:04:30.861662 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1106/2208] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 10 10:04:30 2022] DELETE /identity/v3/users/009901cb7b2141cfbed6147d502d9e9a => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:04:30.862673 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8e3d1e-fcf8-44aa-a485-1993791628be admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:30.865005 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-ca8e3d1e-fcf8-44aa-a485-1993791628be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:30.922930 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8542048f-0b43-4fcd-8cf5-db1658d7f4ad admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:30.945303 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8e3d1e-fcf8-44aa-a485-1993791628be admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:30.950181 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45a4d94-4668-4c7f-bcb1-619700a23b88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4294c170df354fe892831281acd4ea7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:30.950783 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45a4d94-4668-4c7f-bcb1-619700a23b88 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:30.951067 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45a4d94-4668-4c7f-bcb1-619700a23b88 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:30.951342 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45a4d94-4668-4c7f-bcb1-619700a23b88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:30.953903 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-b45a4d94-4668-4c7f-bcb1-619700a23b88 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:31.035189 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f34abd-2c55-442d-9260-19dfb18307cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:31.035886 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f34abd-2c55-442d-9260-19dfb18307cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:31.036257 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f34abd-2c55-442d-9260-19dfb18307cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:31.036621 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f34abd-2c55-442d-9260-19dfb18307cf admin admin] PATH_INFO: `/v3/projects/e32cd240966d49a7b3636a6500f63915/users/e4de640d5e9e41d8b276e6ae941a979c/roles/eb04edc46b3742d7a0f0ead26f68bc22` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:31.038932 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f34abd-2c55-442d-9260-19dfb18307cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=e32cd240966d49a7b3636a6500f63915, user_id=e4de640d5e9e41d8b276e6ae941a979c, role_id=eb04edc46b3742d7a0f0ead26f68bc22)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:31.041929 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f34abd-2c55-442d-9260-19dfb18307cf admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:31.065859 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1103/2209] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:04:30 2022] PUT /identity/v3/projects/e32cd240966d49a7b3636a6500f63915/users/e4de640d5e9e41d8b276e6ae941a979c/roles/eb04edc46b3742d7a0f0ead26f68bc22 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:04:31.067362 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0c9a05-684d-421b-9af5-a22af146f7e9 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:31.067811 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0c9a05-684d-421b-9af5-a22af146f7e9 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:31.068252 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0c9a05-684d-421b-9af5-a22af146f7e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:31.078709 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45a4d94-4668-4c7f-bcb1-619700a23b88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:31.080409 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45a4d94-4668-4c7f-bcb1-619700a23b88 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:31.107006 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-3f0c9a05-684d-421b-9af5-a22af146f7e9 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:04:31.110386 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-3f0c9a05-684d-421b-9af5-a22af146f7e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:31.126425 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1107/2210] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:04:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:04:31.127803 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7d0ff3-d61c-4521-9828-013c0e43460b None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:31.128074 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7d0ff3-d61c-4521-9828-013c0e43460b None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:31.128354 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7d0ff3-d61c-4521-9828-013c0e43460b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:31.154176 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-1f7d0ff3-d61c-4521-9828-013c0e43460b None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:04:31.156908 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-1f7d0ff3-d61c-4521-9828-013c0e43460b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:31.260366 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1108/2211] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:04:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:04:31.277860 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7d0ff3-d61c-4521-9828-013c0e43460b None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:31.280072 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-1f7d0ff3-d61c-4521-9828-013c0e43460b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:31.311120 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1104/2212] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:04:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:04:31.340691 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0c9a05-684d-421b-9af5-a22af146f7e9 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:31.343022 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-3f0c9a05-684d-421b-9af5-a22af146f7e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:31.482631 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:04:31.492229 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:04:31.495281 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7d0ff3-d61c-4521-9828-013c0e43460b None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:31.505452 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65d56a4-559c-4f50-8687-8a55f85f0803 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4294c170df354fe892831281acd4ea7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:31.506285 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d56a4-559c-4f50-8687-8a55f85f0803 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:31.506728 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d56a4-559c-4f50-8687-8a55f85f0803 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:31.507052 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d56a4-559c-4f50-8687-8a55f85f0803 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:31.509308 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0c9a05-684d-421b-9af5-a22af146f7e9 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:31.525822 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348d8ff7-ad7d-4e33-aedb-62c18ca54695 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4294c170df354fe892831281acd4ea7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:31.526460 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348d8ff7-ad7d-4e33-aedb-62c18ca54695 service neutron] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:31.526737 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348d8ff7-ad7d-4e33-aedb-62c18ca54695 service neutron] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:31.527003 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348d8ff7-ad7d-4e33-aedb-62c18ca54695 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:31.540149 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65d56a4-559c-4f50-8687-8a55f85f0803 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:31.542772 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65d56a4-559c-4f50-8687-8a55f85f0803 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:31.546848 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348d8ff7-ad7d-4e33-aedb-62c18ca54695 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:31.548312 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348d8ff7-ad7d-4e33-aedb-62c18ca54695 service neutron] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:31.576045 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1109/2213] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:04:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:04:31.577319 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1105/2214] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:04:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 10:04:32.012564 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65d56a4-559c-4f50-8687-8a55f85f0803 service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:32.016047 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-d65d56a4-559c-4f50-8687-8a55f85f0803 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:32.036199 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65d56a4-559c-4f50-8687-8a55f85f0803 service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:32.052171 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5647e0e8-ee7a-4cde-9b02-32d00b7e0c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:32.053290 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5647e0e8-ee7a-4cde-9b02-32d00b7e0c29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:32.053760 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5647e0e8-ee7a-4cde-9b02-32d00b7e0c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:32.054196 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5647e0e8-ee7a-4cde-9b02-32d00b7e0c29 admin admin] PATH_INFO: `/v3/projects/b7afd31fc374430dbe553e741a64f39e` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:32.059301 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5647e0e8-ee7a-4cde-9b02-32d00b7e0c29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7afd31fc374430dbe553e741a64f39e)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:32.062326 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5647e0e8-ee7a-4cde-9b02-32d00b7e0c29 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:32.277087 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-5647e0e8-ee7a-4cde-9b02-32d00b7e0c29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7afd31fc374430dbe553e741a64f39e', 'request_id': 'req-5647e0e8-ee7a-4cde-9b02-32d00b7e0c29'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:32.289191 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-5647e0e8-ee7a-4cde-9b02-32d00b7e0c29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7afd31fc374430dbe553e741a64f39e', 'request_id': 'req-5647e0e8-ee7a-4cde-9b02-32d00b7e0c29'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:32.302602 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-5647e0e8-ee7a-4cde-9b02-32d00b7e0c29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7afd31fc374430dbe553e741a64f39e', 'request_id': 'req-5647e0e8-ee7a-4cde-9b02-32d00b7e0c29'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:32.339883 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-5647e0e8-ee7a-4cde-9b02-32d00b7e0c29 admin admin] The token cache is being invalidate because project b7afd31fc374430dbe553e741a64f39e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 10:04:32.340211 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-5647e0e8-ee7a-4cde-9b02-32d00b7e0c29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:32.342056 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-5647e0e8-ee7a-4cde-9b02-32d00b7e0c29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:32.357108 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1110/2215] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 10 10:04:32 2022] DELETE /identity/v3/projects/b7afd31fc374430dbe553e741a64f39e => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:04:32.808832 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348d8ff7-ad7d-4e33-aedb-62c18ca54695 service neutron] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:32.810804 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-348d8ff7-ad7d-4e33-aedb-62c18ca54695 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:32.836589 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348d8ff7-ad7d-4e33-aedb-62c18ca54695 service neutron] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:32.985542 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b93f9e-2756-4aa1-be94-5a2fc9c4d824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:32.986260 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b93f9e-2756-4aa1-be94-5a2fc9c4d824 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:32.986538 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b93f9e-2756-4aa1-be94-5a2fc9c4d824 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:32.986908 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b93f9e-2756-4aa1-be94-5a2fc9c4d824 admin admin] PATH_INFO: `/v3/projects/60d2587e64784b6a86e0afd2a5d20535` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:32.988115 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b93f9e-2756-4aa1-be94-5a2fc9c4d824 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60d2587e64784b6a86e0afd2a5d20535)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:32.990247 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b93f9e-2756-4aa1-be94-5a2fc9c4d824 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:33.109783 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-73b93f9e-2756-4aa1-be94-5a2fc9c4d824 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60d2587e64784b6a86e0afd2a5d20535', 'request_id': 'req-73b93f9e-2756-4aa1-be94-5a2fc9c4d824'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:33.118650 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-73b93f9e-2756-4aa1-be94-5a2fc9c4d824 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60d2587e64784b6a86e0afd2a5d20535', 'request_id': 'req-73b93f9e-2756-4aa1-be94-5a2fc9c4d824'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:33.139149 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-73b93f9e-2756-4aa1-be94-5a2fc9c4d824 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60d2587e64784b6a86e0afd2a5d20535', 'request_id': 'req-73b93f9e-2756-4aa1-be94-5a2fc9c4d824'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:33.160366 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-73b93f9e-2756-4aa1-be94-5a2fc9c4d824 admin admin] The token cache is being invalidate because project 60d2587e64784b6a86e0afd2a5d20535 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 10:04:33.160666 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-73b93f9e-2756-4aa1-be94-5a2fc9c4d824 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:33.161356 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-73b93f9e-2756-4aa1-be94-5a2fc9c4d824 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:33.165783 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1106/2216] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 10 10:04:32 2022] DELETE /identity/v3/projects/60d2587e64784b6a86e0afd2a5d20535 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:04:33.430559 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5647e0e8-ee7a-4cde-9b02-32d00b7e0c29 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:33.432433 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-5647e0e8-ee7a-4cde-9b02-32d00b7e0c29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:33.459866 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5647e0e8-ee7a-4cde-9b02-32d00b7e0c29 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:33.557622 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e214d7a1-60b6-402e-8ef4-9e6f6a8ed5e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:33.558878 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e214d7a1-60b6-402e-8ef4-9e6f6a8ed5e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:33.559826 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e214d7a1-60b6-402e-8ef4-9e6f6a8ed5e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:33.559826 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e214d7a1-60b6-402e-8ef4-9e6f6a8ed5e9 admin admin] PATH_INFO: `/v3/projects/14c96c519eae4d9ca1ae8e76a3e8fc4d` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:33.561354 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e214d7a1-60b6-402e-8ef4-9e6f6a8ed5e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14c96c519eae4d9ca1ae8e76a3e8fc4d)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:33.563691 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e214d7a1-60b6-402e-8ef4-9e6f6a8ed5e9 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:33.653159 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-e214d7a1-60b6-402e-8ef4-9e6f6a8ed5e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14c96c519eae4d9ca1ae8e76a3e8fc4d', 'request_id': 'req-e214d7a1-60b6-402e-8ef4-9e6f6a8ed5e9'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:33.669335 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-e214d7a1-60b6-402e-8ef4-9e6f6a8ed5e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14c96c519eae4d9ca1ae8e76a3e8fc4d', 'request_id': 'req-e214d7a1-60b6-402e-8ef4-9e6f6a8ed5e9'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:33.710088 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-e214d7a1-60b6-402e-8ef4-9e6f6a8ed5e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14c96c519eae4d9ca1ae8e76a3e8fc4d', 'request_id': 'req-e214d7a1-60b6-402e-8ef4-9e6f6a8ed5e9'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:33.729473 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-e214d7a1-60b6-402e-8ef4-9e6f6a8ed5e9 admin admin] The token cache is being invalidate because project 14c96c519eae4d9ca1ae8e76a3e8fc4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 10:04:33.729774 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-e214d7a1-60b6-402e-8ef4-9e6f6a8ed5e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:33.733417 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-e214d7a1-60b6-402e-8ef4-9e6f6a8ed5e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:33.740378 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3a7b48-7004-46b8-9c65-b1687869ca4c None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:33.740656 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3a7b48-7004-46b8-9c65-b1687869ca4c None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:33.740935 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3a7b48-7004-46b8-9c65-b1687869ca4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:33.743837 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1111/2217] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 10 10:04:33 2022] DELETE /identity/v3/projects/14c96c519eae4d9ca1ae8e76a3e8fc4d => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:04:33.788355 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-da3a7b48-7004-46b8-9c65-b1687869ca4c None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:04:33.789181 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-da3a7b48-7004-46b8-9c65-b1687869ca4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:33.951108 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40f06c3-adfb-4a76-ac98-f8116fc625a4 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:33.951331 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40f06c3-adfb-4a76-ac98-f8116fc625a4 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:33.951648 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40f06c3-adfb-4a76-ac98-f8116fc625a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:33.954298 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1107/2218] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:04:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:04:33.962194 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:04:33.991059 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-d40f06c3-adfb-4a76-ac98-f8116fc625a4 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:04:33.992391 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-d40f06c3-adfb-4a76-ac98-f8116fc625a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:34.018988 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3a7b48-7004-46b8-9c65-b1687869ca4c None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:34.019553 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1112/2219] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:04:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:04:34.037622 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3a7b48-7004-46b8-9c65-b1687869ca4c None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:34.052753 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b1d39d-5971-4766-9bf1-090e7ae10326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:34.053472 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b1d39d-5971-4766-9bf1-090e7ae10326 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:34.053753 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b1d39d-5971-4766-9bf1-090e7ae10326 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:34.054030 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b1d39d-5971-4766-9bf1-090e7ae10326 admin admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:34.055068 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b1d39d-5971-4766-9bf1-090e7ae10326 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:04:34.055376 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b1d39d-5971-4766-9bf1-090e7ae10326 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:34.057363 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b1d39d-5971-4766-9bf1-090e7ae10326 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:34.087008 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40f06c3-adfb-4a76-ac98-f8116fc625a4 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:34.094068 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1108/2220] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 10 10:04:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:04:34.104055 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40f06c3-adfb-4a76-ac98-f8116fc625a4 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:34.120074 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ddc93f-3766-40f8-9159-9df51b8f838f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:34.121024 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ddc93f-3766-40f8-9159-9df51b8f838f admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:34.121361 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ddc93f-3766-40f8-9159-9df51b8f838f admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:34.121635 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ddc93f-3766-40f8-9159-9df51b8f838f admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:34.130114 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ddc93f-3766-40f8-9159-9df51b8f838f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:34.132297 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ddc93f-3766-40f8-9159-9df51b8f838f admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:34.205791 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b1d39d-5971-4766-9bf1-090e7ae10326 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:34.206485 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1113/2221] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 10 10:04:34 2022] POST /identity/v3/projects => generated 375 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:04:34.218703 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b1d39d-5971-4766-9bf1-090e7ae10326 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:34.231785 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:04:34.330426 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4f527e-f284-4a3d-87f4-86365826dfb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:34.331286 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4f527e-f284-4a3d-87f4-86365826dfb0 admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:34.331660 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4f527e-f284-4a3d-87f4-86365826dfb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:34.332007 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4f527e-f284-4a3d-87f4-86365826dfb0 admin admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:34.333096 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4f527e-f284-4a3d-87f4-86365826dfb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:34.334840 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4f527e-f284-4a3d-87f4-86365826dfb0 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:34.368753 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1109/2222] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 10 10:04:34 2022] POST /identity/v3/users => generated 288 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:04:34.370698 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ddc93f-3766-40f8-9159-9df51b8f838f admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:34.388315 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ddc93f-3766-40f8-9159-9df51b8f838f admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:34.408546 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5833c3f-be51-4553-98ed-56decc0a8e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:34.409926 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5833c3f-be51-4553-98ed-56decc0a8e84 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:34.410216 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5833c3f-be51-4553-98ed-56decc0a8e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:34.410674 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5833c3f-be51-4553-98ed-56decc0a8e84 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:34.411374 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5833c3f-be51-4553-98ed-56decc0a8e84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:34.414365 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5833c3f-be51-4553-98ed-56decc0a8e84 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:34.432892 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1114/2223] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:04:34 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:04:34.439408 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4f527e-f284-4a3d-87f4-86365826dfb0 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:34.456259 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4f527e-f284-4a3d-87f4-86365826dfb0 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:34.464846 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fd9ca7-6c30-497d-b202-897b34b1b06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:34.465455 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fd9ca7-6c30-497d-b202-897b34b1b06f admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:34.465743 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fd9ca7-6c30-497d-b202-897b34b1b06f admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:34.466023 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fd9ca7-6c30-497d-b202-897b34b1b06f admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:34.467128 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fd9ca7-6c30-497d-b202-897b34b1b06f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:34.469042 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fd9ca7-6c30-497d-b202-897b34b1b06f admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:34.485922 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1110/2224] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:04:34 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:04:34.489489 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5833c3f-be51-4553-98ed-56decc0a8e84 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:34.509898 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5833c3f-be51-4553-98ed-56decc0a8e84 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:34.523461 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01f3acd-d3e4-4e54-9a09-40751368e3f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:34.524517 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f3acd-d3e4-4e54-9a09-40751368e3f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:34.525181 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f3acd-d3e4-4e54-9a09-40751368e3f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:34.525880 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f3acd-d3e4-4e54-9a09-40751368e3f0 admin admin] PATH_INFO: `/v3/projects/39b6417291e240faaabffd05bd8f0c7a/users/6d2b81a6002d4507b4e6b407292e87f4/roles/8daabcb6b7394e39b06a3453e33e32db` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:34.558538 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01f3acd-d3e4-4e54-9a09-40751368e3f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39b6417291e240faaabffd05bd8f0c7a, user_id=6d2b81a6002d4507b4e6b407292e87f4, role_id=8daabcb6b7394e39b06a3453e33e32db)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:34.564612 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01f3acd-d3e4-4e54-9a09-40751368e3f0 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:34.603202 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1115/2225] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:04:34 2022] PUT /identity/v3/projects/39b6417291e240faaabffd05bd8f0c7a/users/6d2b81a6002d4507b4e6b407292e87f4/roles/8daabcb6b7394e39b06a3453e33e32db => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:04:34.613688 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e71e74-2ee1-4f31-872c-20036e0972ab None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:34.613885 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e71e74-2ee1-4f31-872c-20036e0972ab None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:34.614295 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e71e74-2ee1-4f31-872c-20036e0972ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:34.648759 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-c2e71e74-2ee1-4f31-872c-20036e0972ab None None] MFA Rules not processed for user `6d2b81a6002d4507b4e6b407292e87f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:04:34.650242 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-c2e71e74-2ee1-4f31-872c-20036e0972ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:34.825373 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1111/2226] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:04:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:04:34.845470 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01f3acd-d3e4-4e54-9a09-40751368e3f0 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:34.847419 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-b01f3acd-d3e4-4e54-9a09-40751368e3f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:34.971604 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01f3acd-d3e4-4e54-9a09-40751368e3f0 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:34.976912 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686b263a-a4f7-408e-8eeb-2dd166101185 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf8e725cbe0403d943b136235eac057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:34.977203 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b263a-a4f7-408e-8eeb-2dd166101185 service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:34.977593 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b263a-a4f7-408e-8eeb-2dd166101185 service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:34.977979 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b263a-a4f7-408e-8eeb-2dd166101185 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:34.987803 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686b263a-a4f7-408e-8eeb-2dd166101185 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:34.989105 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686b263a-a4f7-408e-8eeb-2dd166101185 service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:35.005024 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1116/2227] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:04:34 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:04:39.332190 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b3b085-8919-4e98-9679-3cea35bfd1ad None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:39.332684 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b3b085-8919-4e98-9679-3cea35bfd1ad None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:39.335433 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b3b085-8919-4e98-9679-3cea35bfd1ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:39.377327 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-73b3b085-8919-4e98-9679-3cea35bfd1ad None None] MFA Rules not processed for user `e4de640d5e9e41d8b276e6ae941a979c`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:04:39.378670 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-73b3b085-8919-4e98-9679-3cea35bfd1ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:39.454434 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:04:39.464078 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1112/2228] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:04:39 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:04:39.474319 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686b263a-a4f7-408e-8eeb-2dd166101185 service cinder] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:39.475852 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-686b263a-a4f7-408e-8eeb-2dd166101185 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:39.569691 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686b263a-a4f7-408e-8eeb-2dd166101185 service cinder] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:39.573740 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb8ccf8-9688-4f6b-80af-ccfad54c17b3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e7f1ec6ad64b978f8817a5d2a73757', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:39.574544 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb8ccf8-9688-4f6b-80af-ccfad54c17b3 service glance] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:39.574829 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb8ccf8-9688-4f6b-80af-ccfad54c17b3 service glance] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:39.575108 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb8ccf8-9688-4f6b-80af-ccfad54c17b3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:39.577103 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-2fb8ccf8-9688-4f6b-80af-ccfad54c17b3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:39.656074 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:04:39.661567 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb8ccf8-9688-4f6b-80af-ccfad54c17b3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:39.663602 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb8ccf8-9688-4f6b-80af-ccfad54c17b3 service glance] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:39.675549 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1117/2229] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:04:39 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:04:39.836042 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dcb0ed-05e3-4f54-845b-ae4ceba2eba3 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:39.836447 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dcb0ed-05e3-4f54-845b-ae4ceba2eba3 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:39.836811 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dcb0ed-05e3-4f54-845b-ae4ceba2eba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:39.864121 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-b2dcb0ed-05e3-4f54-845b-ae4ceba2eba3 None None] MFA Rules not processed for user `179709fe7d8343689f096ac0d9a333b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:04:39.866452 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-b2dcb0ed-05e3-4f54-845b-ae4ceba2eba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:39.954143 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1113/2230] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Aug 10 10:04:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:04:40.001309 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb8ccf8-9688-4f6b-80af-ccfad54c17b3 service glance] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:40.003544 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-2fb8ccf8-9688-4f6b-80af-ccfad54c17b3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:40.102614 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb8ccf8-9688-4f6b-80af-ccfad54c17b3 service glance] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:40.108090 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da113a2-ed95-4e3b-9451-996546e568ff service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b801551d29ff4687ab8c1ce8cfa51614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:40.108719 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da113a2-ed95-4e3b-9451-996546e568ff service swift] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:40.109003 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da113a2-ed95-4e3b-9451-996546e568ff service swift] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:40.109329 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da113a2-ed95-4e3b-9451-996546e568ff service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:40.119215 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da113a2-ed95-4e3b-9451-996546e568ff service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:40.120900 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da113a2-ed95-4e3b-9451-996546e568ff service swift] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:40.131822 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1118/2231] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Aug 10 10:04:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 10:04:47.721516 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dcb0ed-05e3-4f54-845b-ae4ceba2eba3 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:47.793937 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dcb0ed-05e3-4f54-845b-ae4ceba2eba3 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:47.801337 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5484a7-e2c7-4a5d-8892-0c01a1f310e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:47.801686 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5484a7-e2c7-4a5d-8892-0c01a1f310e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:47.801962 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5484a7-e2c7-4a5d-8892-0c01a1f310e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:47.802234 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5484a7-e2c7-4a5d-8892-0c01a1f310e4 admin admin] PATH_INFO: `/v3/users/6d2b81a6002d4507b4e6b407292e87f4` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:47.803384 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5484a7-e2c7-4a5d-8892-0c01a1f310e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d2b81a6002d4507b4e6b407292e87f4)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:47.805743 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5484a7-e2c7-4a5d-8892-0c01a1f310e4 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:47.867409 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-9a5484a7-e2c7-4a5d-8892-0c01a1f310e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d2b81a6002d4507b4e6b407292e87f4'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:47.878179 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-9a5484a7-e2c7-4a5d-8892-0c01a1f310e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d2b81a6002d4507b4e6b407292e87f4'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:47.892228 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-9a5484a7-e2c7-4a5d-8892-0c01a1f310e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d2b81a6002d4507b4e6b407292e87f4'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:47.892944 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-9a5484a7-e2c7-4a5d-8892-0c01a1f310e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d2b81a6002d4507b4e6b407292e87f4'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:47.893663 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-9a5484a7-e2c7-4a5d-8892-0c01a1f310e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d2b81a6002d4507b4e6b407292e87f4'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:47.922180 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1114/2232] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 10 10:04:47 2022] DELETE /identity/v3/users/6d2b81a6002d4507b4e6b407292e87f4 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:04:47.923875 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2e61f4-4e2a-4b53-99b9-f5b6c63b48cb None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:47.924385 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2e61f4-4e2a-4b53-99b9-f5b6c63b48cb None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:47.924490 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2e61f4-4e2a-4b53-99b9-f5b6c63b48cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:47.956295 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-1a2e61f4-4e2a-4b53-99b9-f5b6c63b48cb None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:04:47.957570 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-1a2e61f4-4e2a-4b53-99b9-f5b6c63b48cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:48.040006 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1119/2233] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:04:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:04:48.050377 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5484a7-e2c7-4a5d-8892-0c01a1f310e4 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:48.051948 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-9a5484a7-e2c7-4a5d-8892-0c01a1f310e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:48.090641 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:04:48.131907 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5484a7-e2c7-4a5d-8892-0c01a1f310e4 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:48.138358 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6538d13-96e7-42a1-9751-c10098c3894a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4294c170df354fe892831281acd4ea7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:48.139357 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6538d13-96e7-42a1-9751-c10098c3894a service neutron] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:48.140529 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6538d13-96e7-42a1-9751-c10098c3894a service neutron] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:48.141012 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6538d13-96e7-42a1-9751-c10098c3894a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:48.160910 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6538d13-96e7-42a1-9751-c10098c3894a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:48.163426 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6538d13-96e7-42a1-9751-c10098c3894a service neutron] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:48.177978 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1115/2234] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:04:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:04:48.530710 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2e61f4-4e2a-4b53-99b9-f5b6c63b48cb None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:48.534406 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-1a2e61f4-4e2a-4b53-99b9-f5b6c63b48cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:48.548488 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2e61f4-4e2a-4b53-99b9-f5b6c63b48cb None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:48.553982 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93387516-64bb-4737-b142-dad923902a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:48.555058 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93387516-64bb-4737-b142-dad923902a32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:48.555399 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93387516-64bb-4737-b142-dad923902a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:48.555738 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93387516-64bb-4737-b142-dad923902a32 admin admin] PATH_INFO: `/v3/projects/39b6417291e240faaabffd05bd8f0c7a` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:48.558164 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93387516-64bb-4737-b142-dad923902a32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39b6417291e240faaabffd05bd8f0c7a)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:48.560039 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93387516-64bb-4737-b142-dad923902a32 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:48.618603 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-93387516-64bb-4737-b142-dad923902a32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39b6417291e240faaabffd05bd8f0c7a', 'request_id': 'req-93387516-64bb-4737-b142-dad923902a32'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:48.626463 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-93387516-64bb-4737-b142-dad923902a32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39b6417291e240faaabffd05bd8f0c7a', 'request_id': 'req-93387516-64bb-4737-b142-dad923902a32'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:48.636632 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-93387516-64bb-4737-b142-dad923902a32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39b6417291e240faaabffd05bd8f0c7a', 'request_id': 'req-93387516-64bb-4737-b142-dad923902a32'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:48.653138 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-93387516-64bb-4737-b142-dad923902a32 admin admin] The token cache is being invalidate because project 39b6417291e240faaabffd05bd8f0c7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 10:04:48.653715 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-93387516-64bb-4737-b142-dad923902a32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:48.654393 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-93387516-64bb-4737-b142-dad923902a32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:04:48.656272 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1120/2235] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 10 10:04:48 2022] DELETE /identity/v3/projects/39b6417291e240faaabffd05bd8f0c7a => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 10:04:48.661350 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19d3caa-19a6-4a4b-8305-3c974d2562c5 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:48.661861 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19d3caa-19a6-4a4b-8305-3c974d2562c5 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:48.662376 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19d3caa-19a6-4a4b-8305-3c974d2562c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:48.694662 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-c19d3caa-19a6-4a4b-8305-3c974d2562c5 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:04:48.695991 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-c19d3caa-19a6-4a4b-8305-3c974d2562c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:48.788627 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1116/2236] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:04:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:04:48.796672 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f264e22-8647-4133-a6c5-23109268ef59 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:48.796961 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f264e22-8647-4133-a6c5-23109268ef59 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:48.797289 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f264e22-8647-4133-a6c5-23109268ef59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:48.829915 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-4f264e22-8647-4133-a6c5-23109268ef59 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:04:48.831600 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-4f264e22-8647-4133-a6c5-23109268ef59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:48.864357 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19d3caa-19a6-4a4b-8305-3c974d2562c5 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:48.864516 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1121/2237] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:04:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:04:48.882058 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19d3caa-19a6-4a4b-8305-3c974d2562c5 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:48.887200 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99282f19-ca21-4f67-a499-29d4fa9e3ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:48.887819 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99282f19-ca21-4f67-a499-29d4fa9e3ea3 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:48.888094 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99282f19-ca21-4f67-a499-29d4fa9e3ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:48.888366 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99282f19-ca21-4f67-a499-29d4fa9e3ea3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:48.889025 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99282f19-ca21-4f67-a499-29d4fa9e3ea3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:04:48.889362 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99282f19-ca21-4f67-a499-29d4fa9e3ea3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:48.891045 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99282f19-ca21-4f67-a499-29d4fa9e3ea3 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:48.909119 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1117/2238] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 10 10:04:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 10:04:48.910565 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f264e22-8647-4133-a6c5-23109268ef59 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:48.915584 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:04:48.924523 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f264e22-8647-4133-a6c5-23109268ef59 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:48.930986 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd171abd-1f17-49e1-92a1-976f9026cd4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:48.932078 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd171abd-1f17-49e1-92a1-976f9026cd4d admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:48.933484 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd171abd-1f17-49e1-92a1-976f9026cd4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:48.937102 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd171abd-1f17-49e1-92a1-976f9026cd4d admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:48.937102 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd171abd-1f17-49e1-92a1-976f9026cd4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:48.939235 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd171abd-1f17-49e1-92a1-976f9026cd4d admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:49.017171 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99282f19-ca21-4f67-a499-29d4fa9e3ea3 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:49.017623 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1122/2239] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 10 10:04:48 2022] POST /identity/v3/projects => generated 373 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 10:04:49.036816 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99282f19-ca21-4f67-a499-29d4fa9e3ea3 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:49.194054 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17af322-6491-41d0-94eb-5b40170d286f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:49.195007 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17af322-6491-41d0-94eb-5b40170d286f admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:49.195453 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17af322-6491-41d0-94eb-5b40170d286f admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:49.195996 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17af322-6491-41d0-94eb-5b40170d286f admin admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:49.196794 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17af322-6491-41d0-94eb-5b40170d286f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:49.199438 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17af322-6491-41d0-94eb-5b40170d286f admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:49.231064 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1118/2240] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 10 10:04:49 2022] POST /identity/v3/users => generated 287 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:04:49.235298 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd171abd-1f17-49e1-92a1-976f9026cd4d admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:49.252905 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd171abd-1f17-49e1-92a1-976f9026cd4d admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:49.257702 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10769c16-d404-41da-a63a-8228abb0d061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:49.258314 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10769c16-d404-41da-a63a-8228abb0d061 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:49.258590 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10769c16-d404-41da-a63a-8228abb0d061 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:49.258942 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10769c16-d404-41da-a63a-8228abb0d061 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:49.259663 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10769c16-d404-41da-a63a-8228abb0d061 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:49.261325 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10769c16-d404-41da-a63a-8228abb0d061 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:49.272880 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1123/2241] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:04:49 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:04:49.277168 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17af322-6491-41d0-94eb-5b40170d286f admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:49.288075 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17af322-6491-41d0-94eb-5b40170d286f admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:49.293255 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5017c1-e712-4a42-bbe8-1bb7ce0af947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:49.293888 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5017c1-e712-4a42-bbe8-1bb7ce0af947 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:49.294171 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5017c1-e712-4a42-bbe8-1bb7ce0af947 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:49.294446 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5017c1-e712-4a42-bbe8-1bb7ce0af947 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:49.295219 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5017c1-e712-4a42-bbe8-1bb7ce0af947 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:49.297319 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5017c1-e712-4a42-bbe8-1bb7ce0af947 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:49.310861 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1119/2242] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:04:49 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:04:49.327759 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10769c16-d404-41da-a63a-8228abb0d061 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:49.343047 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10769c16-d404-41da-a63a-8228abb0d061 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:49.348458 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1ce4e3-9b69-4686-a31a-4eb80f801523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:49.349186 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ce4e3-9b69-4686-a31a-4eb80f801523 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:49.349468 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ce4e3-9b69-4686-a31a-4eb80f801523 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:49.349744 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ce4e3-9b69-4686-a31a-4eb80f801523 admin admin] PATH_INFO: `/v3/projects/92ec0826be894e9a819919c8f15a4d4e/users/22d9272279894d2f837bcb6f16c2cbff/roles/8daabcb6b7394e39b06a3453e33e32db` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:49.366908 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1ce4e3-9b69-4686-a31a-4eb80f801523 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92ec0826be894e9a819919c8f15a4d4e, user_id=22d9272279894d2f837bcb6f16c2cbff, role_id=8daabcb6b7394e39b06a3453e33e32db)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:49.370285 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1ce4e3-9b69-4686-a31a-4eb80f801523 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:49.404879 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1124/2243] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:04:49 2022] PUT /identity/v3/projects/92ec0826be894e9a819919c8f15a4d4e/users/22d9272279894d2f837bcb6f16c2cbff/roles/8daabcb6b7394e39b06a3453e33e32db => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:04:49.416243 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b75cc0-8a59-43e4-9bfe-00cd65787293 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:49.416503 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b75cc0-8a59-43e4-9bfe-00cd65787293 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:49.416775 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b75cc0-8a59-43e4-9bfe-00cd65787293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:49.450975 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-f1b75cc0-8a59-43e4-9bfe-00cd65787293 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:04:49.452211 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-f1b75cc0-8a59-43e4-9bfe-00cd65787293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:49.498231 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:04:49.549617 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1120/2244] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:04:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:04:49.581230 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1ce4e3-9b69-4686-a31a-4eb80f801523 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:49.583205 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-8e1ce4e3-9b69-4686-a31a-4eb80f801523 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:49.658763 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1ce4e3-9b69-4686-a31a-4eb80f801523 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:49.662207 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c746c440-514d-4040-8927-d0bc791fb574 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4294c170df354fe892831281acd4ea7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:49.662839 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c746c440-514d-4040-8927-d0bc791fb574 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:49.663120 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c746c440-514d-4040-8927-d0bc791fb574 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:49.663396 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c746c440-514d-4040-8927-d0bc791fb574 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:49.682606 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c746c440-514d-4040-8927-d0bc791fb574 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:49.684523 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c746c440-514d-4040-8927-d0bc791fb574 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:49.696176 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1125/2245] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:04:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:04:50.285820 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19741090-fd5b-4dc7-84ed-03c545216a9d None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:50.286410 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19741090-fd5b-4dc7-84ed-03c545216a9d None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:50.286410 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19741090-fd5b-4dc7-84ed-03c545216a9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:50.309334 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-19741090-fd5b-4dc7-84ed-03c545216a9d None None] MFA Rules not processed for user `d41372e4bfd2439291ab0a979fecc160`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:04:50.311019 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-19741090-fd5b-4dc7-84ed-03c545216a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:50.389239 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1121/2246] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:04:50 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:04:50.647243 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a6a6fd-937e-4a34-b2e3-4a657d108c2d None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:50.647804 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a6a6fd-937e-4a34-b2e3-4a657d108c2d None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:50.647804 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a6a6fd-937e-4a34-b2e3-4a657d108c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:50.680403 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-00a6a6fd-937e-4a34-b2e3-4a657d108c2d None None] MFA Rules not processed for user `22d9272279894d2f837bcb6f16c2cbff`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:04:50.681998 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-00a6a6fd-937e-4a34-b2e3-4a657d108c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:50.751563 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1126/2247] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:04:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:04:50.767442 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19741090-fd5b-4dc7-84ed-03c545216a9d None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:50.768903 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-19741090-fd5b-4dc7-84ed-03c545216a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:50.831881 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19741090-fd5b-4dc7-84ed-03c545216a9d None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:50.835518 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ca109e-da1b-4970-97e8-e4e74178eccb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf8e725cbe0403d943b136235eac057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:50.836126 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ca109e-da1b-4970-97e8-e4e74178eccb service cinder] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:50.838162 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ca109e-da1b-4970-97e8-e4e74178eccb service cinder] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:50.838162 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ca109e-da1b-4970-97e8-e4e74178eccb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:50.858786 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ca109e-da1b-4970-97e8-e4e74178eccb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:50.860331 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ca109e-da1b-4970-97e8-e4e74178eccb service cinder] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:50.870413 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1122/2248] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:04:50 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:04:52.288032 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc2bafd-b142-4fc5-9f15-b55442f1ffb5 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:52.288593 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc2bafd-b142-4fc5-9f15-b55442f1ffb5 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:52.288593 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc2bafd-b142-4fc5-9f15-b55442f1ffb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:52.308004 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-9cc2bafd-b142-4fc5-9f15-b55442f1ffb5 None None] MFA Rules not processed for user `22d9272279894d2f837bcb6f16c2cbff`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:04:52.309278 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-9cc2bafd-b142-4fc5-9f15-b55442f1ffb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:52.316577 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1127/2249] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:04:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:04:52.885968 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6196650b-0e9a-406b-9286-250f2fa3c60d None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:52.887120 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6196650b-0e9a-406b-9286-250f2fa3c60d None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:52.887683 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6196650b-0e9a-406b-9286-250f2fa3c60d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:52.909552 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-6196650b-0e9a-406b-9286-250f2fa3c60d None None] MFA Rules not processed for user `179709fe7d8343689f096ac0d9a333b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:04:52.910950 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-6196650b-0e9a-406b-9286-250f2fa3c60d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:52.971064 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1123/2250] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Aug 10 10:04:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:04:52.983824 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc2bafd-b142-4fc5-9f15-b55442f1ffb5 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:04:52.985355 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-9cc2bafd-b142-4fc5-9f15-b55442f1ffb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:04:53.025389 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:04:53.065513 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc2bafd-b142-4fc5-9f15-b55442f1ffb5 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:04:53.072097 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a1b4ce-93ba-4cdf-a2d2-238b90d9fa2a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b801551d29ff4687ab8c1ce8cfa51614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:04:53.072946 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a1b4ce-93ba-4cdf-a2d2-238b90d9fa2a service swift] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:04:53.073220 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a1b4ce-93ba-4cdf-a2d2-238b90d9fa2a service swift] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:04:53.073548 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a1b4ce-93ba-4cdf-a2d2-238b90d9fa2a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:04:53.082752 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a1b4ce-93ba-4cdf-a2d2-238b90d9fa2a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:04:53.084379 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a1b4ce-93ba-4cdf-a2d2-238b90d9fa2a service swift] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:04:53.094942 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1128/2251] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Aug 10 10:04:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 10:05:02.963793 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=88 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:05:03.089772 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=18 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:05:04.960359 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68503ca2-8710-4d16-b038-4e9b8802df02 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:05:04.961081 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68503ca2-8710-4d16-b038-4e9b8802df02 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:05:04.961566 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68503ca2-8710-4d16-b038-4e9b8802df02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:05:04.982048 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-68503ca2-8710-4d16-b038-4e9b8802df02 None None] MFA Rules not processed for user `63fa6ba87a7a4827af4c5fbd4629b1c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:05:04.983486 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-68503ca2-8710-4d16-b038-4e9b8802df02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:05:05.047150 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1124/2252] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:05:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:05:15.039815 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=25 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:05:19.011156 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a1b4ce-93ba-4cdf-a2d2-238b90d9fa2a service swift] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:05:19.012691 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-f4a1b4ce-93ba-4cdf-a2d2-238b90d9fa2a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:05:19.024557 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a1b4ce-93ba-4cdf-a2d2-238b90d9fa2a service swift] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:05:19.028176 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cdfd02-6058-4938-9952-10a8dbe7bfcd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4294c170df354fe892831281acd4ea7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:05:19.028834 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cdfd02-6058-4938-9952-10a8dbe7bfcd service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:05:19.029207 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cdfd02-6058-4938-9952-10a8dbe7bfcd service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:05:19.029536 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cdfd02-6058-4938-9952-10a8dbe7bfcd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:05:19.031271 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-f4cdfd02-6058-4938-9952-10a8dbe7bfcd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:05:19.098500 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cdfd02-6058-4938-9952-10a8dbe7bfcd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:05:19.099958 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cdfd02-6058-4938-9952-10a8dbe7bfcd service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:05:19.109846 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1129/2253] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:05:19 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:05:20.843932 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86c844e-e517-4f6f-97f6-1ab9f46f5839 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:05:20.844991 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86c844e-e517-4f6f-97f6-1ab9f46f5839 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:05:20.845577 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86c844e-e517-4f6f-97f6-1ab9f46f5839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:05:20.887562 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-e86c844e-e517-4f6f-97f6-1ab9f46f5839 None None] MFA Rules not processed for user `179709fe7d8343689f096ac0d9a333b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:05:20.889259 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-e86c844e-e517-4f6f-97f6-1ab9f46f5839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:05:20.906850 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1125/2254] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Aug 10 10:05:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 10:05:20.919324 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cdfd02-6058-4938-9952-10a8dbe7bfcd service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:05:20.932688 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cdfd02-6058-4938-9952-10a8dbe7bfcd service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:05:20.939905 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72c141a-a488-4eb2-9373-650a99e1ef34 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b801551d29ff4687ab8c1ce8cfa51614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:05:20.940808 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72c141a-a488-4eb2-9373-650a99e1ef34 service swift] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:05:20.941390 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72c141a-a488-4eb2-9373-650a99e1ef34 service swift] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:05:20.941809 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72c141a-a488-4eb2-9373-650a99e1ef34 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:05:20.963950 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72c141a-a488-4eb2-9373-650a99e1ef34 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:05:20.966224 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72c141a-a488-4eb2-9373-650a99e1ef34 service swift] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:05:20.980603 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1130/2255] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Aug 10 10:05:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 10:05:27.049306 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7049c3ba-2349-4668-b5ad-a41099725576 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:05:27.049941 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7049c3ba-2349-4668-b5ad-a41099725576 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:05:27.050506 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7049c3ba-2349-4668-b5ad-a41099725576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:05:27.304956 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-7049c3ba-2349-4668-b5ad-a41099725576 None None] MFA Rules not processed for user `22d9272279894d2f837bcb6f16c2cbff`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:05:27.306234 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-7049c3ba-2349-4668-b5ad-a41099725576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:05:27.321516 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1126/2256] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:05:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:05:30.973932 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=36 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:05:37.284861 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=6 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:05:39.544698 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c773d4-7f7b-4525-beaa-8596ac97a155 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:05:39.545414 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c773d4-7f7b-4525-beaa-8596ac97a155 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:05:39.545414 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c773d4-7f7b-4525-beaa-8596ac97a155 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:05:39.547029 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1131/2257] 10.222.0.27 () {54 vars in 921 bytes} [Wed Aug 10 10:05:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:05:39.552836 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4971ce3-dfc6-48bf-b8d8-3a62f48cb552 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:05:39.553719 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4971ce3-dfc6-48bf-b8d8-3a62f48cb552 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:05:39.553823 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4971ce3-dfc6-48bf-b8d8-3a62f48cb552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:05:39.574613 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-b4971ce3-dfc6-48bf-b8d8-3a62f48cb552 None None] MFA Rules not processed for user `dd8580888cba41a88566da4540b1130c`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:05:39.575859 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-b4971ce3-dfc6-48bf-b8d8-3a62f48cb552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:05:39.646634 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1127/2258] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Aug 10 10:05:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:05:39.658988 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c773d4-7f7b-4525-beaa-8596ac97a155 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:05:39.660979 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-77c773d4-7f7b-4525-beaa-8596ac97a155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:05:39.723435 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c773d4-7f7b-4525-beaa-8596ac97a155 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:05:39.726971 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b07ec94-dd2c-481b-a955-cd19c35cad5d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e7f1ec6ad64b978f8817a5d2a73757', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:05:39.727597 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b07ec94-dd2c-481b-a955-cd19c35cad5d service glance] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:05:39.727879 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b07ec94-dd2c-481b-a955-cd19c35cad5d service glance] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:05:39.728154 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b07ec94-dd2c-481b-a955-cd19c35cad5d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:05:39.743559 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b07ec94-dd2c-481b-a955-cd19c35cad5d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:05:39.745177 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b07ec94-dd2c-481b-a955-cd19c35cad5d service glance] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:05:39.756885 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1132/2259] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:05:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:05:39.829437 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d094aa-de0e-4419-b520-c49e6d7c659e None None] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:05:39.829725 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d094aa-de0e-4419-b520-c49e6d7c659e None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:05:39.829995 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d094aa-de0e-4419-b520-c49e6d7c659e None None] PATH_INFO: `/` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:05:39.831414 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1128/2260] 10.222.0.27 () {54 vars in 921 bytes} [Wed Aug 10 10:05:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:05:39.836452 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec49e9a-d931-4239-98ad-a8f770aaad4f None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:05:39.836742 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec49e9a-d931-4239-98ad-a8f770aaad4f None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:05:39.837018 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec49e9a-d931-4239-98ad-a8f770aaad4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:05:39.859520 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-7ec49e9a-d931-4239-98ad-a8f770aaad4f None None] MFA Rules not processed for user `4294c170df354fe892831281acd4ea7d`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:05:39.860738 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-7ec49e9a-d931-4239-98ad-a8f770aaad4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:05:39.868342 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1133/2261] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Aug 10 10:05:39 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:05:39.884092 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d094aa-de0e-4419-b520-c49e6d7c659e None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:05:39.901636 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d094aa-de0e-4419-b520-c49e6d7c659e None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:05:39.906151 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c889179-270b-48a0-b35f-70d374e794c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4294c170df354fe892831281acd4ea7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:05:39.906749 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c889179-270b-48a0-b35f-70d374e794c4 service neutron] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:05:39.907017 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c889179-270b-48a0-b35f-70d374e794c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:05:39.907296 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c889179-270b-48a0-b35f-70d374e794c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:05:39.914784 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c889179-270b-48a0-b35f-70d374e794c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:05:39.916214 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c889179-270b-48a0-b35f-70d374e794c4 service neutron] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:05:39.924332 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1129/2262] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:05:39 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 10:05:40.027475 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d4021a-7cd9-4b99-aaa6-0ceb01e1b26d None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:05:40.027844 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d4021a-7cd9-4b99-aaa6-0ceb01e1b26d None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:05:40.028118 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d4021a-7cd9-4b99-aaa6-0ceb01e1b26d None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:05:40.029583 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1134/2263] 10.222.0.27 () {54 vars in 921 bytes} [Wed Aug 10 10:05:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:05:40.035159 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a48335f-8a3a-474b-8198-9a21ae6dc4e3 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:05:40.035468 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a48335f-8a3a-474b-8198-9a21ae6dc4e3 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:05:40.035742 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a48335f-8a3a-474b-8198-9a21ae6dc4e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:05:40.059299 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-7a48335f-8a3a-474b-8198-9a21ae6dc4e3 None None] MFA Rules not processed for user `dd8580888cba41a88566da4540b1130c`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:05:40.060523 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-7a48335f-8a3a-474b-8198-9a21ae6dc4e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:05:40.071557 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1130/2264] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Aug 10 10:05:40 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:05:40.085652 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d4021a-7cd9-4b99-aaa6-0ceb01e1b26d None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:05:40.099841 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d4021a-7cd9-4b99-aaa6-0ceb01e1b26d None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:05:40.105903 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2415650-6751-4956-bc6d-a295616e3c3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4294c170df354fe892831281acd4ea7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:05:40.106771 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2415650-6751-4956-bc6d-a295616e3c3d service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:05:40.107125 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2415650-6751-4956-bc6d-a295616e3c3d service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:05:40.107458 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2415650-6751-4956-bc6d-a295616e3c3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:05:40.123269 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2415650-6751-4956-bc6d-a295616e3c3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:05:40.124710 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2415650-6751-4956-bc6d-a295616e3c3d service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:05:40.135732 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1135/2265] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:05:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:05:45.526894 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ceff7c-3055-49fa-8b34-a8150ceb22bc None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:05:45.527426 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ceff7c-3055-49fa-8b34-a8150ceb22bc None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:05:45.527506 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ceff7c-3055-49fa-8b34-a8150ceb22bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:05:45.550715 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-27ceff7c-3055-49fa-8b34-a8150ceb22bc None None] MFA Rules not processed for user `179709fe7d8343689f096ac0d9a333b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:05:45.551963 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-27ceff7c-3055-49fa-8b34-a8150ceb22bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:05:45.564491 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1131/2266] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Aug 10 10:05:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:05:45.586235 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2415650-6751-4956-bc6d-a295616e3c3d service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:05:45.597462 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2415650-6751-4956-bc6d-a295616e3c3d service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:05:45.602509 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a7d0a7-e727-4e2a-9167-b1af692f3ce8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b801551d29ff4687ab8c1ce8cfa51614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:05:45.603106 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a7d0a7-e727-4e2a-9167-b1af692f3ce8 service swift] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:05:45.603380 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a7d0a7-e727-4e2a-9167-b1af692f3ce8 service swift] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:05:45.603646 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a7d0a7-e727-4e2a-9167-b1af692f3ce8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:05:45.620107 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a7d0a7-e727-4e2a-9167-b1af692f3ce8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:05:45.621936 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a7d0a7-e727-4e2a-9167-b1af692f3ce8 service swift] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:05:45.630980 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1136/2267] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Aug 10 10:05:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 10:05:55.545596 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=43 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:05:55.627084 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=41 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:06:01.835323 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc148b3a-e37c-4855-bb77-4a5bf29f878c None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:06:01.835820 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc148b3a-e37c-4855-bb77-4a5bf29f878c None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:06:01.835923 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc148b3a-e37c-4855-bb77-4a5bf29f878c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:06:01.855531 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-bc148b3a-e37c-4855-bb77-4a5bf29f878c None None] MFA Rules not processed for user `179709fe7d8343689f096ac0d9a333b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:06:01.856760 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-bc148b3a-e37c-4855-bb77-4a5bf29f878c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:06:01.864910 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1132/2268] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Aug 10 10:06:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:06:01.877105 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a7d0a7-e727-4e2a-9167-b1af692f3ce8 service swift] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:06:01.889901 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a7d0a7-e727-4e2a-9167-b1af692f3ce8 service swift] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:06:01.895875 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f90e28-bf9b-4407-bcea-7e3067eee3ff service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b801551d29ff4687ab8c1ce8cfa51614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:06:01.896711 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f90e28-bf9b-4407-bcea-7e3067eee3ff service swift] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:06:01.897181 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f90e28-bf9b-4407-bcea-7e3067eee3ff service swift] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:06:01.897624 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f90e28-bf9b-4407-bcea-7e3067eee3ff service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:06:01.907830 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f90e28-bf9b-4407-bcea-7e3067eee3ff service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:06:01.909459 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f90e28-bf9b-4407-bcea-7e3067eee3ff service swift] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:06:01.918406 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1137/2269] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Aug 10 10:06:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 10:06:08.055406 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf36175f-8a97-4d9c-91bb-d4cd183e5d90 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:06:08.055974 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf36175f-8a97-4d9c-91bb-d4cd183e5d90 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:06:08.055974 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf36175f-8a97-4d9c-91bb-d4cd183e5d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:06:08.080031 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-cf36175f-8a97-4d9c-91bb-d4cd183e5d90 None None] MFA Rules not processed for user `179709fe7d8343689f096ac0d9a333b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:06:08.081300 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-cf36175f-8a97-4d9c-91bb-d4cd183e5d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:06:08.090739 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1133/2270] 10.222.0.27 () {58 vars in 967 bytes} [Wed Aug 10 10:06:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 10:06:08.107804 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f90e28-bf9b-4407-bcea-7e3067eee3ff service swift] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:06:08.122162 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f90e28-bf9b-4407-bcea-7e3067eee3ff service swift] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:06:08.127566 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93a4cbe-04cb-436b-bc50-afb38c29687b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b801551d29ff4687ab8c1ce8cfa51614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:06:08.128383 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93a4cbe-04cb-436b-bc50-afb38c29687b service swift] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:06:08.128807 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93a4cbe-04cb-436b-bc50-afb38c29687b service swift] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:06:08.129104 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93a4cbe-04cb-436b-bc50-afb38c29687b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:06:08.138394 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93a4cbe-04cb-436b-bc50-afb38c29687b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:06:08.140412 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93a4cbe-04cb-436b-bc50-afb38c29687b service swift] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:06:08.148934 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1138/2271] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Aug 10 10:06:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 10:06:11.754933 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dc8452-af07-4236-935f-e04cca0d510f None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:06:11.757452 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dc8452-af07-4236-935f-e04cca0d510f None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:06:11.757736 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dc8452-af07-4236-935f-e04cca0d510f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:06:11.785482 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-c7dc8452-af07-4236-935f-e04cca0d510f None None] MFA Rules not processed for user `60fc756c67ea44ccba82a37edae56586`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:06:11.787950 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-c7dc8452-af07-4236-935f-e04cca0d510f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:06:11.865225 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1134/2272] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:06:11 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:06:18.145634 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=12 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:06:19.449630 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c237e42a-7f45-4894-9d11-3dfa14d2456e None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:06:19.450229 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c237e42a-7f45-4894-9d11-3dfa14d2456e None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:06:19.450229 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c237e42a-7f45-4894-9d11-3dfa14d2456e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:06:19.470039 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-c237e42a-7f45-4894-9d11-3dfa14d2456e None None] MFA Rules not processed for user `179709fe7d8343689f096ac0d9a333b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:06:19.471165 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-c237e42a-7f45-4894-9d11-3dfa14d2456e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:06:19.478493 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1139/2273] 10.222.0.27 () {58 vars in 967 bytes} [Wed Aug 10 10:06:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:06:19.491761 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dc8452-af07-4236-935f-e04cca0d510f None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:06:19.505131 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dc8452-af07-4236-935f-e04cca0d510f None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:06:19.510368 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c49c03-71ab-4484-873f-040600dc4b5a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b801551d29ff4687ab8c1ce8cfa51614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:06:19.510986 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c49c03-71ab-4484-873f-040600dc4b5a service swift] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:06:19.511264 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c49c03-71ab-4484-873f-040600dc4b5a service swift] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:06:19.511536 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c49c03-71ab-4484-873f-040600dc4b5a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:06:19.520395 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c49c03-71ab-4484-873f-040600dc4b5a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:06:19.522053 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c49c03-71ab-4484-873f-040600dc4b5a service swift] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:06:19.530554 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1135/2274] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Aug 10 10:06:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 10:06:21.756748 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe45ecb9-5cac-411c-869f-3bf696947842 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:06:21.758228 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe45ecb9-5cac-411c-869f-3bf696947842 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:06:21.759130 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe45ecb9-5cac-411c-869f-3bf696947842 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:06:21.761736 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1140/2275] 10.222.0.27 () {54 vars in 921 bytes} [Wed Aug 10 10:06:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 10:06:21.771092 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5354359-3bb0-4c0a-b39c-c2bde67f21f6 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:06:21.772149 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5354359-3bb0-4c0a-b39c-c2bde67f21f6 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:06:21.772793 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5354359-3bb0-4c0a-b39c-c2bde67f21f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:06:21.797195 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-d5354359-3bb0-4c0a-b39c-c2bde67f21f6 None None] MFA Rules not processed for user `a6b658f1e27b4dfb96de71dc6a7e9496`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:06:21.799072 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-d5354359-3bb0-4c0a-b39c-c2bde67f21f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:06:21.863709 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe45ecb9-5cac-411c-869f-3bf696947842 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:06:21.883841 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe45ecb9-5cac-411c-869f-3bf696947842 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:06:21.894193 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429f3817-035e-428b-ad3a-bc0f913dd258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:06:21.895135 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429f3817-035e-428b-ad3a-bc0f913dd258 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:06:21.896206 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429f3817-035e-428b-ad3a-bc0f913dd258 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:06:21.896498 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429f3817-035e-428b-ad3a-bc0f913dd258 admin admin] PATH_INFO: `/v3/users/22d9272279894d2f837bcb6f16c2cbff` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:06:21.897849 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429f3817-035e-428b-ad3a-bc0f913dd258 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22d9272279894d2f837bcb6f16c2cbff)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:06:21.900898 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429f3817-035e-428b-ad3a-bc0f913dd258 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:06:21.903895 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1136/2276] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Aug 10 10:06:21 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:06:21.917767 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5354359-3bb0-4c0a-b39c-c2bde67f21f6 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:06:21.919160 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-d5354359-3bb0-4c0a-b39c-c2bde67f21f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:06:21.934267 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5354359-3bb0-4c0a-b39c-c2bde67f21f6 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:06:21.943661 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a716d02-f9de-46d5-b021-55da5b775e06 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6b658f1e27b4dfb96de71dc6a7e9496', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:06:21.945150 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a716d02-f9de-46d5-b021-55da5b775e06 service placement] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:06:21.945420 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a716d02-f9de-46d5-b021-55da5b775e06 service placement] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:06:21.945857 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a716d02-f9de-46d5-b021-55da5b775e06 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:06:21.958173 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a716d02-f9de-46d5-b021-55da5b775e06 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:06:21.959764 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a716d02-f9de-46d5-b021-55da5b775e06 service placement] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:06:21.977181 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1137/2277] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:06:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 10:06:21.991673 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-429f3817-035e-428b-ad3a-bc0f913dd258 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22d9272279894d2f837bcb6f16c2cbff'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:06:22.002726 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-429f3817-035e-428b-ad3a-bc0f913dd258 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22d9272279894d2f837bcb6f16c2cbff'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:06:22.003640 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-429f3817-035e-428b-ad3a-bc0f913dd258 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22d9272279894d2f837bcb6f16c2cbff'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:06:22.004605 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-429f3817-035e-428b-ad3a-bc0f913dd258 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22d9272279894d2f837bcb6f16c2cbff'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:06:22.014667 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-429f3817-035e-428b-ad3a-bc0f913dd258 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22d9272279894d2f837bcb6f16c2cbff'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:06:22.038230 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1141/2278] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 10 10:06:21 2022] DELETE /identity/v3/users/22d9272279894d2f837bcb6f16c2cbff => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 10:06:22.218284 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a716d02-f9de-46d5-b021-55da5b775e06 service placement] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:06:22.230997 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a716d02-f9de-46d5-b021-55da5b775e06 service placement] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:06:22.308749 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7d7e9c-a8fe-4975-8e6e-d3ebd15a8ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:06:22.309425 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7d7e9c-a8fe-4975-8e6e-d3ebd15a8ae5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:06:22.309722 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7d7e9c-a8fe-4975-8e6e-d3ebd15a8ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:06:22.309970 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7d7e9c-a8fe-4975-8e6e-d3ebd15a8ae5 admin admin] PATH_INFO: `/v3/projects/92ec0826be894e9a819919c8f15a4d4e` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:06:22.311117 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7d7e9c-a8fe-4975-8e6e-d3ebd15a8ae5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92ec0826be894e9a819919c8f15a4d4e)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:06:22.313038 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7d7e9c-a8fe-4975-8e6e-d3ebd15a8ae5 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:06:22.315474 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:06:22.363137 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-ea7d7e9c-a8fe-4975-8e6e-d3ebd15a8ae5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92ec0826be894e9a819919c8f15a4d4e', 'request_id': 'req-ea7d7e9c-a8fe-4975-8e6e-d3ebd15a8ae5'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:06:22.368549 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-ea7d7e9c-a8fe-4975-8e6e-d3ebd15a8ae5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92ec0826be894e9a819919c8f15a4d4e', 'request_id': 'req-ea7d7e9c-a8fe-4975-8e6e-d3ebd15a8ae5'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:06:22.377661 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-ea7d7e9c-a8fe-4975-8e6e-d3ebd15a8ae5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92ec0826be894e9a819919c8f15a4d4e', 'request_id': 'req-ea7d7e9c-a8fe-4975-8e6e-d3ebd15a8ae5'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:06:22.389928 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-ea7d7e9c-a8fe-4975-8e6e-d3ebd15a8ae5 admin admin] The token cache is being invalidate because project 92ec0826be894e9a819919c8f15a4d4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 10:06:22.390217 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-ea7d7e9c-a8fe-4975-8e6e-d3ebd15a8ae5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:06:22.390860 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-ea7d7e9c-a8fe-4975-8e6e-d3ebd15a8ae5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:06:22.392352 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1138/2279] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 10 10:06:22 2022] DELETE /identity/v3/projects/92ec0826be894e9a819919c8f15a4d4e => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 10:06:22.397413 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba38ed9c-cfcc-49fa-aafb-cb09f30a23a5 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:06:22.397696 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba38ed9c-cfcc-49fa-aafb-cb09f30a23a5 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:06:22.397984 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba38ed9c-cfcc-49fa-aafb-cb09f30a23a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:06:22.426527 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-ba38ed9c-cfcc-49fa-aafb-cb09f30a23a5 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:06:22.428258 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-ba38ed9c-cfcc-49fa-aafb-cb09f30a23a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:06:22.494212 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1142/2280] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:06:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 10:06:22.564513 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1cae0e-f297-4873-b65d-6fc6fb66aba3 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:06:22.564815 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1cae0e-f297-4873-b65d-6fc6fb66aba3 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:06:22.565310 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1cae0e-f297-4873-b65d-6fc6fb66aba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:06:22.585777 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-8b1cae0e-f297-4873-b65d-6fc6fb66aba3 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:06:22.587075 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-8b1cae0e-f297-4873-b65d-6fc6fb66aba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:06:22.598937 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1139/2281] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:06:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:06:22.599570 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba38ed9c-cfcc-49fa-aafb-cb09f30a23a5 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:06:22.613612 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba38ed9c-cfcc-49fa-aafb-cb09f30a23a5 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:06:22.619406 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea7c9cf-e3f9-42fa-83fe-25876069973a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:06:22.620253 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea7c9cf-e3f9-42fa-83fe-25876069973a admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:06:22.620372 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea7c9cf-e3f9-42fa-83fe-25876069973a admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:06:22.620571 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea7c9cf-e3f9-42fa-83fe-25876069973a admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:06:22.621272 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea7c9cf-e3f9-42fa-83fe-25876069973a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:06:22.621582 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea7c9cf-e3f9-42fa-83fe-25876069973a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:06:22.623214 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea7c9cf-e3f9-42fa-83fe-25876069973a admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:06:22.640136 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1143/2282] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 10 10:06:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 10:06:22.644758 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1cae0e-f297-4873-b65d-6fc6fb66aba3 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:06:22.654887 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1cae0e-f297-4873-b65d-6fc6fb66aba3 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:06:22.660374 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d759bfb-9600-4db4-8bb3-af13b378e116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:06:22.661243 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d759bfb-9600-4db4-8bb3-af13b378e116 admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:06:22.661679 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d759bfb-9600-4db4-8bb3-af13b378e116 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:06:22.662099 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d759bfb-9600-4db4-8bb3-af13b378e116 admin admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:06:22.662933 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d759bfb-9600-4db4-8bb3-af13b378e116 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:06:22.665018 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d759bfb-9600-4db4-8bb3-af13b378e116 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:06:22.699794 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1140/2283] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 10 10:06:22 2022] POST /identity/v3/projects => generated 367 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:06:22.704741 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea7c9cf-e3f9-42fa-83fe-25876069973a admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:06:22.716886 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea7c9cf-e3f9-42fa-83fe-25876069973a admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:06:22.775794 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:06:22.787398 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f177ec1b-5df4-4b00-8487-9894139699df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:06:22.788297 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f177ec1b-5df4-4b00-8487-9894139699df admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:06:22.788584 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f177ec1b-5df4-4b00-8487-9894139699df admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:06:22.788861 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f177ec1b-5df4-4b00-8487-9894139699df admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:06:22.789548 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f177ec1b-5df4-4b00-8487-9894139699df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:06:22.791652 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f177ec1b-5df4-4b00-8487-9894139699df admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:06:22.817355 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1144/2284] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 10 10:06:22 2022] POST /identity/v3/users => generated 284 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:06:22.818819 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d759bfb-9600-4db4-8bb3-af13b378e116 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:06:22.829878 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d759bfb-9600-4db4-8bb3-af13b378e116 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:06:22.834709 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66226a7b-200b-4d11-b0e7-2f58bd902228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:06:22.835395 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66226a7b-200b-4d11-b0e7-2f58bd902228 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:06:22.835743 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66226a7b-200b-4d11-b0e7-2f58bd902228 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:06:22.836084 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66226a7b-200b-4d11-b0e7-2f58bd902228 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:06:22.836823 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66226a7b-200b-4d11-b0e7-2f58bd902228 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:06:22.838775 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66226a7b-200b-4d11-b0e7-2f58bd902228 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:06:22.852426 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1141/2285] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:06:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:06:22.853784 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f177ec1b-5df4-4b00-8487-9894139699df admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:06:22.864133 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f177ec1b-5df4-4b00-8487-9894139699df admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:06:22.869079 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5188af14-3b0d-4a3a-89b6-dab2720fb534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:06:22.869844 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5188af14-3b0d-4a3a-89b6-dab2720fb534 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:06:22.870160 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5188af14-3b0d-4a3a-89b6-dab2720fb534 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:06:22.870521 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5188af14-3b0d-4a3a-89b6-dab2720fb534 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:06:22.871284 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5188af14-3b0d-4a3a-89b6-dab2720fb534 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:06:22.877912 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5188af14-3b0d-4a3a-89b6-dab2720fb534 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:06:22.889164 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1145/2286] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:06:22 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 10:06:22.893755 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66226a7b-200b-4d11-b0e7-2f58bd902228 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:06:22.903703 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66226a7b-200b-4d11-b0e7-2f58bd902228 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:06:22.908773 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e88be5-3cc3-4d63-aef0-f2290cd5a1c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:06:22.909477 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e88be5-3cc3-4d63-aef0-f2290cd5a1c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:06:22.909754 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e88be5-3cc3-4d63-aef0-f2290cd5a1c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:06:22.910042 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e88be5-3cc3-4d63-aef0-f2290cd5a1c8 admin admin] PATH_INFO: `/v3/projects/e1c4e5bcc1cf4705ae09c738afc354b0/users/66f3594712e04461b191709138eeb215/roles/8daabcb6b7394e39b06a3453e33e32db` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:06:22.948118 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e88be5-3cc3-4d63-aef0-f2290cd5a1c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1c4e5bcc1cf4705ae09c738afc354b0, user_id=66f3594712e04461b191709138eeb215, role_id=8daabcb6b7394e39b06a3453e33e32db)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:06:22.950965 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e88be5-3cc3-4d63-aef0-f2290cd5a1c8 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:06:22.966963 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1142/2287] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:06:22 2022] PUT /identity/v3/projects/e1c4e5bcc1cf4705ae09c738afc354b0/users/66f3594712e04461b191709138eeb215/roles/8daabcb6b7394e39b06a3453e33e32db => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:06:22.976860 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498e27dc-846a-4e01-a33a-a88974960653 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:06:22.977215 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498e27dc-846a-4e01-a33a-a88974960653 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:06:22.977477 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498e27dc-846a-4e01-a33a-a88974960653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:06:23.006042 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-498e27dc-846a-4e01-a33a-a88974960653 None None] MFA Rules not processed for user `66f3594712e04461b191709138eeb215`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:06:23.007567 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-498e27dc-846a-4e01-a33a-a88974960653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:06:23.108340 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1146/2288] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:06:22 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:06:23.121304 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e88be5-3cc3-4d63-aef0-f2290cd5a1c8 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:06:23.123273 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-f1e88be5-3cc3-4d63-aef0-f2290cd5a1c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:06:23.202261 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e88be5-3cc3-4d63-aef0-f2290cd5a1c8 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:06:23.207199 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05042f2c-2e88-424a-967d-f9d78d991c65 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e7f1ec6ad64b978f8817a5d2a73757', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:06:23.208017 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05042f2c-2e88-424a-967d-f9d78d991c65 service glance] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:06:23.208986 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05042f2c-2e88-424a-967d-f9d78d991c65 service glance] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:06:23.209396 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05042f2c-2e88-424a-967d-f9d78d991c65 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:06:23.219587 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05042f2c-2e88-424a-967d-f9d78d991c65 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:06:23.221499 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05042f2c-2e88-424a-967d-f9d78d991c65 service glance] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:06:23.234673 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1143/2289] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:06:23 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:06:29.032842 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498e27dc-846a-4e01-a33a-a88974960653 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:06:29.036092 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-498e27dc-846a-4e01-a33a-a88974960653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:06:29.115722 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498e27dc-846a-4e01-a33a-a88974960653 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:06:29.123485 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09b05cc-1ccd-4970-96b7-134ee101e9b1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6b658f1e27b4dfb96de71dc6a7e9496', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:06:29.124192 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09b05cc-1ccd-4970-96b7-134ee101e9b1 service placement] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:06:29.124621 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09b05cc-1ccd-4970-96b7-134ee101e9b1 service placement] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:06:29.124954 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09b05cc-1ccd-4970-96b7-134ee101e9b1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:06:29.127374 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-f09b05cc-1ccd-4970-96b7-134ee101e9b1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:06:29.140060 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09b05cc-1ccd-4970-96b7-134ee101e9b1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:06:29.141749 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09b05cc-1ccd-4970-96b7-134ee101e9b1 service placement] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:06:29.152349 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1147/2290] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:06:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 10:06:32.664987 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4775ce8e-9050-4866-81d6-80c10cd8186f None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:06:32.665618 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4775ce8e-9050-4866-81d6-80c10cd8186f None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:06:32.665618 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4775ce8e-9050-4866-81d6-80c10cd8186f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:06:32.686133 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-4775ce8e-9050-4866-81d6-80c10cd8186f None None] MFA Rules not processed for user `63fa6ba87a7a4827af4c5fbd4629b1c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:06:32.687388 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-4775ce8e-9050-4866-81d6-80c10cd8186f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:06:32.714124 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:06:32.745770 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1144/2291] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:06:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:06:39.147474 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=74,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:06:42.738725 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=11 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:06:49.566263 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09b05cc-1ccd-4970-96b7-134ee101e9b1 service placement] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:06:49.631865 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09b05cc-1ccd-4970-96b7-134ee101e9b1 service placement] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:06:49.636958 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3b3b7e-7fc1-494c-9b27-6b9c1418387e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:06:49.637611 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3b3b7e-7fc1-494c-9b27-6b9c1418387e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:06:49.637887 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3b3b7e-7fc1-494c-9b27-6b9c1418387e admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:06:49.638161 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3b3b7e-7fc1-494c-9b27-6b9c1418387e admin admin] PATH_INFO: `/v3/users/66f3594712e04461b191709138eeb215` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:06:49.639321 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3b3b7e-7fc1-494c-9b27-6b9c1418387e admin admin] RBAC: Authorizing `identity:delete_user(user_id=66f3594712e04461b191709138eeb215)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:06:49.641290 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3b3b7e-7fc1-494c-9b27-6b9c1418387e admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:06:49.694671 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-2f3b3b7e-7fc1-494c-9b27-6b9c1418387e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66f3594712e04461b191709138eeb215'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:06:49.703264 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-2f3b3b7e-7fc1-494c-9b27-6b9c1418387e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66f3594712e04461b191709138eeb215'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:06:49.703899 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-2f3b3b7e-7fc1-494c-9b27-6b9c1418387e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66f3594712e04461b191709138eeb215'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:06:49.704586 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-2f3b3b7e-7fc1-494c-9b27-6b9c1418387e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66f3594712e04461b191709138eeb215'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:06:49.711672 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-2f3b3b7e-7fc1-494c-9b27-6b9c1418387e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66f3594712e04461b191709138eeb215'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:06:49.728682 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1148/2292] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 10 10:06:49 2022] DELETE /identity/v3/users/66f3594712e04461b191709138eeb215 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:06:49.733187 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4338a54a-1503-417c-a5f7-58037a6a8d2c None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:06:49.733700 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4338a54a-1503-417c-a5f7-58037a6a8d2c None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:06:49.733796 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4338a54a-1503-417c-a5f7-58037a6a8d2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:06:49.752418 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-4338a54a-1503-417c-a5f7-58037a6a8d2c None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:06:49.753669 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-4338a54a-1503-417c-a5f7-58037a6a8d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:06:49.812813 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1145/2293] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:06:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:06:49.822746 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3b3b7e-7fc1-494c-9b27-6b9c1418387e admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:06:49.824200 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-2f3b3b7e-7fc1-494c-9b27-6b9c1418387e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:06:49.887524 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3b3b7e-7fc1-494c-9b27-6b9c1418387e admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:06:49.894127 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d141719-b82d-4187-b2cb-b5d57eded04a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4294c170df354fe892831281acd4ea7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:06:49.894733 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d141719-b82d-4187-b2cb-b5d57eded04a service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:06:49.895014 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d141719-b82d-4187-b2cb-b5d57eded04a service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:06:49.895287 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d141719-b82d-4187-b2cb-b5d57eded04a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:06:49.905370 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d141719-b82d-4187-b2cb-b5d57eded04a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:06:49.906812 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d141719-b82d-4187-b2cb-b5d57eded04a service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:06:49.916521 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1149/2294] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:06:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:06:50.198743 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4338a54a-1503-417c-a5f7-58037a6a8d2c None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:06:50.200190 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-4338a54a-1503-417c-a5f7-58037a6a8d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:06:50.212114 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4338a54a-1503-417c-a5f7-58037a6a8d2c None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:06:50.216769 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e9d4ff-2746-4b35-b6bb-36798a73f9f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:06:50.217423 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e9d4ff-2746-4b35-b6bb-36798a73f9f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:06:50.217696 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e9d4ff-2746-4b35-b6bb-36798a73f9f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:06:50.217960 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e9d4ff-2746-4b35-b6bb-36798a73f9f5 admin admin] PATH_INFO: `/v3/projects/e1c4e5bcc1cf4705ae09c738afc354b0` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:06:50.219090 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e9d4ff-2746-4b35-b6bb-36798a73f9f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1c4e5bcc1cf4705ae09c738afc354b0)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:06:50.220989 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e9d4ff-2746-4b35-b6bb-36798a73f9f5 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:06:50.268176 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-02e9d4ff-2746-4b35-b6bb-36798a73f9f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1c4e5bcc1cf4705ae09c738afc354b0', 'request_id': 'req-02e9d4ff-2746-4b35-b6bb-36798a73f9f5'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:06:50.273432 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-02e9d4ff-2746-4b35-b6bb-36798a73f9f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1c4e5bcc1cf4705ae09c738afc354b0', 'request_id': 'req-02e9d4ff-2746-4b35-b6bb-36798a73f9f5'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:06:50.282007 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-02e9d4ff-2746-4b35-b6bb-36798a73f9f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1c4e5bcc1cf4705ae09c738afc354b0', 'request_id': 'req-02e9d4ff-2746-4b35-b6bb-36798a73f9f5'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:06:50.293729 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-02e9d4ff-2746-4b35-b6bb-36798a73f9f5 admin admin] The token cache is being invalidate because project e1c4e5bcc1cf4705ae09c738afc354b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 10:06:50.294019 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-02e9d4ff-2746-4b35-b6bb-36798a73f9f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:06:50.294724 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-02e9d4ff-2746-4b35-b6bb-36798a73f9f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:06:50.296303 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1146/2295] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 10 10:06:50 2022] DELETE /identity/v3/projects/e1c4e5bcc1cf4705ae09c738afc354b0 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:06:59.912374 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:07:00.290574 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:07:10.921124 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf5b2e0-5652-4db7-b764-627bdf2d006b None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:07:10.921675 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf5b2e0-5652-4db7-b764-627bdf2d006b None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:07:10.921675 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf5b2e0-5652-4db7-b764-627bdf2d006b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:07:10.941915 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-0bf5b2e0-5652-4db7-b764-627bdf2d006b None None] MFA Rules not processed for user `3027050c9e124590971f3930146522d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:07:10.943110 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-0bf5b2e0-5652-4db7-b764-627bdf2d006b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:07:10.999232 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1150/2296] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:07:10 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:07:20.992047 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=25 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:07:39.870987 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ee884-0bf7-4e41-99be-0b0a54c9f90b None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:07:39.871492 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ee884-0bf7-4e41-99be-0b0a54c9f90b None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:07:39.871598 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ee884-0bf7-4e41-99be-0b0a54c9f90b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:07:39.891642 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-6b2ee884-0bf7-4e41-99be-0b0a54c9f90b None None] MFA Rules not processed for user `179709fe7d8343689f096ac0d9a333b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:07:39.892807 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-6b2ee884-0bf7-4e41-99be-0b0a54c9f90b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:07:39.950859 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1147/2297] 10.222.0.27 () {58 vars in 967 bytes} [Wed Aug 10 10:07:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:07:39.998751 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf5b2e0-5652-4db7-b764-627bdf2d006b None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:07:40.000223 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-0bf5b2e0-5652-4db7-b764-627bdf2d006b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:07:40.084305 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf5b2e0-5652-4db7-b764-627bdf2d006b None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:07:40.090546 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5c9d39-5693-4d0d-afee-14db9987cb6b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b801551d29ff4687ab8c1ce8cfa51614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:07:40.091166 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5c9d39-5693-4d0d-afee-14db9987cb6b service swift] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:07:40.091444 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5c9d39-5693-4d0d-afee-14db9987cb6b service swift] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:07:40.091715 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5c9d39-5693-4d0d-afee-14db9987cb6b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:07:40.102012 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5c9d39-5693-4d0d-afee-14db9987cb6b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:07:40.104659 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5c9d39-5693-4d0d-afee-14db9987cb6b service swift] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:07:40.117791 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1151/2298] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Aug 10 10:07:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 10:07:46.909792 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1503ade-860f-4628-afc0-4a16fbc75613 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:07:46.910371 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1503ade-860f-4628-afc0-4a16fbc75613 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:07:46.910371 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1503ade-860f-4628-afc0-4a16fbc75613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:07:46.931873 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-e1503ade-860f-4628-afc0-4a16fbc75613 None None] MFA Rules not processed for user `60fc756c67ea44ccba82a37edae56586`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:07:46.933252 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-e1503ade-860f-4628-afc0-4a16fbc75613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:07:46.998711 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1148/2299] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:07:46 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:07:47.694048 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5c9d39-5693-4d0d-afee-14db9987cb6b service swift] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:07:47.698924 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-3a5c9d39-5693-4d0d-afee-14db9987cb6b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:07:47.765426 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5c9d39-5693-4d0d-afee-14db9987cb6b service swift] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:07:47.770274 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425a1d73-a9ef-44c8-b140-00521b7f623c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:07:47.770896 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a1d73-a9ef-44c8-b140-00521b7f623c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:07:47.771173 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a1d73-a9ef-44c8-b140-00521b7f623c admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:07:47.771440 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a1d73-a9ef-44c8-b140-00521b7f623c admin admin] PATH_INFO: `/v3/users/d41372e4bfd2439291ab0a979fecc160` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:07:47.772698 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425a1d73-a9ef-44c8-b140-00521b7f623c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d41372e4bfd2439291ab0a979fecc160)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:07:47.774651 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425a1d73-a9ef-44c8-b140-00521b7f623c admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:07:47.825742 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-425a1d73-a9ef-44c8-b140-00521b7f623c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd41372e4bfd2439291ab0a979fecc160'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:07:47.834529 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-425a1d73-a9ef-44c8-b140-00521b7f623c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd41372e4bfd2439291ab0a979fecc160'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:07:47.835149 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-425a1d73-a9ef-44c8-b140-00521b7f623c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd41372e4bfd2439291ab0a979fecc160'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:07:47.835979 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-425a1d73-a9ef-44c8-b140-00521b7f623c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd41372e4bfd2439291ab0a979fecc160'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:07:47.843363 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-425a1d73-a9ef-44c8-b140-00521b7f623c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd41372e4bfd2439291ab0a979fecc160'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:07:47.863076 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1152/2300] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 10 10:07:47 2022] DELETE /identity/v3/users/d41372e4bfd2439291ab0a979fecc160 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:07:48.117295 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1503ade-860f-4628-afc0-4a16fbc75613 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:07:48.128930 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1503ade-860f-4628-afc0-4a16fbc75613 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:07:48.194472 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8511384-b713-405f-aea2-d79fa77cf5e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:07:48.195095 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8511384-b713-405f-aea2-d79fa77cf5e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:07:48.195372 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8511384-b713-405f-aea2-d79fa77cf5e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:07:48.195647 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8511384-b713-405f-aea2-d79fa77cf5e9 admin admin] PATH_INFO: `/v3/projects/d1a3ac6a9c094dcab6c151b98499ff3a` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:07:48.196775 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8511384-b713-405f-aea2-d79fa77cf5e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1a3ac6a9c094dcab6c151b98499ff3a)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:07:48.198860 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8511384-b713-405f-aea2-d79fa77cf5e9 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:07:48.246598 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-f8511384-b713-405f-aea2-d79fa77cf5e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1a3ac6a9c094dcab6c151b98499ff3a', 'request_id': 'req-f8511384-b713-405f-aea2-d79fa77cf5e9'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:07:48.248553 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:07:48.253209 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-f8511384-b713-405f-aea2-d79fa77cf5e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1a3ac6a9c094dcab6c151b98499ff3a', 'request_id': 'req-f8511384-b713-405f-aea2-d79fa77cf5e9'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:07:48.261202 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-f8511384-b713-405f-aea2-d79fa77cf5e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1a3ac6a9c094dcab6c151b98499ff3a', 'request_id': 'req-f8511384-b713-405f-aea2-d79fa77cf5e9'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:07:48.272630 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-f8511384-b713-405f-aea2-d79fa77cf5e9 admin admin] The token cache is being invalidate because project d1a3ac6a9c094dcab6c151b98499ff3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 10:07:48.273047 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-f8511384-b713-405f-aea2-d79fa77cf5e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:07:48.273702 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-f8511384-b713-405f-aea2-d79fa77cf5e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:07:48.275212 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1149/2301] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 10 10:07:48 2022] DELETE /identity/v3/projects/d1a3ac6a9c094dcab6c151b98499ff3a => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:07:48.279398 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425a1d73-a9ef-44c8-b140-00521b7f623c admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:07:48.281012 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-425a1d73-a9ef-44c8-b140-00521b7f623c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:07:48.294791 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425a1d73-a9ef-44c8-b140-00521b7f623c admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:07:48.300651 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:07:48.359837 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ab5942-61b8-4a88-a2ba-4beefdb4fd99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:07:48.360480 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ab5942-61b8-4a88-a2ba-4beefdb4fd99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:07:48.360766 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ab5942-61b8-4a88-a2ba-4beefdb4fd99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:07:48.361040 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ab5942-61b8-4a88-a2ba-4beefdb4fd99 admin admin] PATH_INFO: `/v3/users/e4de640d5e9e41d8b276e6ae941a979c` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:07:48.362208 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ab5942-61b8-4a88-a2ba-4beefdb4fd99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4de640d5e9e41d8b276e6ae941a979c)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:07:48.364134 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ab5942-61b8-4a88-a2ba-4beefdb4fd99 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:07:48.412247 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-05ab5942-61b8-4a88-a2ba-4beefdb4fd99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4de640d5e9e41d8b276e6ae941a979c'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:07:48.422198 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-05ab5942-61b8-4a88-a2ba-4beefdb4fd99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4de640d5e9e41d8b276e6ae941a979c'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:07:48.422808 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-05ab5942-61b8-4a88-a2ba-4beefdb4fd99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4de640d5e9e41d8b276e6ae941a979c'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:07:48.423401 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-05ab5942-61b8-4a88-a2ba-4beefdb4fd99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4de640d5e9e41d8b276e6ae941a979c'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:07:48.430624 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-05ab5942-61b8-4a88-a2ba-4beefdb4fd99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4de640d5e9e41d8b276e6ae941a979c'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:07:48.448684 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1153/2302] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 10 10:07:48 2022] DELETE /identity/v3/users/e4de640d5e9e41d8b276e6ae941a979c => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:07:48.788943 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8511384-b713-405f-aea2-d79fa77cf5e9 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:07:48.790432 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-f8511384-b713-405f-aea2-d79fa77cf5e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:07:48.804420 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8511384-b713-405f-aea2-d79fa77cf5e9 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:07:48.890601 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94073d98-b180-4e45-ac98-667149ca2383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:07:48.891246 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94073d98-b180-4e45-ac98-667149ca2383 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:07:48.891554 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94073d98-b180-4e45-ac98-667149ca2383 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:07:48.891798 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94073d98-b180-4e45-ac98-667149ca2383 admin admin] PATH_INFO: `/v3/projects/e32cd240966d49a7b3636a6500f63915` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:07:48.892920 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94073d98-b180-4e45-ac98-667149ca2383 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e32cd240966d49a7b3636a6500f63915)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:07:48.894988 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94073d98-b180-4e45-ac98-667149ca2383 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:07:48.944072 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-94073d98-b180-4e45-ac98-667149ca2383 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e32cd240966d49a7b3636a6500f63915', 'request_id': 'req-94073d98-b180-4e45-ac98-667149ca2383'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:07:48.950093 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-94073d98-b180-4e45-ac98-667149ca2383 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e32cd240966d49a7b3636a6500f63915', 'request_id': 'req-94073d98-b180-4e45-ac98-667149ca2383'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:07:48.959759 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-94073d98-b180-4e45-ac98-667149ca2383 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e32cd240966d49a7b3636a6500f63915', 'request_id': 'req-94073d98-b180-4e45-ac98-667149ca2383'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:07:48.972936 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-94073d98-b180-4e45-ac98-667149ca2383 admin admin] The token cache is being invalidate because project e32cd240966d49a7b3636a6500f63915 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 10:07:48.973563 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-94073d98-b180-4e45-ac98-667149ca2383 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:07:48.974375 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-94073d98-b180-4e45-ac98-667149ca2383 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:07:48.975938 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1150/2303] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 10 10:07:48 2022] DELETE /identity/v3/projects/e32cd240966d49a7b3636a6500f63915 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:07:51.745591 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d805bd-1287-437f-8e4b-7aabbc932c75 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:07:51.746094 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d805bd-1287-437f-8e4b-7aabbc932c75 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:07:51.746186 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d805bd-1287-437f-8e4b-7aabbc932c75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:07:51.765623 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-b4d805bd-1287-437f-8e4b-7aabbc932c75 None None] MFA Rules not processed for user `63fa6ba87a7a4827af4c5fbd4629b1c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:07:51.766819 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-b4d805bd-1287-437f-8e4b-7aabbc932c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:07:51.827068 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1154/2304] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:07:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:07:56.433340 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c806cd9e-29ae-4254-ae93-2780c7e8d105 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:07:56.433928 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c806cd9e-29ae-4254-ae93-2780c7e8d105 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:07:56.433928 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c806cd9e-29ae-4254-ae93-2780c7e8d105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:07:56.454415 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-c806cd9e-29ae-4254-ae93-2780c7e8d105 None None] MFA Rules not processed for user `05de322f3f174bc195a58a108c9387da`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:07:56.455680 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-c806cd9e-29ae-4254-ae93-2780c7e8d105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:07:56.512338 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1151/2305] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:07:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:08:01.817455 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=74,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:08:06.505238 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=82,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:08:10.787622 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d805bd-1287-437f-8e4b-7aabbc932c75 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:08:10.789764 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-b4d805bd-1287-437f-8e4b-7aabbc932c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:08:10.851933 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d805bd-1287-437f-8e4b-7aabbc932c75 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:08:10.855948 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f271e34-161e-40ed-ae2d-db630e6c9beb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4294c170df354fe892831281acd4ea7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:08:10.856559 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f271e34-161e-40ed-ae2d-db630e6c9beb service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:08:10.856834 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f271e34-161e-40ed-ae2d-db630e6c9beb service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:08:10.857103 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f271e34-161e-40ed-ae2d-db630e6c9beb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:08:10.858895 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-3f271e34-161e-40ed-ae2d-db630e6c9beb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:08:10.931218 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f271e34-161e-40ed-ae2d-db630e6c9beb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:08:10.932817 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f271e34-161e-40ed-ae2d-db630e6c9beb service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:08:10.946560 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1155/2306] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:08:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:08:12.143695 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c806cd9e-29ae-4254-ae93-2780c7e8d105 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:08:12.153757 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c806cd9e-29ae-4254-ae93-2780c7e8d105 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:08:12.157785 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaf9194-eb45-4890-a2bd-7dae8f1ee8e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4294c170df354fe892831281acd4ea7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:08:12.158396 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaf9194-eb45-4890-a2bd-7dae8f1ee8e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:08:12.158671 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaf9194-eb45-4890-a2bd-7dae8f1ee8e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:08:12.158938 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaf9194-eb45-4890-a2bd-7dae8f1ee8e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:08:12.161128 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-7aaf9194-eb45-4890-a2bd-7dae8f1ee8e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:08:12.176899 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaf9194-eb45-4890-a2bd-7dae8f1ee8e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:08:12.178385 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaf9194-eb45-4890-a2bd-7dae8f1ee8e5 service neutron] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:08:12.189801 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1152/2307] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:08:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:08:15.723528 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f271e34-161e-40ed-ae2d-db630e6c9beb service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:08:15.725227 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-3f271e34-161e-40ed-ae2d-db630e6c9beb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:08:15.741100 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f271e34-161e-40ed-ae2d-db630e6c9beb service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:08:15.748916 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3affbfa9-47dd-4eea-b798-1c9daeebad70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd8580888cba41a88566da4540b1130c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:08:15.749577 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3affbfa9-47dd-4eea-b798-1c9daeebad70 service nova] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:08:15.749858 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3affbfa9-47dd-4eea-b798-1c9daeebad70 service nova] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:08:15.750126 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3affbfa9-47dd-4eea-b798-1c9daeebad70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:08:15.752286 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-3affbfa9-47dd-4eea-b798-1c9daeebad70 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:08:15.818458 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3affbfa9-47dd-4eea-b798-1c9daeebad70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:08:15.820074 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3affbfa9-47dd-4eea-b798-1c9daeebad70 service nova] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:08:15.829717 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1156/2308] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:08:15 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:08:22.184846 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=6 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:08:25.825286 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=82 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:08:28.609161 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc51a37d-79d9-4262-95ab-36e8939df67f None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:08:28.609639 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc51a37d-79d9-4262-95ab-36e8939df67f None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:08:28.609764 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc51a37d-79d9-4262-95ab-36e8939df67f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:08:28.628701 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-fc51a37d-79d9-4262-95ab-36e8939df67f None None] MFA Rules not processed for user `179709fe7d8343689f096ac0d9a333b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:08:28.629908 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-fc51a37d-79d9-4262-95ab-36e8939df67f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:08:28.688283 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1153/2309] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Aug 10 10:08:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:08:28.700616 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3affbfa9-47dd-4eea-b798-1c9daeebad70 service nova] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:08:28.702029 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-3affbfa9-47dd-4eea-b798-1c9daeebad70 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:08:28.771326 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3affbfa9-47dd-4eea-b798-1c9daeebad70 service nova] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:08:28.777055 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e019680-e136-4d16-917b-f59673389841 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b801551d29ff4687ab8c1ce8cfa51614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:08:28.777748 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e019680-e136-4d16-917b-f59673389841 service swift] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:08:28.778050 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e019680-e136-4d16-917b-f59673389841 service swift] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:08:28.778315 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e019680-e136-4d16-917b-f59673389841 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:08:28.787148 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e019680-e136-4d16-917b-f59673389841 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:08:28.788799 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e019680-e136-4d16-917b-f59673389841 service swift] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:08:28.797090 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1157/2310] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Aug 10 10:08:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 10 10:08:38.438728 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc51a37d-79d9-4262-95ab-36e8939df67f None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:08:38.441328 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-fc51a37d-79d9-4262-95ab-36e8939df67f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:08:38.453912 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc51a37d-79d9-4262-95ab-36e8939df67f None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:08:38.458758 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b243f48-eb2a-40d6-963f-18b9a30e836b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4294c170df354fe892831281acd4ea7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:08:38.459392 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b243f48-eb2a-40d6-963f-18b9a30e836b service neutron] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:08:38.459665 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b243f48-eb2a-40d6-963f-18b9a30e836b service neutron] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:08:38.459953 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b243f48-eb2a-40d6-963f-18b9a30e836b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:08:38.462670 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-1b243f48-eb2a-40d6-963f-18b9a30e836b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:08:38.473569 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b243f48-eb2a-40d6-963f-18b9a30e836b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:08:38.475058 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b243f48-eb2a-40d6-963f-18b9a30e836b service neutron] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:08:38.483850 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1154/2311] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:08:38 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:08:38.793605 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=32 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:08:43.170235 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e019680-e136-4d16-917b-f59673389841 service swift] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:08:43.185856 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e019680-e136-4d16-917b-f59673389841 service swift] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:08:43.194176 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add66889-168c-4336-9655-7e2f88a789c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4294c170df354fe892831281acd4ea7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:08:43.194769 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add66889-168c-4336-9655-7e2f88a789c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:08:43.195040 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add66889-168c-4336-9655-7e2f88a789c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:08:43.195307 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add66889-168c-4336-9655-7e2f88a789c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:08:43.197568 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-add66889-168c-4336-9655-7e2f88a789c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:08:43.209883 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add66889-168c-4336-9655-7e2f88a789c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:08:43.211371 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add66889-168c-4336-9655-7e2f88a789c0 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:08:43.219704 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1158/2312] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:08:43 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:08:43.610578 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b243f48-eb2a-40d6-963f-18b9a30e836b service neutron] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:08:43.612001 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-1b243f48-eb2a-40d6-963f-18b9a30e836b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:08:43.685208 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b243f48-eb2a-40d6-963f-18b9a30e836b service neutron] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:08:43.691422 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab21fc74-933a-4c2b-9c5f-8cc2bd8963c9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6b658f1e27b4dfb96de71dc6a7e9496', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:08:43.692026 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab21fc74-933a-4c2b-9c5f-8cc2bd8963c9 service placement] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:08:43.692342 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab21fc74-933a-4c2b-9c5f-8cc2bd8963c9 service placement] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:08:43.692612 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab21fc74-933a-4c2b-9c5f-8cc2bd8963c9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:08:43.694622 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-ab21fc74-933a-4c2b-9c5f-8cc2bd8963c9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:08:43.705973 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab21fc74-933a-4c2b-9c5f-8cc2bd8963c9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:08:43.707522 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab21fc74-933a-4c2b-9c5f-8cc2bd8963c9 service placement] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:08:43.717152 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1155/2313] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:08:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:08:46.756125 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add66889-168c-4336-9655-7e2f88a789c0 service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:08:46.772989 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add66889-168c-4336-9655-7e2f88a789c0 service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:08:46.779410 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25b8787-2bc3-4347-b51d-73530e5f1620 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd8580888cba41a88566da4540b1130c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:08:46.780143 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25b8787-2bc3-4347-b51d-73530e5f1620 service nova] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:08:46.780561 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25b8787-2bc3-4347-b51d-73530e5f1620 service nova] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:08:46.780900 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25b8787-2bc3-4347-b51d-73530e5f1620 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:08:46.782875 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-e25b8787-2bc3-4347-b51d-73530e5f1620 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:08:46.796926 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25b8787-2bc3-4347-b51d-73530e5f1620 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:08:46.798664 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25b8787-2bc3-4347-b51d-73530e5f1620 service nova] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:08:46.811418 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1159/2314] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:08:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:08:47.608140 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89097e15-709f-460d-a098-f42d67f7778e None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:08:47.608673 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89097e15-709f-460d-a098-f42d67f7778e None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:08:47.608673 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89097e15-709f-460d-a098-f42d67f7778e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:08:47.628493 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-89097e15-709f-460d-a098-f42d67f7778e None None] MFA Rules not processed for user `179709fe7d8343689f096ac0d9a333b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:08:47.629703 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-89097e15-709f-460d-a098-f42d67f7778e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:08:47.637415 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1156/2315] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Aug 10 10:08:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:08:47.658781 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25b8787-2bc3-4347-b51d-73530e5f1620 service nova] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:08:47.670945 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25b8787-2bc3-4347-b51d-73530e5f1620 service nova] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:08:47.676999 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad21f39-3f49-4f62-b759-c81093a349d5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b801551d29ff4687ab8c1ce8cfa51614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:08:47.677635 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad21f39-3f49-4f62-b759-c81093a349d5 service swift] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:08:47.677914 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad21f39-3f49-4f62-b759-c81093a349d5 service swift] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:08:47.678185 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad21f39-3f49-4f62-b759-c81093a349d5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:08:47.687167 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad21f39-3f49-4f62-b759-c81093a349d5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:08:47.688750 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad21f39-3f49-4f62-b759-c81093a349d5 service swift] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:08:47.696922 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1160/2316] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Aug 10 10:08:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 10:08:49.357924 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89097e15-709f-460d-a098-f42d67f7778e None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:08:49.359415 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-89097e15-709f-460d-a098-f42d67f7778e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:08:49.375363 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89097e15-709f-460d-a098-f42d67f7778e None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:08:49.383267 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eee338e-6446-44de-adae-0e8b38e923f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd8580888cba41a88566da4540b1130c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:08:49.384174 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee338e-6446-44de-adae-0e8b38e923f4 service nova] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:08:49.384548 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee338e-6446-44de-adae-0e8b38e923f4 service nova] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:08:49.384911 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee338e-6446-44de-adae-0e8b38e923f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:08:49.386973 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-3eee338e-6446-44de-adae-0e8b38e923f4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:08:49.406340 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eee338e-6446-44de-adae-0e8b38e923f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:08:49.408251 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eee338e-6446-44de-adae-0e8b38e923f4 service nova] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:08:49.418544 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1157/2317] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:08:49 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:08:57.693529 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=18 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:08:59.413952 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=72 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:09:01.402942 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad21f39-3f49-4f62-b759-c81093a349d5 service swift] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:01.419726 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad21f39-3f49-4f62-b759-c81093a349d5 service swift] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:01.426638 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2264fd28-6f2a-4aa4-8381-9d835c70e913 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd8580888cba41a88566da4540b1130c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:01.427246 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2264fd28-6f2a-4aa4-8381-9d835c70e913 service nova] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:01.427524 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2264fd28-6f2a-4aa4-8381-9d835c70e913 service nova] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:01.427794 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2264fd28-6f2a-4aa4-8381-9d835c70e913 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:01.429693 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-2264fd28-6f2a-4aa4-8381-9d835c70e913 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:09:01.443832 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2264fd28-6f2a-4aa4-8381-9d835c70e913 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:01.445632 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2264fd28-6f2a-4aa4-8381-9d835c70e913 service nova] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:01.457153 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1161/2318] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:09:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:09:03.985527 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eee338e-6446-44de-adae-0e8b38e923f4 service nova] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:04.002103 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eee338e-6446-44de-adae-0e8b38e923f4 service nova] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:04.010703 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae75943-73b8-462c-89c4-cfa383db5cec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd8580888cba41a88566da4540b1130c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:04.011586 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae75943-73b8-462c-89c4-cfa383db5cec service nova] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:04.012078 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae75943-73b8-462c-89c4-cfa383db5cec service nova] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:04.012587 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae75943-73b8-462c-89c4-cfa383db5cec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:04.014985 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-6ae75943-73b8-462c-89c4-cfa383db5cec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:09:04.031281 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae75943-73b8-462c-89c4-cfa383db5cec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:04.033388 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae75943-73b8-462c-89c4-cfa383db5cec service nova] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:04.048548 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1158/2319] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:09:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:09:05.921690 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2264fd28-6f2a-4aa4-8381-9d835c70e913 service nova] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:05.923229 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-2264fd28-6f2a-4aa4-8381-9d835c70e913 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:09:06.001692 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2264fd28-6f2a-4aa4-8381-9d835c70e913 service nova] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:06.007425 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd2fd6b-1407-4a0b-9fa6-d791160e8fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:06.008178 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd2fd6b-1407-4a0b-9fa6-d791160e8fe8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:06.008451 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd2fd6b-1407-4a0b-9fa6-d791160e8fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:06.008776 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd2fd6b-1407-4a0b-9fa6-d791160e8fe8 admin admin] PATH_INFO: `/v3/users/60fc756c67ea44ccba82a37edae56586` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:06.009944 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd2fd6b-1407-4a0b-9fa6-d791160e8fe8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60fc756c67ea44ccba82a37edae56586)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:06.011958 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd2fd6b-1407-4a0b-9fa6-d791160e8fe8 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:06.061443 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-0fd2fd6b-1407-4a0b-9fa6-d791160e8fe8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60fc756c67ea44ccba82a37edae56586'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:06.070725 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-0fd2fd6b-1407-4a0b-9fa6-d791160e8fe8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60fc756c67ea44ccba82a37edae56586'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:06.071349 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-0fd2fd6b-1407-4a0b-9fa6-d791160e8fe8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60fc756c67ea44ccba82a37edae56586'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:06.072016 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-0fd2fd6b-1407-4a0b-9fa6-d791160e8fe8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60fc756c67ea44ccba82a37edae56586'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:06.079053 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-0fd2fd6b-1407-4a0b-9fa6-d791160e8fe8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60fc756c67ea44ccba82a37edae56586'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:06.095998 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1162/2320] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 10 10:09:05 2022] DELETE /identity/v3/users/60fc756c67ea44ccba82a37edae56586 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:09:06.277820 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae75943-73b8-462c-89c4-cfa383db5cec service nova] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:06.288747 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae75943-73b8-462c-89c4-cfa383db5cec service nova] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:06.346631 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7071cc8a-73bd-47a9-956a-77f633fab9e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:06.347264 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7071cc8a-73bd-47a9-956a-77f633fab9e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:06.347539 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7071cc8a-73bd-47a9-956a-77f633fab9e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:06.347809 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7071cc8a-73bd-47a9-956a-77f633fab9e8 admin admin] PATH_INFO: `/v3/projects/884ebbe7226a46a5becc3dcbef80b3a4` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:06.349103 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7071cc8a-73bd-47a9-956a-77f633fab9e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=884ebbe7226a46a5becc3dcbef80b3a4)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:06.351069 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7071cc8a-73bd-47a9-956a-77f633fab9e8 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:06.400018 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-7071cc8a-73bd-47a9-956a-77f633fab9e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '884ebbe7226a46a5becc3dcbef80b3a4', 'request_id': 'req-7071cc8a-73bd-47a9-956a-77f633fab9e8'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:06.405571 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-7071cc8a-73bd-47a9-956a-77f633fab9e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '884ebbe7226a46a5becc3dcbef80b3a4', 'request_id': 'req-7071cc8a-73bd-47a9-956a-77f633fab9e8'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:06.414683 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-7071cc8a-73bd-47a9-956a-77f633fab9e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '884ebbe7226a46a5becc3dcbef80b3a4', 'request_id': 'req-7071cc8a-73bd-47a9-956a-77f633fab9e8'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:06.427791 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-7071cc8a-73bd-47a9-956a-77f633fab9e8 admin admin] The token cache is being invalidate because project 884ebbe7226a46a5becc3dcbef80b3a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 10:09:06.428106 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-7071cc8a-73bd-47a9-956a-77f633fab9e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:06.428790 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-7071cc8a-73bd-47a9-956a-77f633fab9e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:06.430377 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1159/2321] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 10 10:09:06 2022] DELETE /identity/v3/projects/884ebbe7226a46a5becc3dcbef80b3a4 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:09:06.435430 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2234c8-e822-4cf8-9277-76cdf663fea7 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:06.435721 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2234c8-e822-4cf8-9277-76cdf663fea7 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:06.436001 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2234c8-e822-4cf8-9277-76cdf663fea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:06.456806 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-1a2234c8-e822-4cf8-9277-76cdf663fea7 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:09:06.458075 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-1a2234c8-e822-4cf8-9277-76cdf663fea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:09:06.519126 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1163/2322] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:09:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 10:09:06.528029 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9eb11c-5322-4d38-9e1a-96adb99bf810 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:06.528355 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9eb11c-5322-4d38-9e1a-96adb99bf810 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:06.528724 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9eb11c-5322-4d38-9e1a-96adb99bf810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:06.550955 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-fa9eb11c-5322-4d38-9e1a-96adb99bf810 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:09:06.552161 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-fa9eb11c-5322-4d38-9e1a-96adb99bf810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:09:06.560950 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1160/2323] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:09:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:09:06.565673 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2234c8-e822-4cf8-9277-76cdf663fea7 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:06.576164 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2234c8-e822-4cf8-9277-76cdf663fea7 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:06.581386 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ff50d4-f35d-42ee-b26c-2445c67b2ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:06.581998 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ff50d4-f35d-42ee-b26c-2445c67b2ad4 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:06.582276 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ff50d4-f35d-42ee-b26c-2445c67b2ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:06.582568 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ff50d4-f35d-42ee-b26c-2445c67b2ad4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:06.583232 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ff50d4-f35d-42ee-b26c-2445c67b2ad4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:09:06.583538 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ff50d4-f35d-42ee-b26c-2445c67b2ad4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:06.585172 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ff50d4-f35d-42ee-b26c-2445c67b2ad4 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:06.586714 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:09:06.598595 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1164/2324] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 10 10:09:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 10:09:06.602332 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9eb11c-5322-4d38-9e1a-96adb99bf810 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:06.611817 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9eb11c-5322-4d38-9e1a-96adb99bf810 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:06.617223 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8b4d56-d151-413e-b0a1-78a1e048ac43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:06.617820 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8b4d56-d151-413e-b0a1-78a1e048ac43 admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:06.618101 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8b4d56-d151-413e-b0a1-78a1e048ac43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:06.618364 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8b4d56-d151-413e-b0a1-78a1e048ac43 admin admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:06.619001 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8b4d56-d151-413e-b0a1-78a1e048ac43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:06.620905 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8b4d56-d151-413e-b0a1-78a1e048ac43 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:06.650899 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1161/2325] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 10 10:09:06 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:09:06.655326 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ff50d4-f35d-42ee-b26c-2445c67b2ad4 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:06.665741 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ff50d4-f35d-42ee-b26c-2445c67b2ad4 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:06.723517 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfa0143-dd2d-4424-9df5-628f95ce7552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:06.724153 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfa0143-dd2d-4424-9df5-628f95ce7552 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:06.724427 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfa0143-dd2d-4424-9df5-628f95ce7552 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:06.724700 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfa0143-dd2d-4424-9df5-628f95ce7552 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:06.725364 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfa0143-dd2d-4424-9df5-628f95ce7552 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:06.727289 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfa0143-dd2d-4424-9df5-628f95ce7552 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:06.753032 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1165/2326] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 10 10:09:06 2022] POST /identity/v3/users => generated 292 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 10:09:06.754412 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8b4d56-d151-413e-b0a1-78a1e048ac43 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:06.765316 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8b4d56-d151-413e-b0a1-78a1e048ac43 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:06.770545 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2d5611-950a-45fb-b8a9-89d2d17ab07b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:06.771236 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2d5611-950a-45fb-b8a9-89d2d17ab07b admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:06.771519 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2d5611-950a-45fb-b8a9-89d2d17ab07b admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:06.771784 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2d5611-950a-45fb-b8a9-89d2d17ab07b admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:06.772448 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2d5611-950a-45fb-b8a9-89d2d17ab07b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:06.774148 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2d5611-950a-45fb-b8a9-89d2d17ab07b admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:06.785890 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1162/2327] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:09:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:09:06.790186 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfa0143-dd2d-4424-9df5-628f95ce7552 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:06.802036 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfa0143-dd2d-4424-9df5-628f95ce7552 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:06.807656 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35d2e49-4153-4636-ba9b-4152b9a34660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:06.808704 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35d2e49-4153-4636-ba9b-4152b9a34660 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:06.808991 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35d2e49-4153-4636-ba9b-4152b9a34660 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:06.809290 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35d2e49-4153-4636-ba9b-4152b9a34660 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:06.809942 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35d2e49-4153-4636-ba9b-4152b9a34660 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:06.811803 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35d2e49-4153-4636-ba9b-4152b9a34660 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:06.824446 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1166/2328] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:09:06 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 10:09:06.831504 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2d5611-950a-45fb-b8a9-89d2d17ab07b admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:06.845444 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2d5611-950a-45fb-b8a9-89d2d17ab07b admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:06.850513 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4225a77-9f6e-405c-822b-c5ba7f306629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:06.851164 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4225a77-9f6e-405c-822b-c5ba7f306629 admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:06.851441 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4225a77-9f6e-405c-822b-c5ba7f306629 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:06.851714 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4225a77-9f6e-405c-822b-c5ba7f306629 admin admin] PATH_INFO: `/v3/projects/5a0f32c4b5f242749da85e1af12d3151/users/4f2c93ff521641b8bbc165e90b5f8ffa/roles/8daabcb6b7394e39b06a3453e33e32db` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:06.866715 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4225a77-9f6e-405c-822b-c5ba7f306629 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a0f32c4b5f242749da85e1af12d3151, user_id=4f2c93ff521641b8bbc165e90b5f8ffa, role_id=8daabcb6b7394e39b06a3453e33e32db)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:06.869396 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4225a77-9f6e-405c-822b-c5ba7f306629 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:06.884391 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1163/2329] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:09:06 2022] PUT /identity/v3/projects/5a0f32c4b5f242749da85e1af12d3151/users/4f2c93ff521641b8bbc165e90b5f8ffa/roles/8daabcb6b7394e39b06a3453e33e32db => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:09:06.895982 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f861a23e-a9ce-4876-a5dc-b74c20d257e0 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:06.896399 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f861a23e-a9ce-4876-a5dc-b74c20d257e0 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:06.896673 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f861a23e-a9ce-4876-a5dc-b74c20d257e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:06.925902 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-f861a23e-a9ce-4876-a5dc-b74c20d257e0 None None] MFA Rules not processed for user `4f2c93ff521641b8bbc165e90b5f8ffa`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:09:06.927032 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-f861a23e-a9ce-4876-a5dc-b74c20d257e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:09:06.992942 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1167/2330] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:09:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:09:06.997845 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4225a77-9f6e-405c-822b-c5ba7f306629 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:07.011812 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:09:07.061354 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4225a77-9f6e-405c-822b-c5ba7f306629 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:07.067609 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c956110-3f11-4370-9f21-0388b0aeeeb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:07.068230 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c956110-3f11-4370-9f21-0388b0aeeeb3 admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:07.068503 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c956110-3f11-4370-9f21-0388b0aeeeb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:07.068767 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c956110-3f11-4370-9f21-0388b0aeeeb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:07.069590 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c956110-3f11-4370-9f21-0388b0aeeeb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:07.071505 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c956110-3f11-4370-9f21-0388b0aeeeb3 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:07.100039 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1164/2331] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 10 10:09:06 2022] POST /identity/v3/projects => generated 383 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:09:07.104374 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f861a23e-a9ce-4876-a5dc-b74c20d257e0 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:07.115589 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f861a23e-a9ce-4876-a5dc-b74c20d257e0 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:07.178717 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31731588-c1c7-4fa2-9038-2d96209d4215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:07.179466 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31731588-c1c7-4fa2-9038-2d96209d4215 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:07.179833 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31731588-c1c7-4fa2-9038-2d96209d4215 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:07.180342 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31731588-c1c7-4fa2-9038-2d96209d4215 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:07.181260 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31731588-c1c7-4fa2-9038-2d96209d4215 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:07.183664 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31731588-c1c7-4fa2-9038-2d96209d4215 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:07.193870 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:09:07.211937 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1168/2332] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 10 10:09:07 2022] POST /identity/v3/users => generated 298 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:09:07.216289 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c956110-3f11-4370-9f21-0388b0aeeeb3 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:07.227260 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c956110-3f11-4370-9f21-0388b0aeeeb3 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:07.232559 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66772bbb-cb45-404e-aa1e-e88ec8c2515a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:07.233315 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66772bbb-cb45-404e-aa1e-e88ec8c2515a admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:07.233631 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66772bbb-cb45-404e-aa1e-e88ec8c2515a admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:07.233971 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66772bbb-cb45-404e-aa1e-e88ec8c2515a admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:07.234693 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66772bbb-cb45-404e-aa1e-e88ec8c2515a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:07.236394 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66772bbb-cb45-404e-aa1e-e88ec8c2515a admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:07.248141 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1165/2333] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:09:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:09:07.252609 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31731588-c1c7-4fa2-9038-2d96209d4215 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:07.262958 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31731588-c1c7-4fa2-9038-2d96209d4215 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:07.267717 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cb4dc1-5b2f-43a2-adcf-890a4408e429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:07.268359 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cb4dc1-5b2f-43a2-adcf-890a4408e429 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:07.268636 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cb4dc1-5b2f-43a2-adcf-890a4408e429 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:07.268904 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cb4dc1-5b2f-43a2-adcf-890a4408e429 admin admin] PATH_INFO: `/v3/projects/5b80e5e0413344de9f2880524d450351/users/a8c858f2c4214d10902266aab8220811/roles/eb04edc46b3742d7a0f0ead26f68bc22` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:07.284120 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cb4dc1-5b2f-43a2-adcf-890a4408e429 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b80e5e0413344de9f2880524d450351, user_id=a8c858f2c4214d10902266aab8220811, role_id=eb04edc46b3742d7a0f0ead26f68bc22)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:07.286821 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cb4dc1-5b2f-43a2-adcf-890a4408e429 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:07.302727 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1169/2334] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:09:07 2022] PUT /identity/v3/projects/5b80e5e0413344de9f2880524d450351/users/a8c858f2c4214d10902266aab8220811/roles/eb04edc46b3742d7a0f0ead26f68bc22 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:09:07.306781 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66772bbb-cb45-404e-aa1e-e88ec8c2515a admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:07.316771 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66772bbb-cb45-404e-aa1e-e88ec8c2515a admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:07.377209 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3376a926-eddf-4b03-843f-15b15b702fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:07.377818 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3376a926-eddf-4b03-843f-15b15b702fb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:07.378101 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3376a926-eddf-4b03-843f-15b15b702fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:07.378375 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3376a926-eddf-4b03-843f-15b15b702fb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:07.379014 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3376a926-eddf-4b03-843f-15b15b702fb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:07.380623 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3376a926-eddf-4b03-843f-15b15b702fb6 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:07.390549 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1166/2335] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:09:07 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 10:09:07.394860 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cb4dc1-5b2f-43a2-adcf-890a4408e429 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:07.405584 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cb4dc1-5b2f-43a2-adcf-890a4408e429 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:07.410423 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1408f7b-e4ce-4684-a600-bb2483cd8762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:07.411072 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1408f7b-e4ce-4684-a600-bb2483cd8762 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:07.411351 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1408f7b-e4ce-4684-a600-bb2483cd8762 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:07.411627 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1408f7b-e4ce-4684-a600-bb2483cd8762 admin admin] PATH_INFO: `/v3/projects/5b80e5e0413344de9f2880524d450351/users/a8c858f2c4214d10902266aab8220811/roles/eb04edc46b3742d7a0f0ead26f68bc22` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:07.413671 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1408f7b-e4ce-4684-a600-bb2483cd8762 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b80e5e0413344de9f2880524d450351, user_id=a8c858f2c4214d10902266aab8220811, role_id=eb04edc46b3742d7a0f0ead26f68bc22)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:07.416298 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1408f7b-e4ce-4684-a600-bb2483cd8762 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:07.427460 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1170/2336] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:09:07 2022] PUT /identity/v3/projects/5b80e5e0413344de9f2880524d450351/users/a8c858f2c4214d10902266aab8220811/roles/eb04edc46b3742d7a0f0ead26f68bc22 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 10:09:07.437974 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c33d091-dba4-49fa-84f0-bbc90064ff82 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:07.438169 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c33d091-dba4-49fa-84f0-bbc90064ff82 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:07.438477 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c33d091-dba4-49fa-84f0-bbc90064ff82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:07.466231 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-4c33d091-dba4-49fa-84f0-bbc90064ff82 None None] MFA Rules not processed for user `a8c858f2c4214d10902266aab8220811`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:09:07.467440 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-4c33d091-dba4-49fa-84f0-bbc90064ff82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:09:07.543872 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1167/2337] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:09:07 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:09:07.555781 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1408f7b-e4ce-4684-a600-bb2483cd8762 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:07.557930 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-c1408f7b-e4ce-4684-a600-bb2483cd8762 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:09:07.620678 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1408f7b-e4ce-4684-a600-bb2483cd8762 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:07.625513 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d3712d-fc28-48b4-9dcd-ec89a5a973cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf8e725cbe0403d943b136235eac057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:07.626142 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d3712d-fc28-48b4-9dcd-ec89a5a973cb service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:07.626422 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d3712d-fc28-48b4-9dcd-ec89a5a973cb service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:07.626690 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d3712d-fc28-48b4-9dcd-ec89a5a973cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:07.636478 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d3712d-fc28-48b4-9dcd-ec89a5a973cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:07.637955 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d3712d-fc28-48b4-9dcd-ec89a5a973cb service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:07.647764 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1171/2338] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:09:07 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:09:07.717039 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2402fd54-30a8-41b3-b68c-084bafd759bd None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:07.717372 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2402fd54-30a8-41b3-b68c-084bafd759bd None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:07.717633 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2402fd54-30a8-41b3-b68c-084bafd759bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:07.745196 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-2402fd54-30a8-41b3-b68c-084bafd759bd None None] MFA Rules not processed for user `179709fe7d8343689f096ac0d9a333b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:09:07.745196 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-2402fd54-30a8-41b3-b68c-084bafd759bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:09:07.747868 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:09:07.755775 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d3712d-fc28-48b4-9dcd-ec89a5a973cb service cinder] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:07.765263 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d3712d-fc28-48b4-9dcd-ec89a5a973cb service cinder] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:07.770103 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35503afc-819e-4ec5-9d36-def466e2a959 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf8e725cbe0403d943b136235eac057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:07.770709 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35503afc-819e-4ec5-9d36-def466e2a959 service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:07.770984 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35503afc-819e-4ec5-9d36-def466e2a959 service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:07.771250 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35503afc-819e-4ec5-9d36-def466e2a959 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:07.809730 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1168/2339] 10.222.0.27 () {58 vars in 967 bytes} [Wed Aug 10 10:09:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:09:07.833856 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2402fd54-30a8-41b3-b68c-084bafd759bd None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:07.835871 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-2402fd54-30a8-41b3-b68c-084bafd759bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:09:07.843414 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35503afc-819e-4ec5-9d36-def466e2a959 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:07.845699 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35503afc-819e-4ec5-9d36-def466e2a959 service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:07.859002 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1172/2340] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:09:07 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:09:07.937927 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2402fd54-30a8-41b3-b68c-084bafd759bd None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:07.943859 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d4f1ed-8756-4dc0-b53c-ca8709bd9dae service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b801551d29ff4687ab8c1ce8cfa51614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:07.944467 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d4f1ed-8756-4dc0-b53c-ca8709bd9dae service swift] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:07.944742 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d4f1ed-8756-4dc0-b53c-ca8709bd9dae service swift] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:07.945007 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d4f1ed-8756-4dc0-b53c-ca8709bd9dae service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:07.953935 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d4f1ed-8756-4dc0-b53c-ca8709bd9dae service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:07.955519 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d4f1ed-8756-4dc0-b53c-ca8709bd9dae service swift] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:07.964618 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1169/2341] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Aug 10 10:09:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 10 10:09:10.535393 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35503afc-819e-4ec5-9d36-def466e2a959 service cinder] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:10.598159 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:09:10.605333 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35503afc-819e-4ec5-9d36-def466e2a959 service cinder] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:10.610977 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb444ab-a07b-4cce-854d-a9767af2b777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:10.611616 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb444ab-a07b-4cce-854d-a9767af2b777 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:10.611894 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb444ab-a07b-4cce-854d-a9767af2b777 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:10.612194 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb444ab-a07b-4cce-854d-a9767af2b777 admin admin] PATH_INFO: `/v3/users/4f2c93ff521641b8bbc165e90b5f8ffa` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:10.613535 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb444ab-a07b-4cce-854d-a9767af2b777 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f2c93ff521641b8bbc165e90b5f8ffa)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:10.615658 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb444ab-a07b-4cce-854d-a9767af2b777 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:10.665502 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-8bb444ab-a07b-4cce-854d-a9767af2b777 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f2c93ff521641b8bbc165e90b5f8ffa'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:10.673551 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-8bb444ab-a07b-4cce-854d-a9767af2b777 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f2c93ff521641b8bbc165e90b5f8ffa'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:10.674866 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-8bb444ab-a07b-4cce-854d-a9767af2b777 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f2c93ff521641b8bbc165e90b5f8ffa'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:10.675606 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-8bb444ab-a07b-4cce-854d-a9767af2b777 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f2c93ff521641b8bbc165e90b5f8ffa'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:10.683437 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-8bb444ab-a07b-4cce-854d-a9767af2b777 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f2c93ff521641b8bbc165e90b5f8ffa'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:10.701344 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1173/2342] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 10 10:09:10 2022] DELETE /identity/v3/users/4f2c93ff521641b8bbc165e90b5f8ffa => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:09:10.706025 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74c2b1d-23ff-4a82-92eb-5bb17d41f704 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:10.706507 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74c2b1d-23ff-4a82-92eb-5bb17d41f704 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:10.706629 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74c2b1d-23ff-4a82-92eb-5bb17d41f704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:10.726030 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-f74c2b1d-23ff-4a82-92eb-5bb17d41f704 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:09:10.727240 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-f74c2b1d-23ff-4a82-92eb-5bb17d41f704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:09:10.789374 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1170/2343] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:09:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:09:10.799743 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb444ab-a07b-4cce-854d-a9767af2b777 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:10.801359 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-8bb444ab-a07b-4cce-854d-a9767af2b777 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:09:10.862195 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb444ab-a07b-4cce-854d-a9767af2b777 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:10.866576 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc01de2f-c75a-4ffb-97fa-9087ac1ff740 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4294c170df354fe892831281acd4ea7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:10.867156 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc01de2f-c75a-4ffb-97fa-9087ac1ff740 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:10.867440 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc01de2f-c75a-4ffb-97fa-9087ac1ff740 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:10.867718 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc01de2f-c75a-4ffb-97fa-9087ac1ff740 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:10.877360 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc01de2f-c75a-4ffb-97fa-9087ac1ff740 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:10.878787 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc01de2f-c75a-4ffb-97fa-9087ac1ff740 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:10.888377 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1174/2344] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:09:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:09:11.160452 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74c2b1d-23ff-4a82-92eb-5bb17d41f704 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:11.162180 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-f74c2b1d-23ff-4a82-92eb-5bb17d41f704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:09:11.175864 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74c2b1d-23ff-4a82-92eb-5bb17d41f704 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:11.180813 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290041df-a172-4149-aa6c-47672538fe8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:11.181501 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290041df-a172-4149-aa6c-47672538fe8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:11.181786 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290041df-a172-4149-aa6c-47672538fe8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:11.182057 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290041df-a172-4149-aa6c-47672538fe8e admin admin] PATH_INFO: `/v3/projects/5a0f32c4b5f242749da85e1af12d3151` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:11.183207 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290041df-a172-4149-aa6c-47672538fe8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a0f32c4b5f242749da85e1af12d3151)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:11.185170 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290041df-a172-4149-aa6c-47672538fe8e admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:11.226582 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:09:11.234356 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-290041df-a172-4149-aa6c-47672538fe8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a0f32c4b5f242749da85e1af12d3151', 'request_id': 'req-290041df-a172-4149-aa6c-47672538fe8e'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:11.239992 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-290041df-a172-4149-aa6c-47672538fe8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a0f32c4b5f242749da85e1af12d3151', 'request_id': 'req-290041df-a172-4149-aa6c-47672538fe8e'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:11.248514 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-290041df-a172-4149-aa6c-47672538fe8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a0f32c4b5f242749da85e1af12d3151', 'request_id': 'req-290041df-a172-4149-aa6c-47672538fe8e'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:11.260133 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-290041df-a172-4149-aa6c-47672538fe8e admin admin] The token cache is being invalidate because project 5a0f32c4b5f242749da85e1af12d3151 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 10:09:11.260423 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-290041df-a172-4149-aa6c-47672538fe8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:11.261089 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-290041df-a172-4149-aa6c-47672538fe8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:11.262696 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1171/2345] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 10 10:09:11 2022] DELETE /identity/v3/projects/5a0f32c4b5f242749da85e1af12d3151 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:09:11.266937 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc01de2f-c75a-4ffb-97fa-9087ac1ff740 service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:11.278143 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc01de2f-c75a-4ffb-97fa-9087ac1ff740 service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:11.336057 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05121dfc-8a26-402e-a6f5-3f0ba8d99d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:11.336709 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05121dfc-8a26-402e-a6f5-3f0ba8d99d96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:11.336989 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05121dfc-8a26-402e-a6f5-3f0ba8d99d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:11.337296 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05121dfc-8a26-402e-a6f5-3f0ba8d99d96 admin admin] PATH_INFO: `/v3/users/a8c858f2c4214d10902266aab8220811` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:11.338535 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05121dfc-8a26-402e-a6f5-3f0ba8d99d96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8c858f2c4214d10902266aab8220811)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:11.340531 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05121dfc-8a26-402e-a6f5-3f0ba8d99d96 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:11.362683 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:09:11.391123 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-05121dfc-8a26-402e-a6f5-3f0ba8d99d96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8c858f2c4214d10902266aab8220811'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:11.401330 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-05121dfc-8a26-402e-a6f5-3f0ba8d99d96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8c858f2c4214d10902266aab8220811'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:11.401973 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-05121dfc-8a26-402e-a6f5-3f0ba8d99d96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8c858f2c4214d10902266aab8220811'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:11.402560 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-05121dfc-8a26-402e-a6f5-3f0ba8d99d96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8c858f2c4214d10902266aab8220811'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:11.409748 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-05121dfc-8a26-402e-a6f5-3f0ba8d99d96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8c858f2c4214d10902266aab8220811'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:11.427284 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1175/2346] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 10 10:09:11 2022] DELETE /identity/v3/users/a8c858f2c4214d10902266aab8220811 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:09:11.731343 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290041df-a172-4149-aa6c-47672538fe8e admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:11.733593 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-290041df-a172-4149-aa6c-47672538fe8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:09:11.753534 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290041df-a172-4149-aa6c-47672538fe8e admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:11.838278 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291df02a-076b-42a5-9642-4b8997c03a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:11.839183 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291df02a-076b-42a5-9642-4b8997c03a07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:11.840487 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291df02a-076b-42a5-9642-4b8997c03a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:11.840487 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291df02a-076b-42a5-9642-4b8997c03a07 admin admin] PATH_INFO: `/v3/projects/5b80e5e0413344de9f2880524d450351` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:11.841939 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291df02a-076b-42a5-9642-4b8997c03a07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b80e5e0413344de9f2880524d450351)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:11.843648 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291df02a-076b-42a5-9642-4b8997c03a07 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:11.900377 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-291df02a-076b-42a5-9642-4b8997c03a07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b80e5e0413344de9f2880524d450351', 'request_id': 'req-291df02a-076b-42a5-9642-4b8997c03a07'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:11.906505 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-291df02a-076b-42a5-9642-4b8997c03a07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b80e5e0413344de9f2880524d450351', 'request_id': 'req-291df02a-076b-42a5-9642-4b8997c03a07'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:11.914574 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-291df02a-076b-42a5-9642-4b8997c03a07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b80e5e0413344de9f2880524d450351', 'request_id': 'req-291df02a-076b-42a5-9642-4b8997c03a07'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:11.927550 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-291df02a-076b-42a5-9642-4b8997c03a07 admin admin] The token cache is being invalidate because project 5b80e5e0413344de9f2880524d450351 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 10:09:11.927785 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-291df02a-076b-42a5-9642-4b8997c03a07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:11.928498 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-291df02a-076b-42a5-9642-4b8997c03a07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:11.930094 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1172/2347] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 10 10:09:11 2022] DELETE /identity/v3/projects/5b80e5e0413344de9f2880524d450351 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:09:11.935551 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b449c0-a8bd-4d3d-a035-aaed795b7c15 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:11.936069 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b449c0-a8bd-4d3d-a035-aaed795b7c15 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:11.936069 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b449c0-a8bd-4d3d-a035-aaed795b7c15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:11.955775 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-90b449c0-a8bd-4d3d-a035-aaed795b7c15 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:09:11.956983 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-90b449c0-a8bd-4d3d-a035-aaed795b7c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:09:12.024410 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1176/2348] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:09:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 10:09:12.032625 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da75a191-193a-4b25-9f10-5bea09138bad None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:12.032912 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da75a191-193a-4b25-9f10-5bea09138bad None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:12.033221 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da75a191-193a-4b25-9f10-5bea09138bad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:12.054913 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-da75a191-193a-4b25-9f10-5bea09138bad None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:09:12.056130 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-da75a191-193a-4b25-9f10-5bea09138bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:09:12.065643 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1173/2349] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:09:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:09:12.070492 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b449c0-a8bd-4d3d-a035-aaed795b7c15 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:12.084872 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b449c0-a8bd-4d3d-a035-aaed795b7c15 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:12.091899 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a3188f-a658-414d-868d-d29be7afe381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:12.092492 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a3188f-a658-414d-868d-d29be7afe381 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:12.092764 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a3188f-a658-414d-868d-d29be7afe381 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:12.093037 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a3188f-a658-414d-868d-d29be7afe381 admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:12.093712 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a3188f-a658-414d-868d-d29be7afe381 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:09:12.094016 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a3188f-a658-414d-868d-d29be7afe381 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:12.095619 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a3188f-a658-414d-868d-d29be7afe381 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:12.107228 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1177/2350] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 10 10:09:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:09:12.111673 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da75a191-193a-4b25-9f10-5bea09138bad None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:12.121507 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da75a191-193a-4b25-9f10-5bea09138bad None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:12.127534 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42642f99-7198-4d65-ba9a-9cfbb866a852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:12.128121 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42642f99-7198-4d65-ba9a-9cfbb866a852 admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:12.128398 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42642f99-7198-4d65-ba9a-9cfbb866a852 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:12.128656 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42642f99-7198-4d65-ba9a-9cfbb866a852 admin admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:12.129315 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42642f99-7198-4d65-ba9a-9cfbb866a852 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:12.131244 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42642f99-7198-4d65-ba9a-9cfbb866a852 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:12.161241 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1174/2351] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 10 10:09:12 2022] POST /identity/v3/projects => generated 387 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:09:12.167565 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a3188f-a658-414d-868d-d29be7afe381 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:12.183334 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a3188f-a658-414d-868d-d29be7afe381 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:12.249353 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282eb19e-798e-4242-b4fe-9f3b604d02f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:12.249970 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282eb19e-798e-4242-b4fe-9f3b604d02f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:12.250248 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282eb19e-798e-4242-b4fe-9f3b604d02f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:12.250516 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282eb19e-798e-4242-b4fe-9f3b604d02f0 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:12.251143 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282eb19e-798e-4242-b4fe-9f3b604d02f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:12.253095 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282eb19e-798e-4242-b4fe-9f3b604d02f0 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:12.276998 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1178/2352] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 10 10:09:12 2022] POST /identity/v3/users => generated 294 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:09:12.281419 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42642f99-7198-4d65-ba9a-9cfbb866a852 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:12.291997 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42642f99-7198-4d65-ba9a-9cfbb866a852 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:12.296934 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9043d0-ee32-4c08-99f9-fba0deba671a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:12.297577 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9043d0-ee32-4c08-99f9-fba0deba671a admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:12.297839 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9043d0-ee32-4c08-99f9-fba0deba671a admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:12.298107 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9043d0-ee32-4c08-99f9-fba0deba671a admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:12.298748 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9043d0-ee32-4c08-99f9-fba0deba671a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:12.300705 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9043d0-ee32-4c08-99f9-fba0deba671a admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:12.310694 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1175/2353] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:09:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:09:12.314577 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282eb19e-798e-4242-b4fe-9f3b604d02f0 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:12.324386 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282eb19e-798e-4242-b4fe-9f3b604d02f0 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:12.329453 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9357446-a0c4-4a9f-a8c1-f91b096a25ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:12.330038 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9357446-a0c4-4a9f-a8c1-f91b096a25ff admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:12.330316 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9357446-a0c4-4a9f-a8c1-f91b096a25ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:12.330585 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9357446-a0c4-4a9f-a8c1-f91b096a25ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:12.331228 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9357446-a0c4-4a9f-a8c1-f91b096a25ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:12.332843 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9357446-a0c4-4a9f-a8c1-f91b096a25ff admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:12.343198 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1179/2354] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:09:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:09:12.348875 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9043d0-ee32-4c08-99f9-fba0deba671a admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:12.358931 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9043d0-ee32-4c08-99f9-fba0deba671a admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:12.364126 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61698a4a-4115-4b78-bfeb-0977799b14b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:12.364762 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61698a4a-4115-4b78-bfeb-0977799b14b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:12.365039 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61698a4a-4115-4b78-bfeb-0977799b14b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:12.365341 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61698a4a-4115-4b78-bfeb-0977799b14b6 admin admin] PATH_INFO: `/v3/projects/8da27048d488487ca93f3c2f2249c7f3/users/a801d613b4d44a789553e2ba57c17cce/roles/8daabcb6b7394e39b06a3453e33e32db` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:12.380349 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61698a4a-4115-4b78-bfeb-0977799b14b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8da27048d488487ca93f3c2f2249c7f3, user_id=a801d613b4d44a789553e2ba57c17cce, role_id=8daabcb6b7394e39b06a3453e33e32db)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:12.383027 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61698a4a-4115-4b78-bfeb-0977799b14b6 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:12.385245 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:09:12.399027 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1176/2355] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:09:12 2022] PUT /identity/v3/projects/8da27048d488487ca93f3c2f2249c7f3/users/a801d613b4d44a789553e2ba57c17cce/roles/8daabcb6b7394e39b06a3453e33e32db => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:09:12.410786 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e9a252-738a-4d23-bd31-7dd545d5d9c8 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:12.411073 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e9a252-738a-4d23-bd31-7dd545d5d9c8 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:12.411348 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e9a252-738a-4d23-bd31-7dd545d5d9c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:12.419091 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:09:12.442683 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-d1e9a252-738a-4d23-bd31-7dd545d5d9c8 None None] MFA Rules not processed for user `a801d613b4d44a789553e2ba57c17cce`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:09:12.443843 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-d1e9a252-738a-4d23-bd31-7dd545d5d9c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:09:12.516148 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1180/2356] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:09:12 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:09:12.520958 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61698a4a-4115-4b78-bfeb-0977799b14b6 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:12.585921 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61698a4a-4115-4b78-bfeb-0977799b14b6 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:12.591593 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605e177d-ab32-4dbc-af10-160819763f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:12.592233 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e177d-ab32-4dbc-af10-160819763f55 admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:12.592639 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e177d-ab32-4dbc-af10-160819763f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:12.592923 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e177d-ab32-4dbc-af10-160819763f55 admin admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:12.593578 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605e177d-ab32-4dbc-af10-160819763f55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:12.595505 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605e177d-ab32-4dbc-af10-160819763f55 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:12.625325 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1177/2357] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 10 10:09:12 2022] POST /identity/v3/projects => generated 387 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:09:12.629869 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e9a252-738a-4d23-bd31-7dd545d5d9c8 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:12.643338 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e9a252-738a-4d23-bd31-7dd545d5d9c8 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:12.710356 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8168e158-9849-4145-b3af-26fdddd642f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:12.710817 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8168e158-9849-4145-b3af-26fdddd642f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:12.711086 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8168e158-9849-4145-b3af-26fdddd642f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:12.711376 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8168e158-9849-4145-b3af-26fdddd642f3 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:12.711998 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8168e158-9849-4145-b3af-26fdddd642f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:12.713966 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8168e158-9849-4145-b3af-26fdddd642f3 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:12.738279 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1181/2358] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 10 10:09:12 2022] POST /identity/v3/users => generated 300 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:09:12.742199 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605e177d-ab32-4dbc-af10-160819763f55 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:12.753431 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605e177d-ab32-4dbc-af10-160819763f55 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:12.759265 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca182761-399a-4ee2-b159-faefc54491eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:12.759957 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca182761-399a-4ee2-b159-faefc54491eb admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:12.760327 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca182761-399a-4ee2-b159-faefc54491eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:12.760817 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca182761-399a-4ee2-b159-faefc54491eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:12.761625 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca182761-399a-4ee2-b159-faefc54491eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:12.763367 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca182761-399a-4ee2-b159-faefc54491eb admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:12.777627 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1178/2359] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:09:12 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:09:12.781858 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8168e158-9849-4145-b3af-26fdddd642f3 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:12.794351 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8168e158-9849-4145-b3af-26fdddd642f3 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:12.799654 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00686b6a-c158-43a6-bc77-94ed42a3f0fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:12.800313 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00686b6a-c158-43a6-bc77-94ed42a3f0fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:12.800592 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00686b6a-c158-43a6-bc77-94ed42a3f0fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:12.800871 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00686b6a-c158-43a6-bc77-94ed42a3f0fe admin admin] PATH_INFO: `/v3/projects/070a0a98db414fe29ace200790fa1c72/users/7d29749067774507a9f8c043893d3152/roles/eb04edc46b3742d7a0f0ead26f68bc22` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:12.817834 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00686b6a-c158-43a6-bc77-94ed42a3f0fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=070a0a98db414fe29ace200790fa1c72, user_id=7d29749067774507a9f8c043893d3152, role_id=eb04edc46b3742d7a0f0ead26f68bc22)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:12.821537 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00686b6a-c158-43a6-bc77-94ed42a3f0fe admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:12.835509 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1182/2360] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:09:12 2022] PUT /identity/v3/projects/070a0a98db414fe29ace200790fa1c72/users/7d29749067774507a9f8c043893d3152/roles/eb04edc46b3742d7a0f0ead26f68bc22 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:09:12.839340 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca182761-399a-4ee2-b159-faefc54491eb admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:12.849833 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca182761-399a-4ee2-b159-faefc54491eb admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:12.908380 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4b549f-75fc-4a6a-a187-d638be99987f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:12.908980 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4b549f-75fc-4a6a-a187-d638be99987f admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:12.909287 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4b549f-75fc-4a6a-a187-d638be99987f admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:12.909555 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4b549f-75fc-4a6a-a187-d638be99987f admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:12.910196 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4b549f-75fc-4a6a-a187-d638be99987f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:12.911797 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4b549f-75fc-4a6a-a187-d638be99987f admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:12.921391 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1179/2361] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:09:12 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:09:12.926226 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00686b6a-c158-43a6-bc77-94ed42a3f0fe admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:12.936921 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00686b6a-c158-43a6-bc77-94ed42a3f0fe admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:12.941798 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c197c46c-9aab-4f13-be44-46d41b5f0d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:12.942460 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c197c46c-9aab-4f13-be44-46d41b5f0d4f admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:12.942739 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c197c46c-9aab-4f13-be44-46d41b5f0d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:12.943014 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c197c46c-9aab-4f13-be44-46d41b5f0d4f admin admin] PATH_INFO: `/v3/projects/070a0a98db414fe29ace200790fa1c72/users/7d29749067774507a9f8c043893d3152/roles/eb04edc46b3742d7a0f0ead26f68bc22` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:12.945013 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c197c46c-9aab-4f13-be44-46d41b5f0d4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=070a0a98db414fe29ace200790fa1c72, user_id=7d29749067774507a9f8c043893d3152, role_id=eb04edc46b3742d7a0f0ead26f68bc22)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:12.947724 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c197c46c-9aab-4f13-be44-46d41b5f0d4f admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:12.950482 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4b549f-75fc-4a6a-a187-d638be99987f admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:12.952131 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-5b4b549f-75fc-4a6a-a187-d638be99987f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:09:12.958399 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1183/2362] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:09:12 2022] PUT /identity/v3/projects/070a0a98db414fe29ace200790fa1c72/users/7d29749067774507a9f8c043893d3152/roles/eb04edc46b3742d7a0f0ead26f68bc22 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:09:12.968446 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88884e6b-ed12-43b5-a232-7a5d95777fd2 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:12.968735 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88884e6b-ed12-43b5-a232-7a5d95777fd2 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:12.969009 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88884e6b-ed12-43b5-a232-7a5d95777fd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:12.997059 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-88884e6b-ed12-43b5-a232-7a5d95777fd2 None None] MFA Rules not processed for user `7d29749067774507a9f8c043893d3152`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:09:12.998368 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-88884e6b-ed12-43b5-a232-7a5d95777fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:09:13.023078 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:09:13.030834 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4b549f-75fc-4a6a-a187-d638be99987f admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:13.033414 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:09:13.071716 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1184/2363] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:09:12 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:09:13.084395 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88884e6b-ed12-43b5-a232-7a5d95777fd2 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:13.085966 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-88884e6b-ed12-43b5-a232-7a5d95777fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:09:13.101249 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75db999-f4fb-43f8-9231-5de6d9b35611 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd8580888cba41a88566da4540b1130c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:13.101866 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75db999-f4fb-43f8-9231-5de6d9b35611 service nova] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:13.102136 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75db999-f4fb-43f8-9231-5de6d9b35611 service nova] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:13.102402 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75db999-f4fb-43f8-9231-5de6d9b35611 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:13.104251 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-e75db999-f4fb-43f8-9231-5de6d9b35611 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:09:13.144399 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88884e6b-ed12-43b5-a232-7a5d95777fd2 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:13.148202 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57092391-a944-4346-8b8b-66acf67f28e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf8e725cbe0403d943b136235eac057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:13.148815 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57092391-a944-4346-8b8b-66acf67f28e4 service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:13.149117 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57092391-a944-4346-8b8b-66acf67f28e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:13.149392 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57092391-a944-4346-8b8b-66acf67f28e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:13.159188 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57092391-a944-4346-8b8b-66acf67f28e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:13.160623 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57092391-a944-4346-8b8b-66acf67f28e4 service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:13.164332 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75db999-f4fb-43f8-9231-5de6d9b35611 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:13.165988 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75db999-f4fb-43f8-9231-5de6d9b35611 service nova] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:13.170853 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1185/2364] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:09:13 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 10:09:13.176982 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1180/2365] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:09:12 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 10:09:13.756045 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57092391-a944-4346-8b8b-66acf67f28e4 service cinder] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:13.820352 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57092391-a944-4346-8b8b-66acf67f28e4 service cinder] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:13.826199 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1debc03-9092-4767-a029-e10af65764cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:13.826848 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1debc03-9092-4767-a029-e10af65764cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:13.827115 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1debc03-9092-4767-a029-e10af65764cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:13.827384 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1debc03-9092-4767-a029-e10af65764cf admin admin] PATH_INFO: `/v3/users/a801d613b4d44a789553e2ba57c17cce` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:13.828668 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1debc03-9092-4767-a029-e10af65764cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=a801d613b4d44a789553e2ba57c17cce)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:13.830651 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1debc03-9092-4767-a029-e10af65764cf admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:13.878760 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-c1debc03-9092-4767-a029-e10af65764cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a801d613b4d44a789553e2ba57c17cce'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:13.890140 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-c1debc03-9092-4767-a029-e10af65764cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a801d613b4d44a789553e2ba57c17cce'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:13.890828 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-c1debc03-9092-4767-a029-e10af65764cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a801d613b4d44a789553e2ba57c17cce'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:13.891917 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-c1debc03-9092-4767-a029-e10af65764cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a801d613b4d44a789553e2ba57c17cce'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:13.901083 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-c1debc03-9092-4767-a029-e10af65764cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a801d613b4d44a789553e2ba57c17cce'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:13.910378 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:09:13.920733 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1186/2366] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 10 10:09:13 2022] DELETE /identity/v3/users/a801d613b4d44a789553e2ba57c17cce => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:09:13.925857 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c94af6f-96e1-40a2-97d3-91b0e156279b None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:13.926293 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c94af6f-96e1-40a2-97d3-91b0e156279b None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:13.926466 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c94af6f-96e1-40a2-97d3-91b0e156279b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:13.947793 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-7c94af6f-96e1-40a2-97d3-91b0e156279b None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:09:13.947793 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-7c94af6f-96e1-40a2-97d3-91b0e156279b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:09:13.992380 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1debc03-9092-4767-a029-e10af65764cf admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:13.993884 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-c1debc03-9092-4767-a029-e10af65764cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:09:14.019829 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1181/2367] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:09:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:09:14.029452 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c94af6f-96e1-40a2-97d3-91b0e156279b None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:14.030844 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-7c94af6f-96e1-40a2-97d3-91b0e156279b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:09:14.053180 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1debc03-9092-4767-a029-e10af65764cf admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:14.056946 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9565c94d-a54e-4e11-99ec-3ce204d41040 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4294c170df354fe892831281acd4ea7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:14.057588 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9565c94d-a54e-4e11-99ec-3ce204d41040 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:14.057864 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9565c94d-a54e-4e11-99ec-3ce204d41040 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:14.058141 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9565c94d-a54e-4e11-99ec-3ce204d41040 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:14.059987 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-9565c94d-a54e-4e11-99ec-3ce204d41040 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:09:14.071716 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9565c94d-a54e-4e11-99ec-3ce204d41040 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:14.073179 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9565c94d-a54e-4e11-99ec-3ce204d41040 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:14.074266 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:09:14.083235 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1187/2368] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:09:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 10:09:14.088769 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c94af6f-96e1-40a2-97d3-91b0e156279b None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:14.092698 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba47cfc-d6a0-4c05-b9c0-5283f0724243 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4294c170df354fe892831281acd4ea7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:14.093340 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba47cfc-d6a0-4c05-b9c0-5283f0724243 service neutron] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:14.093615 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba47cfc-d6a0-4c05-b9c0-5283f0724243 service neutron] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:14.093883 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba47cfc-d6a0-4c05-b9c0-5283f0724243 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:14.103528 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba47cfc-d6a0-4c05-b9c0-5283f0724243 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:14.104961 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba47cfc-d6a0-4c05-b9c0-5283f0724243 service neutron] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:14.114618 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1182/2369] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:09:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 10:09:14.736299 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9565c94d-a54e-4e11-99ec-3ce204d41040 service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:14.738414 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-9565c94d-a54e-4e11-99ec-3ce204d41040 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:09:14.752295 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9565c94d-a54e-4e11-99ec-3ce204d41040 service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:14.757159 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9552dd38-d34b-48e5-a186-acd25a6cc582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:14.758042 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9552dd38-d34b-48e5-a186-acd25a6cc582 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:14.758206 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9552dd38-d34b-48e5-a186-acd25a6cc582 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:14.758603 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9552dd38-d34b-48e5-a186-acd25a6cc582 admin admin] PATH_INFO: `/v3/projects/8da27048d488487ca93f3c2f2249c7f3` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:14.759844 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9552dd38-d34b-48e5-a186-acd25a6cc582 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8da27048d488487ca93f3c2f2249c7f3)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:14.761935 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9552dd38-d34b-48e5-a186-acd25a6cc582 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:14.832192 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-9552dd38-d34b-48e5-a186-acd25a6cc582 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8da27048d488487ca93f3c2f2249c7f3', 'request_id': 'req-9552dd38-d34b-48e5-a186-acd25a6cc582'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:14.839180 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-9552dd38-d34b-48e5-a186-acd25a6cc582 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8da27048d488487ca93f3c2f2249c7f3', 'request_id': 'req-9552dd38-d34b-48e5-a186-acd25a6cc582'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:14.854589 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-9552dd38-d34b-48e5-a186-acd25a6cc582 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8da27048d488487ca93f3c2f2249c7f3', 'request_id': 'req-9552dd38-d34b-48e5-a186-acd25a6cc582'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:14.868351 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-9552dd38-d34b-48e5-a186-acd25a6cc582 admin admin] The token cache is being invalidate because project 8da27048d488487ca93f3c2f2249c7f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 10:09:14.868548 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-9552dd38-d34b-48e5-a186-acd25a6cc582 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:14.869330 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-9552dd38-d34b-48e5-a186-acd25a6cc582 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:14.871216 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1188/2370] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 10 10:09:14 2022] DELETE /identity/v3/projects/8da27048d488487ca93f3c2f2249c7f3 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:09:14.875194 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba47cfc-d6a0-4c05-b9c0-5283f0724243 service neutron] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:14.885718 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba47cfc-d6a0-4c05-b9c0-5283f0724243 service neutron] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:14.969764 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2a7198-c910-49a5-932c-0c5c264686cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:14.970412 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2a7198-c910-49a5-932c-0c5c264686cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:14.970698 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2a7198-c910-49a5-932c-0c5c264686cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:14.970971 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2a7198-c910-49a5-932c-0c5c264686cd admin admin] PATH_INFO: `/v3/users/7d29749067774507a9f8c043893d3152` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:14.972102 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2a7198-c910-49a5-932c-0c5c264686cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d29749067774507a9f8c043893d3152)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:14.974154 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2a7198-c910-49a5-932c-0c5c264686cd admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:15.026920 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-ac2a7198-c910-49a5-932c-0c5c264686cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d29749067774507a9f8c043893d3152'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:15.034130 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-ac2a7198-c910-49a5-932c-0c5c264686cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d29749067774507a9f8c043893d3152'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:15.042166 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-ac2a7198-c910-49a5-932c-0c5c264686cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d29749067774507a9f8c043893d3152'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:15.042937 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-ac2a7198-c910-49a5-932c-0c5c264686cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d29749067774507a9f8c043893d3152'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:15.043641 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-ac2a7198-c910-49a5-932c-0c5c264686cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d29749067774507a9f8c043893d3152'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:15.067300 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1183/2371] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 10 10:09:14 2022] DELETE /identity/v3/users/7d29749067774507a9f8c043893d3152 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:09:15.363826 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9552dd38-d34b-48e5-a186-acd25a6cc582 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:15.366036 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-9552dd38-d34b-48e5-a186-acd25a6cc582 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:09:15.390747 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9552dd38-d34b-48e5-a186-acd25a6cc582 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:15.464215 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7949013-d3af-4675-ac7c-821aae895ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:15.465299 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7949013-d3af-4675-ac7c-821aae895ffd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:15.465607 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7949013-d3af-4675-ac7c-821aae895ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:15.465845 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7949013-d3af-4675-ac7c-821aae895ffd admin admin] PATH_INFO: `/v3/projects/070a0a98db414fe29ace200790fa1c72` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:15.467218 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7949013-d3af-4675-ac7c-821aae895ffd admin admin] RBAC: Authorizing `identity:delete_project(project_id=070a0a98db414fe29ace200790fa1c72)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:15.469184 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7949013-d3af-4675-ac7c-821aae895ffd admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:15.496543 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:09:15.524502 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-b7949013-d3af-4675-ac7c-821aae895ffd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '070a0a98db414fe29ace200790fa1c72', 'request_id': 'req-b7949013-d3af-4675-ac7c-821aae895ffd'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:15.530635 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-b7949013-d3af-4675-ac7c-821aae895ffd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '070a0a98db414fe29ace200790fa1c72', 'request_id': 'req-b7949013-d3af-4675-ac7c-821aae895ffd'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:15.538731 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-b7949013-d3af-4675-ac7c-821aae895ffd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '070a0a98db414fe29ace200790fa1c72', 'request_id': 'req-b7949013-d3af-4675-ac7c-821aae895ffd'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:15.550575 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-b7949013-d3af-4675-ac7c-821aae895ffd admin admin] The token cache is being invalidate because project 070a0a98db414fe29ace200790fa1c72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 10:09:15.550866 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-b7949013-d3af-4675-ac7c-821aae895ffd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:15.551552 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-b7949013-d3af-4675-ac7c-821aae895ffd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:15.553049 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1189/2372] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 10 10:09:15 2022] DELETE /identity/v3/projects/070a0a98db414fe29ace200790fa1c72 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:09:15.558925 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1175f6-062d-4997-8757-4bac115c638d None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:15.559213 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1175f6-062d-4997-8757-4bac115c638d None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:15.559603 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1175f6-062d-4997-8757-4bac115c638d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:15.579915 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-7f1175f6-062d-4997-8757-4bac115c638d None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:09:15.581176 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-7f1175f6-062d-4997-8757-4bac115c638d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:09:15.640721 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1184/2373] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:09:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:09:15.648662 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04557c12-6709-4bac-a5a2-af338c6a7998 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:15.649167 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04557c12-6709-4bac-a5a2-af338c6a7998 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:15.649441 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04557c12-6709-4bac-a5a2-af338c6a7998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:15.682625 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-04557c12-6709-4bac-a5a2-af338c6a7998 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:09:15.684026 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-04557c12-6709-4bac-a5a2-af338c6a7998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:09:15.693024 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1190/2374] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:09:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:09:15.701688 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1175f6-062d-4997-8757-4bac115c638d None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:15.707613 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:09:15.715578 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1175f6-062d-4997-8757-4bac115c638d None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:15.723456 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b511fda5-3038-4456-918b-6b5bddf041cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:15.724286 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b511fda5-3038-4456-918b-6b5bddf041cd admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:15.724566 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b511fda5-3038-4456-918b-6b5bddf041cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:15.724835 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b511fda5-3038-4456-918b-6b5bddf041cd admin admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:15.725525 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b511fda5-3038-4456-918b-6b5bddf041cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:09:15.725825 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b511fda5-3038-4456-918b-6b5bddf041cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:15.727445 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b511fda5-3038-4456-918b-6b5bddf041cd admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:15.740341 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1185/2375] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 10 10:09:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:09:15.744931 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04557c12-6709-4bac-a5a2-af338c6a7998 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:15.757491 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04557c12-6709-4bac-a5a2-af338c6a7998 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:15.763945 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9030deb6-2190-438b-ae43-c9ae46ca755f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:15.765891 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9030deb6-2190-438b-ae43-c9ae46ca755f admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:15.766264 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9030deb6-2190-438b-ae43-c9ae46ca755f admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:15.766611 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9030deb6-2190-438b-ae43-c9ae46ca755f admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:15.767330 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9030deb6-2190-438b-ae43-c9ae46ca755f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:15.769513 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9030deb6-2190-438b-ae43-c9ae46ca755f admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:15.800929 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1191/2376] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 10 10:09:15 2022] POST /identity/v3/projects => generated 383 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:09:15.805293 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b511fda5-3038-4456-918b-6b5bddf041cd admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:15.816301 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b511fda5-3038-4456-918b-6b5bddf041cd admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:15.884633 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec540499-7715-4976-8407-70d50a0872be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:15.885286 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec540499-7715-4976-8407-70d50a0872be admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:15.885567 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec540499-7715-4976-8407-70d50a0872be admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:15.885846 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec540499-7715-4976-8407-70d50a0872be admin admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:15.886452 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec540499-7715-4976-8407-70d50a0872be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:15.888477 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec540499-7715-4976-8407-70d50a0872be admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:15.920544 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1186/2377] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 10 10:09:15 2022] POST /identity/v3/users => generated 292 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:09:15.922917 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9030deb6-2190-438b-ae43-c9ae46ca755f admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:15.937953 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9030deb6-2190-438b-ae43-c9ae46ca755f admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:15.945776 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9400902-093a-48c9-920f-912f4eb4789f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:15.946445 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9400902-093a-48c9-920f-912f4eb4789f admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:15.946719 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9400902-093a-48c9-920f-912f4eb4789f admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:15.947033 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9400902-093a-48c9-920f-912f4eb4789f admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:15.947845 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9400902-093a-48c9-920f-912f4eb4789f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:15.957093 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9400902-093a-48c9-920f-912f4eb4789f admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:15.965402 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1192/2378] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:09:15 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:09:15.968668 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec540499-7715-4976-8407-70d50a0872be admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:15.980110 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec540499-7715-4976-8407-70d50a0872be admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:15.999172 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0030b1ba-16cc-4be9-9d89-0962c5a2ff57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:15.999872 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0030b1ba-16cc-4be9-9d89-0962c5a2ff57 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:16.000215 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0030b1ba-16cc-4be9-9d89-0962c5a2ff57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:16.000632 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0030b1ba-16cc-4be9-9d89-0962c5a2ff57 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:16.007789 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0030b1ba-16cc-4be9-9d89-0962c5a2ff57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:16.010233 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0030b1ba-16cc-4be9-9d89-0962c5a2ff57 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:16.025965 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1187/2379] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:09:15 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:09:16.027001 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9400902-093a-48c9-920f-912f4eb4789f admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:16.043100 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9400902-093a-48c9-920f-912f4eb4789f admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:16.050461 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba4b3da-70c1-43c7-97be-a1f775bd4933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:16.061047 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba4b3da-70c1-43c7-97be-a1f775bd4933 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:16.061426 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba4b3da-70c1-43c7-97be-a1f775bd4933 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:16.061706 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba4b3da-70c1-43c7-97be-a1f775bd4933 admin admin] PATH_INFO: `/v3/projects/5accbe4caeb24c0cbc226bd2f33af291/users/8e843a8948d54285aa87ddd8efcc2ccd/roles/8daabcb6b7394e39b06a3453e33e32db` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:16.082711 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba4b3da-70c1-43c7-97be-a1f775bd4933 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5accbe4caeb24c0cbc226bd2f33af291, user_id=8e843a8948d54285aa87ddd8efcc2ccd, role_id=8daabcb6b7394e39b06a3453e33e32db)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:16.085712 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba4b3da-70c1-43c7-97be-a1f775bd4933 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:16.113677 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1193/2380] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:09:16 2022] PUT /identity/v3/projects/5accbe4caeb24c0cbc226bd2f33af291/users/8e843a8948d54285aa87ddd8efcc2ccd/roles/8daabcb6b7394e39b06a3453e33e32db => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 10:09:16.124732 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056e5c36-80ca-4185-8688-05faf35d04d9 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:16.125017 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056e5c36-80ca-4185-8688-05faf35d04d9 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:16.125332 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056e5c36-80ca-4185-8688-05faf35d04d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:16.157503 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-056e5c36-80ca-4185-8688-05faf35d04d9 None None] MFA Rules not processed for user `8e843a8948d54285aa87ddd8efcc2ccd`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:09:16.159441 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-056e5c36-80ca-4185-8688-05faf35d04d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:09:16.241110 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1188/2381] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:09:16 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:09:16.252460 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba4b3da-70c1-43c7-97be-a1f775bd4933 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:16.255516 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-0ba4b3da-70c1-43c7-97be-a1f775bd4933 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:09:16.327815 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba4b3da-70c1-43c7-97be-a1f775bd4933 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:16.332421 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0540842a-58ed-4f9d-aa7a-195c91d66351 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf8e725cbe0403d943b136235eac057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:16.333276 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0540842a-58ed-4f9d-aa7a-195c91d66351 service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:16.333633 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0540842a-58ed-4f9d-aa7a-195c91d66351 service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:16.334140 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0540842a-58ed-4f9d-aa7a-195c91d66351 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:16.344335 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0540842a-58ed-4f9d-aa7a-195c91d66351 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:16.345937 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0540842a-58ed-4f9d-aa7a-195c91d66351 service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:16.362264 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1194/2382] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:09:16 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:09:17.354190 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056e5c36-80ca-4185-8688-05faf35d04d9 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:17.360856 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-056e5c36-80ca-4185-8688-05faf35d04d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:09:17.427234 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0540842a-58ed-4f9d-aa7a-195c91d66351 service cinder] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:17.428752 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-0540842a-58ed-4f9d-aa7a-195c91d66351 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:09:17.451952 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:09:17.484250 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056e5c36-80ca-4185-8688-05faf35d04d9 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:17.491497 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e779f6ad-cda3-4626-91a3-03431f0992f1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6b658f1e27b4dfb96de71dc6a7e9496', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:17.492259 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e779f6ad-cda3-4626-91a3-03431f0992f1 service placement] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:17.492604 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e779f6ad-cda3-4626-91a3-03431f0992f1 service placement] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:17.492970 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e779f6ad-cda3-4626-91a3-03431f0992f1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:17.494957 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-e779f6ad-cda3-4626-91a3-03431f0992f1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:09:17.509548 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e779f6ad-cda3-4626-91a3-03431f0992f1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:17.511661 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e779f6ad-cda3-4626-91a3-03431f0992f1 service placement] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:17.533560 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1189/2383] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:09:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:09:17.539942 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:09:17.565398 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0540842a-58ed-4f9d-aa7a-195c91d66351 service cinder] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:17.572393 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dbd719-36ed-46ad-af96-b3bd13d18945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:17.573179 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dbd719-36ed-46ad-af96-b3bd13d18945 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:17.573687 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dbd719-36ed-46ad-af96-b3bd13d18945 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:17.574119 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dbd719-36ed-46ad-af96-b3bd13d18945 admin admin] PATH_INFO: `/v3/users/63fa6ba87a7a4827af4c5fbd4629b1c0` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:17.575807 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dbd719-36ed-46ad-af96-b3bd13d18945 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63fa6ba87a7a4827af4c5fbd4629b1c0)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:17.578367 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dbd719-36ed-46ad-af96-b3bd13d18945 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:17.648292 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-d6dbd719-36ed-46ad-af96-b3bd13d18945 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63fa6ba87a7a4827af4c5fbd4629b1c0'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:17.657382 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-d6dbd719-36ed-46ad-af96-b3bd13d18945 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63fa6ba87a7a4827af4c5fbd4629b1c0'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:17.658181 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-d6dbd719-36ed-46ad-af96-b3bd13d18945 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63fa6ba87a7a4827af4c5fbd4629b1c0'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:17.658780 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-d6dbd719-36ed-46ad-af96-b3bd13d18945 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63fa6ba87a7a4827af4c5fbd4629b1c0'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:17.666658 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-d6dbd719-36ed-46ad-af96-b3bd13d18945 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63fa6ba87a7a4827af4c5fbd4629b1c0'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:17.712254 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1195/2384] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 10 10:09:17 2022] DELETE /identity/v3/users/63fa6ba87a7a4827af4c5fbd4629b1c0 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 10:09:17.932080 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e779f6ad-cda3-4626-91a3-03431f0992f1 service placement] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:17.971558 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e779f6ad-cda3-4626-91a3-03431f0992f1 service placement] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:18.045284 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98466fa4-9664-456f-959f-a4e11be58bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:18.045989 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98466fa4-9664-456f-959f-a4e11be58bca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:18.046438 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98466fa4-9664-456f-959f-a4e11be58bca admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:18.046557 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98466fa4-9664-456f-959f-a4e11be58bca admin admin] PATH_INFO: `/v3/projects/fd52b7be13dc455baa5581f05d8dbb72` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:18.047717 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98466fa4-9664-456f-959f-a4e11be58bca admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd52b7be13dc455baa5581f05d8dbb72)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:18.050087 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98466fa4-9664-456f-959f-a4e11be58bca admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:18.099199 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-98466fa4-9664-456f-959f-a4e11be58bca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd52b7be13dc455baa5581f05d8dbb72', 'request_id': 'req-98466fa4-9664-456f-959f-a4e11be58bca'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:18.104700 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-98466fa4-9664-456f-959f-a4e11be58bca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd52b7be13dc455baa5581f05d8dbb72', 'request_id': 'req-98466fa4-9664-456f-959f-a4e11be58bca'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:18.112933 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-98466fa4-9664-456f-959f-a4e11be58bca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd52b7be13dc455baa5581f05d8dbb72', 'request_id': 'req-98466fa4-9664-456f-959f-a4e11be58bca'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:18.124632 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-98466fa4-9664-456f-959f-a4e11be58bca admin admin] The token cache is being invalidate because project fd52b7be13dc455baa5581f05d8dbb72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 10:09:18.124922 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-98466fa4-9664-456f-959f-a4e11be58bca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:18.125590 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-98466fa4-9664-456f-959f-a4e11be58bca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:18.127100 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1190/2385] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 10 10:09:17 2022] DELETE /identity/v3/projects/fd52b7be13dc455baa5581f05d8dbb72 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:09:18.132283 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5205dfd-083f-42a8-88dd-90c16ec432de None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:18.132566 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5205dfd-083f-42a8-88dd-90c16ec432de None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:18.132836 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5205dfd-083f-42a8-88dd-90c16ec432de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:18.153297 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-f5205dfd-083f-42a8-88dd-90c16ec432de None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:09:18.154834 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-f5205dfd-083f-42a8-88dd-90c16ec432de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:09:18.216521 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1196/2386] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:09:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:09:18.225077 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5535121-a716-4517-a253-eb822d384479 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:18.225370 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5535121-a716-4517-a253-eb822d384479 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:18.225641 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5535121-a716-4517-a253-eb822d384479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:18.246458 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-f5535121-a716-4517-a253-eb822d384479 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:09:18.247662 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-f5535121-a716-4517-a253-eb822d384479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:09:18.255586 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1191/2387] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:09:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:09:18.260108 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5205dfd-083f-42a8-88dd-90c16ec432de None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:18.270111 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5205dfd-083f-42a8-88dd-90c16ec432de None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:18.275849 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1ec692-8494-4e6b-aacb-ccdd7b9e525f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:18.276439 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1ec692-8494-4e6b-aacb-ccdd7b9e525f admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:18.276715 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1ec692-8494-4e6b-aacb-ccdd7b9e525f admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:18.276978 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1ec692-8494-4e6b-aacb-ccdd7b9e525f admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:18.277827 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1ec692-8494-4e6b-aacb-ccdd7b9e525f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:09:18.278128 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1ec692-8494-4e6b-aacb-ccdd7b9e525f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:18.279765 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1ec692-8494-4e6b-aacb-ccdd7b9e525f admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:18.291738 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1197/2388] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 10 10:09:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 10:09:18.295996 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5535121-a716-4517-a253-eb822d384479 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:18.306013 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5535121-a716-4517-a253-eb822d384479 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:18.311863 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f6f30b-ef1f-4b43-ab90-0fda4a4091a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:18.312452 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f6f30b-ef1f-4b43-ab90-0fda4a4091a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:18.312724 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f6f30b-ef1f-4b43-ab90-0fda4a4091a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:18.312985 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f6f30b-ef1f-4b43-ab90-0fda4a4091a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:18.313638 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f6f30b-ef1f-4b43-ab90-0fda4a4091a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:18.315537 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f6f30b-ef1f-4b43-ab90-0fda4a4091a7 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:18.345180 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1192/2389] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 10 10:09:18 2022] POST /identity/v3/projects => generated 365 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:09:18.349422 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1ec692-8494-4e6b-aacb-ccdd7b9e525f admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:18.366942 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1ec692-8494-4e6b-aacb-ccdd7b9e525f admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:18.422916 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:09:18.436473 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a629e23-facc-4a2d-b995-b6152b8cdf4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:18.437166 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a629e23-facc-4a2d-b995-b6152b8cdf4c admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:18.437379 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a629e23-facc-4a2d-b995-b6152b8cdf4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:18.437674 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a629e23-facc-4a2d-b995-b6152b8cdf4c admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:18.438327 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a629e23-facc-4a2d-b995-b6152b8cdf4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:18.441039 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a629e23-facc-4a2d-b995-b6152b8cdf4c admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:18.463892 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1198/2390] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 10 10:09:18 2022] POST /identity/v3/users => generated 283 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:09:18.468295 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f6f30b-ef1f-4b43-ab90-0fda4a4091a7 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:18.478859 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f6f30b-ef1f-4b43-ab90-0fda4a4091a7 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:18.484655 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc95586-aa5e-4e7e-8a87-0dd7c9f59e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:18.485277 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc95586-aa5e-4e7e-8a87-0dd7c9f59e00 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:18.485551 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc95586-aa5e-4e7e-8a87-0dd7c9f59e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:18.485817 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc95586-aa5e-4e7e-8a87-0dd7c9f59e00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:18.486459 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc95586-aa5e-4e7e-8a87-0dd7c9f59e00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:18.488070 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc95586-aa5e-4e7e-8a87-0dd7c9f59e00 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:18.498260 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1193/2391] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:09:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:09:18.502417 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a629e23-facc-4a2d-b995-b6152b8cdf4c admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:18.512505 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a629e23-facc-4a2d-b995-b6152b8cdf4c admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:18.517455 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce393b4-5a22-429d-990e-1834c76141f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:18.518045 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce393b4-5a22-429d-990e-1834c76141f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:18.518331 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce393b4-5a22-429d-990e-1834c76141f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:18.518594 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce393b4-5a22-429d-990e-1834c76141f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:18.519243 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce393b4-5a22-429d-990e-1834c76141f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:18.520855 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce393b4-5a22-429d-990e-1834c76141f5 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:18.531804 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1199/2392] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:09:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:09:18.536188 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc95586-aa5e-4e7e-8a87-0dd7c9f59e00 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:18.546954 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc95586-aa5e-4e7e-8a87-0dd7c9f59e00 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:18.552637 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d45bc04-b702-46cf-a13f-fb3917d03a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:18.553509 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d45bc04-b702-46cf-a13f-fb3917d03a24 admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:18.553783 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d45bc04-b702-46cf-a13f-fb3917d03a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:18.554048 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d45bc04-b702-46cf-a13f-fb3917d03a24 admin admin] PATH_INFO: `/v3/projects/b78f03247b4342ef83f75a2f36ffe346/users/c4778644878b49da8f863b4d10133cfc/roles/8daabcb6b7394e39b06a3453e33e32db` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:18.568835 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d45bc04-b702-46cf-a13f-fb3917d03a24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b78f03247b4342ef83f75a2f36ffe346, user_id=c4778644878b49da8f863b4d10133cfc, role_id=8daabcb6b7394e39b06a3453e33e32db)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:18.571544 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d45bc04-b702-46cf-a13f-fb3917d03a24 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:18.585925 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1194/2393] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:09:18 2022] PUT /identity/v3/projects/b78f03247b4342ef83f75a2f36ffe346/users/c4778644878b49da8f863b4d10133cfc/roles/8daabcb6b7394e39b06a3453e33e32db => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:09:18.596443 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9b8066-a31b-494e-9d49-d379ac665bb8 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:18.596751 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9b8066-a31b-494e-9d49-d379ac665bb8 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:18.597027 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9b8066-a31b-494e-9d49-d379ac665bb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:18.624380 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-aa9b8066-a31b-494e-9d49-d379ac665bb8 None None] MFA Rules not processed for user `c4778644878b49da8f863b4d10133cfc`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:09:18.625625 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-aa9b8066-a31b-494e-9d49-d379ac665bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:09:18.706174 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1200/2394] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:09:18 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:09:18.717850 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d45bc04-b702-46cf-a13f-fb3917d03a24 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:18.719945 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-5d45bc04-b702-46cf-a13f-fb3917d03a24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:09:18.734899 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:09:18.782259 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d45bc04-b702-46cf-a13f-fb3917d03a24 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:18.786440 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3940147b-0da4-41e4-9b82-6e8e0e9e16b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf8e725cbe0403d943b136235eac057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:18.787049 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3940147b-0da4-41e4-9b82-6e8e0e9e16b8 service cinder] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:18.787327 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3940147b-0da4-41e4-9b82-6e8e0e9e16b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:18.787599 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3940147b-0da4-41e4-9b82-6e8e0e9e16b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:18.797130 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3940147b-0da4-41e4-9b82-6e8e0e9e16b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:18.798582 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3940147b-0da4-41e4-9b82-6e8e0e9e16b8 service cinder] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:18.808034 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1195/2395] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:09:18 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:09:21.903750 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9b8066-a31b-494e-9d49-d379ac665bb8 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:21.905554 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-aa9b8066-a31b-494e-9d49-d379ac665bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:09:21.986987 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9b8066-a31b-494e-9d49-d379ac665bb8 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:21.991672 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cb4fd1-733a-446f-8981-e5caed2284a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:21.992308 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cb4fd1-733a-446f-8981-e5caed2284a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:21.992591 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cb4fd1-733a-446f-8981-e5caed2284a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:21.992864 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cb4fd1-733a-446f-8981-e5caed2284a4 admin admin] PATH_INFO: `/v3/users/8e843a8948d54285aa87ddd8efcc2ccd` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:21.994025 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cb4fd1-733a-446f-8981-e5caed2284a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e843a8948d54285aa87ddd8efcc2ccd)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:21.995949 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cb4fd1-733a-446f-8981-e5caed2284a4 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:22.042444 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-11cb4fd1-733a-446f-8981-e5caed2284a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e843a8948d54285aa87ddd8efcc2ccd'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:22.051606 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-11cb4fd1-733a-446f-8981-e5caed2284a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e843a8948d54285aa87ddd8efcc2ccd'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:22.052227 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-11cb4fd1-733a-446f-8981-e5caed2284a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e843a8948d54285aa87ddd8efcc2ccd'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:22.052839 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-11cb4fd1-733a-446f-8981-e5caed2284a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e843a8948d54285aa87ddd8efcc2ccd'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:22.059910 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-11cb4fd1-733a-446f-8981-e5caed2284a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e843a8948d54285aa87ddd8efcc2ccd'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:22.061019 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:09:22.079120 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1201/2396] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 10 10:09:21 2022] DELETE /identity/v3/users/8e843a8948d54285aa87ddd8efcc2ccd => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:09:22.083718 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dbf175-828c-4270-b969-3376375b5467 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:22.084196 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dbf175-828c-4270-b969-3376375b5467 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:22.084316 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dbf175-828c-4270-b969-3376375b5467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:22.103325 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-85dbf175-828c-4270-b969-3376375b5467 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:09:22.104493 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-85dbf175-828c-4270-b969-3376375b5467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:09:22.167197 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1196/2397] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:09:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:09:22.177690 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cb4fd1-733a-446f-8981-e5caed2284a4 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:22.179416 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-11cb4fd1-733a-446f-8981-e5caed2284a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:09:22.237002 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cb4fd1-733a-446f-8981-e5caed2284a4 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:22.241137 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86e1ba1-97e5-42e7-b1d8-cebe7110eb8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4294c170df354fe892831281acd4ea7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:22.241760 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e1ba1-97e5-42e7-b1d8-cebe7110eb8c service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:22.242033 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e1ba1-97e5-42e7-b1d8-cebe7110eb8c service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:22.242297 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e1ba1-97e5-42e7-b1d8-cebe7110eb8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:22.251347 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86e1ba1-97e5-42e7-b1d8-cebe7110eb8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:22.252767 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86e1ba1-97e5-42e7-b1d8-cebe7110eb8c service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:22.262181 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1202/2398] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:09:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:09:22.535239 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dbf175-828c-4270-b969-3376375b5467 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:22.536756 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-85dbf175-828c-4270-b969-3376375b5467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:09:22.550894 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dbf175-828c-4270-b969-3376375b5467 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:22.556735 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5e4e7b-e985-4c9e-933f-80c0e896a0a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:22.557424 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5e4e7b-e985-4c9e-933f-80c0e896a0a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:22.557702 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5e4e7b-e985-4c9e-933f-80c0e896a0a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:22.557970 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5e4e7b-e985-4c9e-933f-80c0e896a0a6 admin admin] PATH_INFO: `/v3/projects/5accbe4caeb24c0cbc226bd2f33af291` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:22.559228 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5e4e7b-e985-4c9e-933f-80c0e896a0a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5accbe4caeb24c0cbc226bd2f33af291)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:22.561321 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5e4e7b-e985-4c9e-933f-80c0e896a0a6 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:22.611687 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-ed5e4e7b-e985-4c9e-933f-80c0e896a0a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5accbe4caeb24c0cbc226bd2f33af291', 'request_id': 'req-ed5e4e7b-e985-4c9e-933f-80c0e896a0a6'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:22.617252 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-ed5e4e7b-e985-4c9e-933f-80c0e896a0a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5accbe4caeb24c0cbc226bd2f33af291', 'request_id': 'req-ed5e4e7b-e985-4c9e-933f-80c0e896a0a6'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:22.625866 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-ed5e4e7b-e985-4c9e-933f-80c0e896a0a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5accbe4caeb24c0cbc226bd2f33af291', 'request_id': 'req-ed5e4e7b-e985-4c9e-933f-80c0e896a0a6'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:22.637327 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-ed5e4e7b-e985-4c9e-933f-80c0e896a0a6 admin admin] The token cache is being invalidate because project 5accbe4caeb24c0cbc226bd2f33af291 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 10:09:22.637617 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-ed5e4e7b-e985-4c9e-933f-80c0e896a0a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:22.638329 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-ed5e4e7b-e985-4c9e-933f-80c0e896a0a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:22.639930 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1197/2399] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 10 10:09:22 2022] DELETE /identity/v3/projects/5accbe4caeb24c0cbc226bd2f33af291 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:09:22.646728 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3426dd-0a5d-4b27-a732-d518480d9805 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:22.647018 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3426dd-0a5d-4b27-a732-d518480d9805 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:22.647289 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3426dd-0a5d-4b27-a732-d518480d9805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:22.667738 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-7b3426dd-0a5d-4b27-a732-d518480d9805 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:09:22.673407 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-7b3426dd-0a5d-4b27-a732-d518480d9805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:09:22.735259 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1203/2400] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:09:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:09:22.743808 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581bba12-9a4a-4c40-8b12-cb1049323c17 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:22.744093 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581bba12-9a4a-4c40-8b12-cb1049323c17 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:22.744361 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581bba12-9a4a-4c40-8b12-cb1049323c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:22.765435 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-581bba12-9a4a-4c40-8b12-cb1049323c17 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:09:22.766658 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-581bba12-9a4a-4c40-8b12-cb1049323c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:09:22.775796 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1198/2401] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:09:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:09:22.780577 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3426dd-0a5d-4b27-a732-d518480d9805 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:22.790492 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3426dd-0a5d-4b27-a732-d518480d9805 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:22.795641 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c690502-889a-4662-a2c2-7f0934af0678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:22.796276 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c690502-889a-4662-a2c2-7f0934af0678 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:22.796554 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c690502-889a-4662-a2c2-7f0934af0678 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:22.796952 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c690502-889a-4662-a2c2-7f0934af0678 admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:22.797869 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c690502-889a-4662-a2c2-7f0934af0678 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:09:22.798172 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c690502-889a-4662-a2c2-7f0934af0678 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:22.800413 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c690502-889a-4662-a2c2-7f0934af0678 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:22.817100 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1204/2402] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 10 10:09:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:09:22.818337 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581bba12-9a4a-4c40-8b12-cb1049323c17 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:22.828063 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581bba12-9a4a-4c40-8b12-cb1049323c17 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:22.833101 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f295da-5b7c-4c2e-a699-98746cb0bbb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:22.834010 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f295da-5b7c-4c2e-a699-98746cb0bbb6 admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:22.834135 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f295da-5b7c-4c2e-a699-98746cb0bbb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:22.834410 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f295da-5b7c-4c2e-a699-98746cb0bbb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:22.835036 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f295da-5b7c-4c2e-a699-98746cb0bbb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:22.836956 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f295da-5b7c-4c2e-a699-98746cb0bbb6 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:22.869691 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1199/2403] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 10 10:09:22 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:09:22.873932 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c690502-889a-4662-a2c2-7f0934af0678 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:22.884541 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c690502-889a-4662-a2c2-7f0934af0678 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:22.951265 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b559112-66b8-4b4f-9351-ef0912373998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:22.951881 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b559112-66b8-4b4f-9351-ef0912373998 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:22.952305 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b559112-66b8-4b4f-9351-ef0912373998 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:22.952661 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b559112-66b8-4b4f-9351-ef0912373998 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:22.953549 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b559112-66b8-4b4f-9351-ef0912373998 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:22.956316 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b559112-66b8-4b4f-9351-ef0912373998 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:22.983158 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:09:22.993009 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1205/2404] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 10 10:09:22 2022] POST /identity/v3/users => generated 287 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 10:09:22.993848 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f295da-5b7c-4c2e-a699-98746cb0bbb6 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:23.004934 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f295da-5b7c-4c2e-a699-98746cb0bbb6 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:23.009801 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13985fba-442d-44fb-b36b-86fe432d9f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:23.011329 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13985fba-442d-44fb-b36b-86fe432d9f39 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:23.011613 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13985fba-442d-44fb-b36b-86fe432d9f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:23.012000 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13985fba-442d-44fb-b36b-86fe432d9f39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:23.012704 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13985fba-442d-44fb-b36b-86fe432d9f39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:23.014357 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13985fba-442d-44fb-b36b-86fe432d9f39 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:23.022072 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:09:23.031022 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1200/2405] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:09:22 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 10:09:23.032723 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b559112-66b8-4b4f-9351-ef0912373998 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:23.053188 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b559112-66b8-4b4f-9351-ef0912373998 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:23.058402 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4367f2a-83c0-42d2-971b-ab7b4f8f1f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:23.060416 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4367f2a-83c0-42d2-971b-ab7b4f8f1f89 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:23.060416 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4367f2a-83c0-42d2-971b-ab7b4f8f1f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:23.060416 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4367f2a-83c0-42d2-971b-ab7b4f8f1f89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:23.060978 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4367f2a-83c0-42d2-971b-ab7b4f8f1f89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:23.062870 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4367f2a-83c0-42d2-971b-ab7b4f8f1f89 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:23.075694 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1206/2406] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:09:23 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 10:09:23.080192 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13985fba-442d-44fb-b36b-86fe432d9f39 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:23.090622 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13985fba-442d-44fb-b36b-86fe432d9f39 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:23.096848 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15599194-1b77-4e6b-a035-9f094e53fba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:23.097616 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15599194-1b77-4e6b-a035-9f094e53fba2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:23.099536 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15599194-1b77-4e6b-a035-9f094e53fba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:23.099937 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15599194-1b77-4e6b-a035-9f094e53fba2 admin admin] PATH_INFO: `/v3/projects/7e2feae7dddd42e2bd76bfc949c7d3cb/users/4f32f9bf4a634282bda01c1e2b908186/roles/8daabcb6b7394e39b06a3453e33e32db` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:23.118487 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15599194-1b77-4e6b-a035-9f094e53fba2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e2feae7dddd42e2bd76bfc949c7d3cb, user_id=4f32f9bf4a634282bda01c1e2b908186, role_id=8daabcb6b7394e39b06a3453e33e32db)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:23.121381 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15599194-1b77-4e6b-a035-9f094e53fba2 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:23.141479 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1201/2407] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:09:23 2022] PUT /identity/v3/projects/7e2feae7dddd42e2bd76bfc949c7d3cb/users/4f32f9bf4a634282bda01c1e2b908186/roles/8daabcb6b7394e39b06a3453e33e32db => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 10:09:23.146660 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bf1f77-636a-4e33-9c45-ed41573884ce None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:23.147061 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bf1f77-636a-4e33-9c45-ed41573884ce None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:23.147431 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bf1f77-636a-4e33-9c45-ed41573884ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:23.171624 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-83bf1f77-636a-4e33-9c45-ed41573884ce None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:09:23.173783 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-83bf1f77-636a-4e33-9c45-ed41573884ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:09:23.245429 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1207/2408] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:09:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:09:23.256564 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15599194-1b77-4e6b-a035-9f094e53fba2 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:23.259632 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-15599194-1b77-4e6b-a035-9f094e53fba2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:09:23.320501 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15599194-1b77-4e6b-a035-9f094e53fba2 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:23.324089 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e56925-64d8-45a2-8bc9-066bc17d1942 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4294c170df354fe892831281acd4ea7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:23.324683 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e56925-64d8-45a2-8bc9-066bc17d1942 service neutron] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:23.324956 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e56925-64d8-45a2-8bc9-066bc17d1942 service neutron] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:23.325254 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e56925-64d8-45a2-8bc9-066bc17d1942 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:23.334048 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e56925-64d8-45a2-8bc9-066bc17d1942 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:23.335471 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e56925-64d8-45a2-8bc9-066bc17d1942 service neutron] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:23.345043 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1202/2409] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:09:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:09:27.362964 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bf1f77-636a-4e33-9c45-ed41573884ce None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:27.364563 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-83bf1f77-636a-4e33-9c45-ed41573884ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:09:27.377333 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bf1f77-636a-4e33-9c45-ed41573884ce None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:27.382134 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3461afbb-1f86-4fea-a355-2dac1fa35dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:27.382775 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3461afbb-1f86-4fea-a355-2dac1fa35dbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:27.383054 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3461afbb-1f86-4fea-a355-2dac1fa35dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:27.383325 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3461afbb-1f86-4fea-a355-2dac1fa35dbf admin admin] PATH_INFO: `/v3/users/c4778644878b49da8f863b4d10133cfc` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:27.384482 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3461afbb-1f86-4fea-a355-2dac1fa35dbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4778644878b49da8f863b4d10133cfc)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:27.386681 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3461afbb-1f86-4fea-a355-2dac1fa35dbf admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:27.457107 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-3461afbb-1f86-4fea-a355-2dac1fa35dbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4778644878b49da8f863b4d10133cfc'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:27.471849 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-3461afbb-1f86-4fea-a355-2dac1fa35dbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4778644878b49da8f863b4d10133cfc'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:27.472481 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-3461afbb-1f86-4fea-a355-2dac1fa35dbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4778644878b49da8f863b4d10133cfc'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:27.473124 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-3461afbb-1f86-4fea-a355-2dac1fa35dbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4778644878b49da8f863b4d10133cfc'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:27.486693 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-3461afbb-1f86-4fea-a355-2dac1fa35dbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4778644878b49da8f863b4d10133cfc'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:27.510813 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1208/2410] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 10 10:09:27 2022] DELETE /identity/v3/users/c4778644878b49da8f863b4d10133cfc => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:09:27.515594 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6442b7-3bca-48a5-bc64-10ffa35a96b3 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:27.516113 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6442b7-3bca-48a5-bc64-10ffa35a96b3 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:27.516219 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6442b7-3bca-48a5-bc64-10ffa35a96b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:27.540611 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-3f6442b7-3bca-48a5-bc64-10ffa35a96b3 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:09:27.541918 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-3f6442b7-3bca-48a5-bc64-10ffa35a96b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:09:27.617474 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1203/2411] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:09:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 10:09:27.626873 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3461afbb-1f86-4fea-a355-2dac1fa35dbf admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:27.628868 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-3461afbb-1f86-4fea-a355-2dac1fa35dbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:09:27.712388 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3461afbb-1f86-4fea-a355-2dac1fa35dbf admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:27.724098 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a878d9df-85f1-483e-839c-b1eb177a3701 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4294c170df354fe892831281acd4ea7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:27.724856 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a878d9df-85f1-483e-839c-b1eb177a3701 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:27.725247 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a878d9df-85f1-483e-839c-b1eb177a3701 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:27.726668 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a878d9df-85f1-483e-839c-b1eb177a3701 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:27.740851 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a878d9df-85f1-483e-839c-b1eb177a3701 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:27.743102 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a878d9df-85f1-483e-839c-b1eb177a3701 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:27.768602 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1209/2412] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:09:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:09:28.128778 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6442b7-3bca-48a5-bc64-10ffa35a96b3 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:28.130376 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-3f6442b7-3bca-48a5-bc64-10ffa35a96b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:09:28.144981 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6442b7-3bca-48a5-bc64-10ffa35a96b3 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:28.150047 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051c1056-4462-45b7-91a7-3278a71b32c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:28.150722 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051c1056-4462-45b7-91a7-3278a71b32c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:28.151062 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051c1056-4462-45b7-91a7-3278a71b32c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:28.151341 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051c1056-4462-45b7-91a7-3278a71b32c8 admin admin] PATH_INFO: `/v3/projects/b78f03247b4342ef83f75a2f36ffe346` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:28.154173 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c65100-5ade-4d25-af2e-01be02631fa6 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:28.154465 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c65100-5ade-4d25-af2e-01be02631fa6 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:28.154739 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c65100-5ade-4d25-af2e-01be02631fa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:28.161978 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051c1056-4462-45b7-91a7-3278a71b32c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b78f03247b4342ef83f75a2f36ffe346)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:28.165713 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051c1056-4462-45b7-91a7-3278a71b32c8 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:28.176588 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:09:28.213370 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-a7c65100-5ade-4d25-af2e-01be02631fa6 None None] MFA Rules not processed for user `4f32f9bf4a634282bda01c1e2b908186`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:09:28.215515 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-a7c65100-5ade-4d25-af2e-01be02631fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:09:28.235056 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-051c1056-4462-45b7-91a7-3278a71b32c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b78f03247b4342ef83f75a2f36ffe346', 'request_id': 'req-051c1056-4462-45b7-91a7-3278a71b32c8'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:28.249810 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-051c1056-4462-45b7-91a7-3278a71b32c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b78f03247b4342ef83f75a2f36ffe346', 'request_id': 'req-051c1056-4462-45b7-91a7-3278a71b32c8'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:28.265688 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-051c1056-4462-45b7-91a7-3278a71b32c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b78f03247b4342ef83f75a2f36ffe346', 'request_id': 'req-051c1056-4462-45b7-91a7-3278a71b32c8'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:28.285622 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-051c1056-4462-45b7-91a7-3278a71b32c8 admin admin] The token cache is being invalidate because project b78f03247b4342ef83f75a2f36ffe346 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 10:09:28.286413 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-051c1056-4462-45b7-91a7-3278a71b32c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:28.287475 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-051c1056-4462-45b7-91a7-3278a71b32c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:28.290665 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1204/2413] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 10 10:09:28 2022] DELETE /identity/v3/projects/b78f03247b4342ef83f75a2f36ffe346 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:09:28.296801 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee0406-610d-4369-940d-72469193e60a None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:28.297250 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee0406-610d-4369-940d-72469193e60a None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:28.297748 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee0406-610d-4369-940d-72469193e60a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:28.306592 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:09:28.323718 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-36ee0406-610d-4369-940d-72469193e60a None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:09:28.327513 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-36ee0406-610d-4369-940d-72469193e60a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:09:28.329961 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1210/2414] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:09:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:09:28.335063 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c65100-5ade-4d25-af2e-01be02631fa6 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:28.336648 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-a7c65100-5ade-4d25-af2e-01be02631fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:09:28.398878 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1205/2415] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:09:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:09:28.412930 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03df50d-b94b-46fc-9126-c2fd2f82f5ab None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:28.413224 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03df50d-b94b-46fc-9126-c2fd2f82f5ab None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:28.413504 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03df50d-b94b-46fc-9126-c2fd2f82f5ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:28.420584 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c65100-5ade-4d25-af2e-01be02631fa6 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:28.426842 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1e33df-d281-42ae-b73b-1f01e5c0b507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:28.427533 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e33df-d281-42ae-b73b-1f01e5c0b507 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:28.427884 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e33df-d281-42ae-b73b-1f01e5c0b507 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:28.428258 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e33df-d281-42ae-b73b-1f01e5c0b507 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:28.428949 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1e33df-d281-42ae-b73b-1f01e5c0b507 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:28.431249 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1e33df-d281-42ae-b73b-1f01e5c0b507 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:28.436024 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-e03df50d-b94b-46fc-9126-c2fd2f82f5ab None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:09:28.437387 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-e03df50d-b94b-46fc-9126-c2fd2f82f5ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:09:28.446654 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1206/2416] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:09:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:09:28.450805 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03df50d-b94b-46fc-9126-c2fd2f82f5ab None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:28.462867 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03df50d-b94b-46fc-9126-c2fd2f82f5ab None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:28.464162 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1211/2417] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 10 10:09:28 2022] POST /identity/v3/projects => generated 369 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:09:28.468404 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1e33df-d281-42ae-b73b-1f01e5c0b507 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:28.529582 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d77186c-621f-4ac7-b7a8-30c0eaac2c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:28.530935 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d77186c-621f-4ac7-b7a8-30c0eaac2c02 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:28.531381 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d77186c-621f-4ac7-b7a8-30c0eaac2c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:28.531918 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d77186c-621f-4ac7-b7a8-30c0eaac2c02 admin admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:28.532831 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d77186c-621f-4ac7-b7a8-30c0eaac2c02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:09:28.533382 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d77186c-621f-4ac7-b7a8-30c0eaac2c02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:28.535016 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d77186c-621f-4ac7-b7a8-30c0eaac2c02 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:28.547434 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1e33df-d281-42ae-b73b-1f01e5c0b507 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:28.553843 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1207/2418] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 10 10:09:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 10:09:28.557777 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d77186c-621f-4ac7-b7a8-30c0eaac2c02 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:28.562964 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe54f96-dd38-4bec-ae8b-98504b3ac36b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:28.563935 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe54f96-dd38-4bec-ae8b-98504b3ac36b admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:28.564394 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe54f96-dd38-4bec-ae8b-98504b3ac36b admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:28.564485 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe54f96-dd38-4bec-ae8b-98504b3ac36b admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:28.565157 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe54f96-dd38-4bec-ae8b-98504b3ac36b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:28.567760 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe54f96-dd38-4bec-ae8b-98504b3ac36b admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:28.571619 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d77186c-621f-4ac7-b7a8-30c0eaac2c02 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:28.577217 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6a9525-1d09-4f38-b0b2-9a459ebbb794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:28.578153 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6a9525-1d09-4f38-b0b2-9a459ebbb794 admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:28.578694 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6a9525-1d09-4f38-b0b2-9a459ebbb794 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:28.579253 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6a9525-1d09-4f38-b0b2-9a459ebbb794 admin admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:28.580918 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6a9525-1d09-4f38-b0b2-9a459ebbb794 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:28.583140 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6a9525-1d09-4f38-b0b2-9a459ebbb794 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:28.608534 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1212/2419] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 10 10:09:28 2022] POST /identity/v3/users => generated 291 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 10:09:28.612465 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe54f96-dd38-4bec-ae8b-98504b3ac36b admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:28.624541 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe54f96-dd38-4bec-ae8b-98504b3ac36b admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:28.630388 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6627826a-7127-481e-a4ce-2ca3efce46ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:28.631886 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6627826a-7127-481e-a4ce-2ca3efce46ef admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:28.632498 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6627826a-7127-481e-a4ce-2ca3efce46ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:28.632777 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6627826a-7127-481e-a4ce-2ca3efce46ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:28.633769 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6627826a-7127-481e-a4ce-2ca3efce46ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:28.635648 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6627826a-7127-481e-a4ce-2ca3efce46ef admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:28.638827 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:09:28.651135 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1213/2420] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:09:28 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:09:28.655863 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6627826a-7127-481e-a4ce-2ca3efce46ef admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:28.658167 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1208/2421] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 10 10:09:28 2022] POST /identity/v3/projects => generated 363 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:09:28.663534 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6a9525-1d09-4f38-b0b2-9a459ebbb794 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:28.678509 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6627826a-7127-481e-a4ce-2ca3efce46ef admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:28.797698 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50816954-c4d6-4cf5-ae59-2c210dbeb104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:28.798378 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50816954-c4d6-4cf5-ae59-2c210dbeb104 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:28.799172 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50816954-c4d6-4cf5-ae59-2c210dbeb104 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:28.799444 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50816954-c4d6-4cf5-ae59-2c210dbeb104 admin admin] PATH_INFO: `/v3/projects/6d8bda38e6d04d5c8decaf99e60dcf86/users/994d1818878449b7a2bd290dc87256fd/roles/eb04edc46b3742d7a0f0ead26f68bc22` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:28.801092 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6a9525-1d09-4f38-b0b2-9a459ebbb794 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:28.819148 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e7ca75-1699-41fe-a697-04147ebbc99c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:28.820062 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50816954-c4d6-4cf5-ae59-2c210dbeb104 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d8bda38e6d04d5c8decaf99e60dcf86, user_id=994d1818878449b7a2bd290dc87256fd, role_id=eb04edc46b3742d7a0f0ead26f68bc22)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:28.820272 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e7ca75-1699-41fe-a697-04147ebbc99c admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:28.820721 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e7ca75-1699-41fe-a697-04147ebbc99c admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:28.821192 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e7ca75-1699-41fe-a697-04147ebbc99c admin admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:28.822432 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e7ca75-1699-41fe-a697-04147ebbc99c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:28.823496 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50816954-c4d6-4cf5-ae59-2c210dbeb104 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:28.824886 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e7ca75-1699-41fe-a697-04147ebbc99c admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:28.847518 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1214/2422] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:09:28 2022] PUT /identity/v3/projects/6d8bda38e6d04d5c8decaf99e60dcf86/users/994d1818878449b7a2bd290dc87256fd/roles/eb04edc46b3742d7a0f0ead26f68bc22 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:09:28.853771 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50816954-c4d6-4cf5-ae59-2c210dbeb104 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:28.859451 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:09:28.871868 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1209/2423] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 10 10:09:28 2022] POST /identity/v3/users => generated 282 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:09:28.877406 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e7ca75-1699-41fe-a697-04147ebbc99c admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:28.896924 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e7ca75-1699-41fe-a697-04147ebbc99c admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:28.953356 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50816954-c4d6-4cf5-ae59-2c210dbeb104 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:28.958881 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37af972f-89be-4f60-a56d-16e0d577e868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:28.959220 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af972f-89be-4f60-a56d-16e0d577e868 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:28.959484 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af972f-89be-4f60-a56d-16e0d577e868 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:28.959828 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af972f-89be-4f60-a56d-16e0d577e868 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:28.960607 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37af972f-89be-4f60-a56d-16e0d577e868 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:28.962436 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37af972f-89be-4f60-a56d-16e0d577e868 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:28.976257 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1215/2424] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:09:28 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:09:28.981059 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37af972f-89be-4f60-a56d-16e0d577e868 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:29.003436 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37af972f-89be-4f60-a56d-16e0d577e868 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:29.008755 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ff7253-b568-4f2d-a183-3e2e2ad7b326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:29.009569 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ff7253-b568-4f2d-a183-3e2e2ad7b326 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:29.010105 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ff7253-b568-4f2d-a183-3e2e2ad7b326 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:29.010391 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ff7253-b568-4f2d-a183-3e2e2ad7b326 admin admin] PATH_INFO: `/v3/projects/6d8bda38e6d04d5c8decaf99e60dcf86/users/994d1818878449b7a2bd290dc87256fd/roles/eb04edc46b3742d7a0f0ead26f68bc22` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:29.012378 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ff7253-b568-4f2d-a183-3e2e2ad7b326 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d8bda38e6d04d5c8decaf99e60dcf86, user_id=994d1818878449b7a2bd290dc87256fd, role_id=eb04edc46b3742d7a0f0ead26f68bc22)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:29.016956 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ff7253-b568-4f2d-a183-3e2e2ad7b326 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:29.018320 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda30a2c-5a5d-46ca-8f7d-8525771e383c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:29.019274 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda30a2c-5a5d-46ca-8f7d-8525771e383c admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:29.019821 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda30a2c-5a5d-46ca-8f7d-8525771e383c admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:29.020122 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda30a2c-5a5d-46ca-8f7d-8525771e383c admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:29.020780 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda30a2c-5a5d-46ca-8f7d-8525771e383c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:29.023003 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda30a2c-5a5d-46ca-8f7d-8525771e383c admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:29.026603 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1216/2425] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:09:28 2022] PUT /identity/v3/projects/6d8bda38e6d04d5c8decaf99e60dcf86/users/994d1818878449b7a2bd290dc87256fd/roles/eb04edc46b3742d7a0f0ead26f68bc22 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:09:29.037399 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1210/2426] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:09:28 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:09:29.038491 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ff7253-b568-4f2d-a183-3e2e2ad7b326 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:29.111321 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ff7253-b568-4f2d-a183-3e2e2ad7b326 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:29.116404 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261af628-442b-425c-8e15-bce5d9aa44b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:29.116830 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261af628-442b-425c-8e15-bce5d9aa44b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:29.117181 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261af628-442b-425c-8e15-bce5d9aa44b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:29.117453 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261af628-442b-425c-8e15-bce5d9aa44b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:29.118159 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261af628-442b-425c-8e15-bce5d9aa44b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:29.119790 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261af628-442b-425c-8e15-bce5d9aa44b5 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:29.129697 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:09:29.149018 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1217/2427] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:09:29 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 10:09:29.150319 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda30a2c-5a5d-46ca-8f7d-8525771e383c admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:29.163651 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda30a2c-5a5d-46ca-8f7d-8525771e383c admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:29.171856 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb65f7f0-0d1d-4e6b-9a4f-b0d4ed041435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:29.172996 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb65f7f0-0d1d-4e6b-9a4f-b0d4ed041435 admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:29.173357 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb65f7f0-0d1d-4e6b-9a4f-b0d4ed041435 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:29.174044 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb65f7f0-0d1d-4e6b-9a4f-b0d4ed041435 admin admin] PATH_INFO: `/v3/projects/487331b613de4281a8960dc093713854/users/4ec62c8d53f2431bbb5e2ca95d60a81d/roles/8daabcb6b7394e39b06a3453e33e32db` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:29.196860 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb65f7f0-0d1d-4e6b-9a4f-b0d4ed041435 admin admin] RBAC: Authorizing `identity:create_grant(project_id=487331b613de4281a8960dc093713854, user_id=4ec62c8d53f2431bbb5e2ca95d60a81d, role_id=8daabcb6b7394e39b06a3453e33e32db)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:29.201420 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb65f7f0-0d1d-4e6b-9a4f-b0d4ed041435 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:29.239726 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1211/2428] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:09:29 2022] PUT /identity/v3/projects/487331b613de4281a8960dc093713854/users/4ec62c8d53f2431bbb5e2ca95d60a81d/roles/8daabcb6b7394e39b06a3453e33e32db => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:09:29.252266 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d8117c-9ea4-48ea-b2c0-394f12457311 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:29.252973 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d8117c-9ea4-48ea-b2c0-394f12457311 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:29.253395 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d8117c-9ea4-48ea-b2c0-394f12457311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:29.298632 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-48d8117c-9ea4-48ea-b2c0-394f12457311 None None] MFA Rules not processed for user `4ec62c8d53f2431bbb5e2ca95d60a81d`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:09:29.300493 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-48d8117c-9ea4-48ea-b2c0-394f12457311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:09:29.386584 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1218/2429] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:09:29 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:09:29.388161 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb65f7f0-0d1d-4e6b-9a4f-b0d4ed041435 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:29.519602 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb65f7f0-0d1d-4e6b-9a4f-b0d4ed041435 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:29.525118 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce4ab7f-03fb-49d9-bd15-1fb9463365a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:29.525985 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce4ab7f-03fb-49d9-bd15-1fb9463365a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:29.526426 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce4ab7f-03fb-49d9-bd15-1fb9463365a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:29.526862 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce4ab7f-03fb-49d9-bd15-1fb9463365a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:29.527882 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce4ab7f-03fb-49d9-bd15-1fb9463365a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:29.529982 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce4ab7f-03fb-49d9-bd15-1fb9463365a9 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:29.572136 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1212/2430] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 10 10:09:29 2022] POST /identity/v3/projects => generated 363 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:09:29.574472 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d8117c-9ea4-48ea-b2c0-394f12457311 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:29.592021 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d8117c-9ea4-48ea-b2c0-394f12457311 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:29.682508 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe637c98-f507-4c07-9512-7a658c01f1a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:29.683383 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe637c98-f507-4c07-9512-7a658c01f1a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:29.683740 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe637c98-f507-4c07-9512-7a658c01f1a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:29.684083 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe637c98-f507-4c07-9512-7a658c01f1a6 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:29.684906 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe637c98-f507-4c07-9512-7a658c01f1a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:29.687098 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe637c98-f507-4c07-9512-7a658c01f1a6 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:29.714833 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1219/2431] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 10 10:09:29 2022] POST /identity/v3/users => generated 288 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:09:29.718692 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce4ab7f-03fb-49d9-bd15-1fb9463365a9 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:29.730822 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce4ab7f-03fb-49d9-bd15-1fb9463365a9 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:29.737034 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f582ac-3eb8-4d46-8496-7d396b916fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:29.738126 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f582ac-3eb8-4d46-8496-7d396b916fcb admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:29.739373 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f582ac-3eb8-4d46-8496-7d396b916fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:29.739819 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f582ac-3eb8-4d46-8496-7d396b916fcb admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:29.740793 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f582ac-3eb8-4d46-8496-7d396b916fcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:29.742859 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f582ac-3eb8-4d46-8496-7d396b916fcb admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:29.760691 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1213/2432] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:09:29 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:09:29.762096 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe637c98-f507-4c07-9512-7a658c01f1a6 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:29.775337 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe637c98-f507-4c07-9512-7a658c01f1a6 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:29.780584 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067a8ef5-4dd7-40e3-817c-0a93c50b152f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:29.781702 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067a8ef5-4dd7-40e3-817c-0a93c50b152f admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:29.782123 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067a8ef5-4dd7-40e3-817c-0a93c50b152f admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:29.782764 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067a8ef5-4dd7-40e3-817c-0a93c50b152f admin admin] PATH_INFO: `/v3/projects/ae3137da17a14756966c0501040ecd3e/users/a8fd7184cb7e43a783ea5c1458cdfaaa/roles/eb04edc46b3742d7a0f0ead26f68bc22` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:29.802021 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067a8ef5-4dd7-40e3-817c-0a93c50b152f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae3137da17a14756966c0501040ecd3e, user_id=a8fd7184cb7e43a783ea5c1458cdfaaa, role_id=eb04edc46b3742d7a0f0ead26f68bc22)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:29.805436 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067a8ef5-4dd7-40e3-817c-0a93c50b152f admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:29.824654 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1220/2433] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:09:29 2022] PUT /identity/v3/projects/ae3137da17a14756966c0501040ecd3e/users/a8fd7184cb7e43a783ea5c1458cdfaaa/roles/eb04edc46b3742d7a0f0ead26f68bc22 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:09:29.828850 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f582ac-3eb8-4d46-8496-7d396b916fcb admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:29.846532 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f582ac-3eb8-4d46-8496-7d396b916fcb admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:29.954533 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:09:29.994254 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2191227-2776-45ee-8649-ea73f9bef679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:29.994894 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2191227-2776-45ee-8649-ea73f9bef679 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:29.995588 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2191227-2776-45ee-8649-ea73f9bef679 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:29.995588 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2191227-2776-45ee-8649-ea73f9bef679 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:29.996858 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2191227-2776-45ee-8649-ea73f9bef679 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:29.998556 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2191227-2776-45ee-8649-ea73f9bef679 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:30.025160 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1214/2434] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:09:29 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:09:30.026511 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067a8ef5-4dd7-40e3-817c-0a93c50b152f admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:30.043608 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067a8ef5-4dd7-40e3-817c-0a93c50b152f admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:30.053952 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c5bcd5-4650-47b5-ab8a-90843329c02b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:30.054643 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c5bcd5-4650-47b5-ab8a-90843329c02b admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:30.057926 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c5bcd5-4650-47b5-ab8a-90843329c02b admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:30.058235 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c5bcd5-4650-47b5-ab8a-90843329c02b admin admin] PATH_INFO: `/v3/projects/ae3137da17a14756966c0501040ecd3e/users/a8fd7184cb7e43a783ea5c1458cdfaaa/roles/eb04edc46b3742d7a0f0ead26f68bc22` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:30.066203 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c5bcd5-4650-47b5-ab8a-90843329c02b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae3137da17a14756966c0501040ecd3e, user_id=a8fd7184cb7e43a783ea5c1458cdfaaa, role_id=eb04edc46b3742d7a0f0ead26f68bc22)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:30.070502 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c5bcd5-4650-47b5-ab8a-90843329c02b admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:30.091433 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1221/2435] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:09:30 2022] PUT /identity/v3/projects/ae3137da17a14756966c0501040ecd3e/users/a8fd7184cb7e43a783ea5c1458cdfaaa/roles/eb04edc46b3742d7a0f0ead26f68bc22 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:09:30.102561 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eae117-b2c9-496f-a249-89626b21612c None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:30.102885 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eae117-b2c9-496f-a249-89626b21612c None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:30.103116 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eae117-b2c9-496f-a249-89626b21612c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:30.151595 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-94eae117-b2c9-496f-a249-89626b21612c None None] MFA Rules not processed for user `a8fd7184cb7e43a783ea5c1458cdfaaa`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:09:30.152841 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-94eae117-b2c9-496f-a249-89626b21612c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:09:30.277194 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1215/2436] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:09:30 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:09:30.285927 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c5bcd5-4650-47b5-ab8a-90843329c02b admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:30.288082 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-e9c5bcd5-4650-47b5-ab8a-90843329c02b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:09:30.392858 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:09:30.412956 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c5bcd5-4650-47b5-ab8a-90843329c02b admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:30.421107 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c68d379-2cc2-423e-bc68-1f428c171849 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf8e725cbe0403d943b136235eac057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:30.421965 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c68d379-2cc2-423e-bc68-1f428c171849 service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:30.422306 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c68d379-2cc2-423e-bc68-1f428c171849 service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:30.422662 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c68d379-2cc2-423e-bc68-1f428c171849 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:30.435037 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c68d379-2cc2-423e-bc68-1f428c171849 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:30.437028 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c68d379-2cc2-423e-bc68-1f428c171849 service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:30.450224 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1222/2437] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:09:30 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:09:30.576414 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eae117-b2c9-496f-a249-89626b21612c None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:30.597430 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eae117-b2c9-496f-a249-89626b21612c None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:30.611382 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59509b97-366a-4250-9de9-0f8bb4644e05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf8e725cbe0403d943b136235eac057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:30.612089 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59509b97-366a-4250-9de9-0f8bb4644e05 service cinder] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:30.612376 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59509b97-366a-4250-9de9-0f8bb4644e05 service cinder] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:30.612661 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59509b97-366a-4250-9de9-0f8bb4644e05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:30.756947 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59509b97-366a-4250-9de9-0f8bb4644e05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:30.762536 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59509b97-366a-4250-9de9-0f8bb4644e05 service cinder] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:30.785957 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1216/2438] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:09:30 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:09:34.059086 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c68d379-2cc2-423e-bc68-1f428c171849 service cinder] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:34.183348 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c68d379-2cc2-423e-bc68-1f428c171849 service cinder] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:34.200705 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ca729-810b-4d10-b438-23a8b54f4e06 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:34.201221 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ca729-810b-4d10-b438-23a8b54f4e06 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:34.201358 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ca729-810b-4d10-b438-23a8b54f4e06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:34.208316 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e141c0a3-42f0-4fc1-82f2-cfab9cbf7bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:34.211116 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e141c0a3-42f0-4fc1-82f2-cfab9cbf7bcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:34.211496 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e141c0a3-42f0-4fc1-82f2-cfab9cbf7bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:34.211846 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e141c0a3-42f0-4fc1-82f2-cfab9cbf7bcf admin admin] PATH_INFO: `/v3/users/4ec62c8d53f2431bbb5e2ca95d60a81d` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:34.213446 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e141c0a3-42f0-4fc1-82f2-cfab9cbf7bcf admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ec62c8d53f2431bbb5e2ca95d60a81d)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:34.216689 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e141c0a3-42f0-4fc1-82f2-cfab9cbf7bcf admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:34.243183 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-830ca729-810b-4d10-b438-23a8b54f4e06 None None] MFA Rules not processed for user `994d1818878449b7a2bd290dc87256fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:09:34.244790 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-830ca729-810b-4d10-b438-23a8b54f4e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:09:34.287371 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-e141c0a3-42f0-4fc1-82f2-cfab9cbf7bcf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ec62c8d53f2431bbb5e2ca95d60a81d'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:34.299524 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-e141c0a3-42f0-4fc1-82f2-cfab9cbf7bcf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ec62c8d53f2431bbb5e2ca95d60a81d'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:34.300488 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-e141c0a3-42f0-4fc1-82f2-cfab9cbf7bcf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ec62c8d53f2431bbb5e2ca95d60a81d'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:34.301646 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-e141c0a3-42f0-4fc1-82f2-cfab9cbf7bcf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ec62c8d53f2431bbb5e2ca95d60a81d'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:34.316577 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-e141c0a3-42f0-4fc1-82f2-cfab9cbf7bcf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ec62c8d53f2431bbb5e2ca95d60a81d'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:34.321458 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:09:34.342050 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1223/2439] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 10 10:09:34 2022] DELETE /identity/v3/users/4ec62c8d53f2431bbb5e2ca95d60a81d => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:09:34.346995 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7714b98a-e851-41cc-825c-a2ff34e929a7 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:34.346995 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7714b98a-e851-41cc-825c-a2ff34e929a7 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:34.346995 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7714b98a-e851-41cc-825c-a2ff34e929a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:34.351588 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1217/2440] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:09:34 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 10:09:34.366462 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830ca729-810b-4d10-b438-23a8b54f4e06 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:34.368204 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-830ca729-810b-4d10-b438-23a8b54f4e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:09:34.369140 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-7714b98a-e851-41cc-825c-a2ff34e929a7 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:09:34.370539 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-7714b98a-e851-41cc-825c-a2ff34e929a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:09:34.454395 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1224/2441] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:09:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:09:34.463567 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7714b98a-e851-41cc-825c-a2ff34e929a7 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:34.465222 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-7714b98a-e851-41cc-825c-a2ff34e929a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:09:34.471448 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830ca729-810b-4d10-b438-23a8b54f4e06 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:34.474910 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:09:34.545467 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7714b98a-e851-41cc-825c-a2ff34e929a7 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:34.550535 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97a48f5-94c0-4828-80b9-3d47f66e15d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4294c170df354fe892831281acd4ea7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:34.551303 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a48f5-94c0-4828-80b9-3d47f66e15d1 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:34.551751 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a48f5-94c0-4828-80b9-3d47f66e15d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:34.552030 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a48f5-94c0-4828-80b9-3d47f66e15d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:34.561965 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97a48f5-94c0-4828-80b9-3d47f66e15d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:34.563503 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97a48f5-94c0-4828-80b9-3d47f66e15d1 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:34.565164 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbb10ac-d63a-4e5c-8703-634a7679b179 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd8580888cba41a88566da4540b1130c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:34.565794 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb10ac-d63a-4e5c-8703-634a7679b179 service nova] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:34.566075 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb10ac-d63a-4e5c-8703-634a7679b179 service nova] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:34.566349 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb10ac-d63a-4e5c-8703-634a7679b179 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:34.568189 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-acbb10ac-d63a-4e5c-8703-634a7679b179 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:09:34.575805 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1225/2442] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:09:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:09:34.634896 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbb10ac-d63a-4e5c-8703-634a7679b179 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:34.636574 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbb10ac-d63a-4e5c-8703-634a7679b179 service nova] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:34.647434 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1218/2443] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:09:34 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:09:34.898778 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97a48f5-94c0-4828-80b9-3d47f66e15d1 service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:34.900501 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-c97a48f5-94c0-4828-80b9-3d47f66e15d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:09:34.915810 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97a48f5-94c0-4828-80b9-3d47f66e15d1 service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:34.922161 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853a7736-f363-4650-9e05-0cc5ed869a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:34.923002 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853a7736-f363-4650-9e05-0cc5ed869a07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:34.923431 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853a7736-f363-4650-9e05-0cc5ed869a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:34.924243 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853a7736-f363-4650-9e05-0cc5ed869a07 admin admin] PATH_INFO: `/v3/projects/487331b613de4281a8960dc093713854` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:34.925482 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853a7736-f363-4650-9e05-0cc5ed869a07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=487331b613de4281a8960dc093713854)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:34.927463 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853a7736-f363-4650-9e05-0cc5ed869a07 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:34.981750 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-853a7736-f363-4650-9e05-0cc5ed869a07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '487331b613de4281a8960dc093713854', 'request_id': 'req-853a7736-f363-4650-9e05-0cc5ed869a07'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:34.988134 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-853a7736-f363-4650-9e05-0cc5ed869a07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '487331b613de4281a8960dc093713854', 'request_id': 'req-853a7736-f363-4650-9e05-0cc5ed869a07'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:34.997024 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-853a7736-f363-4650-9e05-0cc5ed869a07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '487331b613de4281a8960dc093713854', 'request_id': 'req-853a7736-f363-4650-9e05-0cc5ed869a07'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:35.009998 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-853a7736-f363-4650-9e05-0cc5ed869a07 admin admin] The token cache is being invalidate because project 487331b613de4281a8960dc093713854 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 10:09:35.010292 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-853a7736-f363-4650-9e05-0cc5ed869a07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:35.011046 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-853a7736-f363-4650-9e05-0cc5ed869a07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:35.012662 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1226/2444] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 10 10:09:34 2022] DELETE /identity/v3/projects/487331b613de4281a8960dc093713854 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:09:35.017360 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbb10ac-d63a-4e5c-8703-634a7679b179 service nova] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:35.028296 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbb10ac-d63a-4e5c-8703-634a7679b179 service nova] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:35.055504 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:09:35.093146 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853a7736-f363-4650-9e05-0cc5ed869a07 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:35.095288 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-853a7736-f363-4650-9e05-0cc5ed869a07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:09:35.104246 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a235d44-743d-4894-89da-eea6175308be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:35.104890 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a235d44-743d-4894-89da-eea6175308be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:35.105205 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a235d44-743d-4894-89da-eea6175308be admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:35.105477 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a235d44-743d-4894-89da-eea6175308be admin admin] PATH_INFO: `/v3/users/a8fd7184cb7e43a783ea5c1458cdfaaa` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:35.106629 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a235d44-743d-4894-89da-eea6175308be admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8fd7184cb7e43a783ea5c1458cdfaaa)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:35.108639 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a235d44-743d-4894-89da-eea6175308be admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:35.159012 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853a7736-f363-4650-9e05-0cc5ed869a07 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:35.162987 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3d081a-90e6-498d-aaa4-e6247ef61bb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4294c170df354fe892831281acd4ea7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:35.163701 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3d081a-90e6-498d-aaa4-e6247ef61bb4 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:35.164099 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3d081a-90e6-498d-aaa4-e6247ef61bb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:35.164391 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3d081a-90e6-498d-aaa4-e6247ef61bb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:35.165831 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-3a235d44-743d-4894-89da-eea6175308be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8fd7184cb7e43a783ea5c1458cdfaaa'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:35.166690 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-ff3d081a-90e6-498d-aaa4-e6247ef61bb4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:09:35.176320 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-3a235d44-743d-4894-89da-eea6175308be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8fd7184cb7e43a783ea5c1458cdfaaa'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:35.185909 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3d081a-90e6-498d-aaa4-e6247ef61bb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:35.186254 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-3a235d44-743d-4894-89da-eea6175308be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8fd7184cb7e43a783ea5c1458cdfaaa'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:35.187113 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-3a235d44-743d-4894-89da-eea6175308be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8fd7184cb7e43a783ea5c1458cdfaaa'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:35.187977 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-3a235d44-743d-4894-89da-eea6175308be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8fd7184cb7e43a783ea5c1458cdfaaa'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:35.188090 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3d081a-90e6-498d-aaa4-e6247ef61bb4 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:35.204287 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1227/2445] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:09:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 10:09:35.216252 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1219/2446] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 10 10:09:35 2022] DELETE /identity/v3/users/a8fd7184cb7e43a783ea5c1458cdfaaa => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:09:35.524035 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3d081a-90e6-498d-aaa4-e6247ef61bb4 service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:35.525812 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-ff3d081a-90e6-498d-aaa4-e6247ef61bb4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:09:35.542628 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3d081a-90e6-498d-aaa4-e6247ef61bb4 service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:35.580691 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:09:35.609994 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a728f79-7c9e-40b1-ab46-cc0aa0147a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:35.611212 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a728f79-7c9e-40b1-ab46-cc0aa0147a2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:35.611492 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a728f79-7c9e-40b1-ab46-cc0aa0147a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:35.611757 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a728f79-7c9e-40b1-ab46-cc0aa0147a2d admin admin] PATH_INFO: `/v3/projects/ae3137da17a14756966c0501040ecd3e` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:35.612945 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a728f79-7c9e-40b1-ab46-cc0aa0147a2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae3137da17a14756966c0501040ecd3e)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:35.614938 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a728f79-7c9e-40b1-ab46-cc0aa0147a2d admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:35.666590 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-9a728f79-7c9e-40b1-ab46-cc0aa0147a2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae3137da17a14756966c0501040ecd3e', 'request_id': 'req-9a728f79-7c9e-40b1-ab46-cc0aa0147a2d'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:35.687097 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-9a728f79-7c9e-40b1-ab46-cc0aa0147a2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae3137da17a14756966c0501040ecd3e', 'request_id': 'req-9a728f79-7c9e-40b1-ab46-cc0aa0147a2d'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:35.697972 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-9a728f79-7c9e-40b1-ab46-cc0aa0147a2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae3137da17a14756966c0501040ecd3e', 'request_id': 'req-9a728f79-7c9e-40b1-ab46-cc0aa0147a2d'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:35.710558 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-9a728f79-7c9e-40b1-ab46-cc0aa0147a2d admin admin] The token cache is being invalidate because project ae3137da17a14756966c0501040ecd3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 10:09:35.710928 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-9a728f79-7c9e-40b1-ab46-cc0aa0147a2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:35.711703 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-9a728f79-7c9e-40b1-ab46-cc0aa0147a2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:35.713594 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1228/2447] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 10 10:09:35 2022] DELETE /identity/v3/projects/ae3137da17a14756966c0501040ecd3e => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:09:35.718548 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745d8e93-40bd-4670-a230-14bdf632a87a None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:35.718827 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745d8e93-40bd-4670-a230-14bdf632a87a None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:35.719101 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745d8e93-40bd-4670-a230-14bdf632a87a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:35.744291 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-745d8e93-40bd-4670-a230-14bdf632a87a None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:09:35.745622 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-745d8e93-40bd-4670-a230-14bdf632a87a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:09:35.813709 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1220/2448] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:09:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:09:35.823659 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a31f1b-eaaa-4279-827e-02ca6e21064b None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:35.823977 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a31f1b-eaaa-4279-827e-02ca6e21064b None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:35.824219 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a31f1b-eaaa-4279-827e-02ca6e21064b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:35.846698 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-64a31f1b-eaaa-4279-827e-02ca6e21064b None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:09:35.848945 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-64a31f1b-eaaa-4279-827e-02ca6e21064b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:09:35.872446 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1229/2449] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:09:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:09:35.873428 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745d8e93-40bd-4670-a230-14bdf632a87a None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:35.886798 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745d8e93-40bd-4670-a230-14bdf632a87a None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:35.892767 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaebac08-add0-4622-9dac-884ec018bfca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:35.893420 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaebac08-add0-4622-9dac-884ec018bfca admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:35.893697 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaebac08-add0-4622-9dac-884ec018bfca admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:35.894774 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaebac08-add0-4622-9dac-884ec018bfca admin admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:35.895448 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaebac08-add0-4622-9dac-884ec018bfca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:09:35.895750 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaebac08-add0-4622-9dac-884ec018bfca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:35.899019 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaebac08-add0-4622-9dac-884ec018bfca admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:35.943064 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1221/2450] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 10 10:09:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 10:09:35.947023 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a31f1b-eaaa-4279-827e-02ca6e21064b None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:35.958073 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a31f1b-eaaa-4279-827e-02ca6e21064b None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:35.972971 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46470764-6faa-4a7f-b208-9b86932fa043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:35.973572 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46470764-6faa-4a7f-b208-9b86932fa043 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:35.973897 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46470764-6faa-4a7f-b208-9b86932fa043 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:35.974179 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46470764-6faa-4a7f-b208-9b86932fa043 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:35.974843 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46470764-6faa-4a7f-b208-9b86932fa043 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:35.976913 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46470764-6faa-4a7f-b208-9b86932fa043 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:36.039412 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1230/2451] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 10 10:09:35 2022] POST /identity/v3/projects => generated 379 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:09:36.043624 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaebac08-add0-4622-9dac-884ec018bfca admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:36.057581 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaebac08-add0-4622-9dac-884ec018bfca admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:36.114430 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:09:36.160805 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666e3778-80b9-4a67-827a-9907b2c3b6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:36.161585 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666e3778-80b9-4a67-827a-9907b2c3b6d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:36.161864 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666e3778-80b9-4a67-827a-9907b2c3b6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:36.162206 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666e3778-80b9-4a67-827a-9907b2c3b6d1 admin admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:36.162942 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666e3778-80b9-4a67-827a-9907b2c3b6d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:36.165039 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666e3778-80b9-4a67-827a-9907b2c3b6d1 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:36.177609 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891f0b1b-1bc6-41b3-aecb-b6993ba13fdc None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:36.178170 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891f0b1b-1bc6-41b3-aecb-b6993ba13fdc None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:36.178170 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891f0b1b-1bc6-41b3-aecb-b6993ba13fdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:36.194556 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1222/2452] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 10 10:09:36 2022] POST /identity/v3/users => generated 290 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 10:09:36.195561 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666e3778-80b9-4a67-827a-9907b2c3b6d1 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:36.204811 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-891f0b1b-1bc6-41b3-aecb-b6993ba13fdc None None] MFA Rules not processed for user `4f32f9bf4a634282bda01c1e2b908186`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:09:36.206256 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666e3778-80b9-4a67-827a-9907b2c3b6d1 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:36.207001 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-891f0b1b-1bc6-41b3-aecb-b6993ba13fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:09:36.211223 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f864cb56-f5e3-4934-9521-cb73452e34d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:36.211924 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f864cb56-f5e3-4934-9521-cb73452e34d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:36.212376 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f864cb56-f5e3-4934-9521-cb73452e34d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:36.212758 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f864cb56-f5e3-4934-9521-cb73452e34d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:36.213871 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f864cb56-f5e3-4934-9521-cb73452e34d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:36.215938 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f864cb56-f5e3-4934-9521-cb73452e34d1 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:36.229305 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1223/2453] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:09:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:09:36.234652 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f864cb56-f5e3-4934-9521-cb73452e34d1 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:36.247827 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f864cb56-f5e3-4934-9521-cb73452e34d1 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:36.253433 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d78c9c-0458-41ea-ae54-76c65a1407ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:36.254281 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d78c9c-0458-41ea-ae54-76c65a1407ff admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:36.254714 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d78c9c-0458-41ea-ae54-76c65a1407ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:36.255155 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d78c9c-0458-41ea-ae54-76c65a1407ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:36.256050 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d78c9c-0458-41ea-ae54-76c65a1407ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:36.257860 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d78c9c-0458-41ea-ae54-76c65a1407ff admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:36.271891 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1224/2454] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:09:36 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:09:36.272994 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d78c9c-0458-41ea-ae54-76c65a1407ff admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:36.285938 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d78c9c-0458-41ea-ae54-76c65a1407ff admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:36.292024 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52a904d-0755-4241-a605-9c739ce664ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:36.292691 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52a904d-0755-4241-a605-9c739ce664ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:36.292973 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52a904d-0755-4241-a605-9c739ce664ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:36.293672 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52a904d-0755-4241-a605-9c739ce664ca admin admin] PATH_INFO: `/v3/projects/7ada0c55ab76484eaa29d1c0b21f247b/users/a5415d9233c84d0eafc44c5f11ce7fe0/roles/8daabcb6b7394e39b06a3453e33e32db` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:36.305419 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1231/2455] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:09:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 10:09:36.314441 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52a904d-0755-4241-a605-9c739ce664ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ada0c55ab76484eaa29d1c0b21f247b, user_id=a5415d9233c84d0eafc44c5f11ce7fe0, role_id=8daabcb6b7394e39b06a3453e33e32db)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:36.317442 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52a904d-0755-4241-a605-9c739ce664ca admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:36.339967 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1225/2456] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:09:36 2022] PUT /identity/v3/projects/7ada0c55ab76484eaa29d1c0b21f247b/users/a5415d9233c84d0eafc44c5f11ce7fe0/roles/8daabcb6b7394e39b06a3453e33e32db => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:09:36.351143 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8e4e47-ab7f-4a10-986e-aaba4416509e None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:36.351724 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8e4e47-ab7f-4a10-986e-aaba4416509e None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:36.352139 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8e4e47-ab7f-4a10-986e-aaba4416509e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:36.393571 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-7b8e4e47-ab7f-4a10-986e-aaba4416509e None None] MFA Rules not processed for user `a5415d9233c84d0eafc44c5f11ce7fe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:09:36.395385 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-7b8e4e47-ab7f-4a10-986e-aaba4416509e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:09:36.446762 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:09:36.507623 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1232/2457] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:09:36 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:09:36.512255 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52a904d-0755-4241-a605-9c739ce664ca admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:36.637943 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52a904d-0755-4241-a605-9c739ce664ca admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:36.646267 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4091948-b009-4a2e-bcb9-09ad8f2b45c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:36.646990 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4091948-b009-4a2e-bcb9-09ad8f2b45c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:36.647322 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4091948-b009-4a2e-bcb9-09ad8f2b45c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:36.647627 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4091948-b009-4a2e-bcb9-09ad8f2b45c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:36.648350 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4091948-b009-4a2e-bcb9-09ad8f2b45c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:36.650903 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4091948-b009-4a2e-bcb9-09ad8f2b45c0 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:36.704705 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8e4e47-ab7f-4a10-986e-aaba4416509e None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:36.705551 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1226/2458] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 10 10:09:36 2022] POST /identity/v3/projects => generated 377 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:09:36.721414 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8e4e47-ab7f-4a10-986e-aaba4416509e None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:36.836444 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f431c048-55e2-417b-bd28-b1f28782858f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:36.838018 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f431c048-55e2-417b-bd28-b1f28782858f admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:36.838018 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f431c048-55e2-417b-bd28-b1f28782858f admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:36.838289 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f431c048-55e2-417b-bd28-b1f28782858f admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:36.838975 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f431c048-55e2-417b-bd28-b1f28782858f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:36.841116 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f431c048-55e2-417b-bd28-b1f28782858f admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:36.867473 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1233/2459] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 10 10:09:36 2022] POST /identity/v3/users => generated 295 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:09:36.871243 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4091948-b009-4a2e-bcb9-09ad8f2b45c0 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:36.884130 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4091948-b009-4a2e-bcb9-09ad8f2b45c0 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:36.899121 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a8a08f-ccbb-4802-bd12-016e9bf21bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:36.901720 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a8a08f-ccbb-4802-bd12-016e9bf21bd1 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:36.902033 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a8a08f-ccbb-4802-bd12-016e9bf21bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:36.902315 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a8a08f-ccbb-4802-bd12-016e9bf21bd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:36.903008 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a8a08f-ccbb-4802-bd12-016e9bf21bd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:36.906851 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a8a08f-ccbb-4802-bd12-016e9bf21bd1 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:36.922736 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1227/2460] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:09:36 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:09:36.927874 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f431c048-55e2-417b-bd28-b1f28782858f admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:36.940507 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f431c048-55e2-417b-bd28-b1f28782858f admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:36.945748 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0a149e-cb5c-4e2d-93de-d1559acb6633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:36.946775 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0a149e-cb5c-4e2d-93de-d1559acb6633 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:36.947185 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0a149e-cb5c-4e2d-93de-d1559acb6633 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:36.947368 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0a149e-cb5c-4e2d-93de-d1559acb6633 admin admin] PATH_INFO: `/v3/projects/5789b75d552545429d4258e8df302221/users/c7dc1dbf154f4b14bc62e42d14b82802/roles/eb04edc46b3742d7a0f0ead26f68bc22` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:36.968843 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0a149e-cb5c-4e2d-93de-d1559acb6633 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5789b75d552545429d4258e8df302221, user_id=c7dc1dbf154f4b14bc62e42d14b82802, role_id=eb04edc46b3742d7a0f0ead26f68bc22)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:36.972736 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0a149e-cb5c-4e2d-93de-d1559acb6633 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:36.990666 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1234/2461] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:09:36 2022] PUT /identity/v3/projects/5789b75d552545429d4258e8df302221/users/c7dc1dbf154f4b14bc62e42d14b82802/roles/eb04edc46b3742d7a0f0ead26f68bc22 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:09:36.994655 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a8a08f-ccbb-4802-bd12-016e9bf21bd1 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:37.007185 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a8a08f-ccbb-4802-bd12-016e9bf21bd1 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:37.057901 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:09:37.075157 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa0b1a2-9ede-4569-a063-85856976b3b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:37.075376 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa0b1a2-9ede-4569-a063-85856976b3b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:37.075535 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa0b1a2-9ede-4569-a063-85856976b3b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:37.075793 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa0b1a2-9ede-4569-a063-85856976b3b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:37.076483 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa0b1a2-9ede-4569-a063-85856976b3b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:37.078152 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa0b1a2-9ede-4569-a063-85856976b3b6 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:37.091841 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1228/2462] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:09:36 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 10:09:37.093612 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0a149e-cb5c-4e2d-93de-d1559acb6633 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:37.106718 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0a149e-cb5c-4e2d-93de-d1559acb6633 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:37.115961 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d0d131-872b-45ba-a36b-73ee93957920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:37.117982 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d0d131-872b-45ba-a36b-73ee93957920 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:37.117982 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d0d131-872b-45ba-a36b-73ee93957920 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:37.118183 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d0d131-872b-45ba-a36b-73ee93957920 admin admin] PATH_INFO: `/v3/projects/5789b75d552545429d4258e8df302221/users/c7dc1dbf154f4b14bc62e42d14b82802/roles/eb04edc46b3742d7a0f0ead26f68bc22` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:37.120166 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d0d131-872b-45ba-a36b-73ee93957920 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5789b75d552545429d4258e8df302221, user_id=c7dc1dbf154f4b14bc62e42d14b82802, role_id=eb04edc46b3742d7a0f0ead26f68bc22)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:37.127700 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d0d131-872b-45ba-a36b-73ee93957920 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:37.142143 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1235/2463] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:09:37 2022] PUT /identity/v3/projects/5789b75d552545429d4258e8df302221/users/c7dc1dbf154f4b14bc62e42d14b82802/roles/eb04edc46b3742d7a0f0ead26f68bc22 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 10:09:37.152255 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21da0e92-ba88-49bf-b561-f7ea32fe613a None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:37.152555 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21da0e92-ba88-49bf-b561-f7ea32fe613a None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:37.152958 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21da0e92-ba88-49bf-b561-f7ea32fe613a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:37.233548 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-21da0e92-ba88-49bf-b561-f7ea32fe613a None None] MFA Rules not processed for user `c7dc1dbf154f4b14bc62e42d14b82802`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:09:37.249769 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-21da0e92-ba88-49bf-b561-f7ea32fe613a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:09:37.356526 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1229/2464] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:09:37 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:09:37.374975 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d0d131-872b-45ba-a36b-73ee93957920 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:37.378926 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-a6d0d131-872b-45ba-a36b-73ee93957920 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:09:37.491386 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d0d131-872b-45ba-a36b-73ee93957920 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:37.498684 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b83f54-c6c9-48b9-b831-a4134faf05fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf8e725cbe0403d943b136235eac057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:37.499593 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b83f54-c6c9-48b9-b831-a4134faf05fe service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:37.499876 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b83f54-c6c9-48b9-b831-a4134faf05fe service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:37.500374 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b83f54-c6c9-48b9-b831-a4134faf05fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:37.550362 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:09:37.596479 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b83f54-c6c9-48b9-b831-a4134faf05fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:37.598165 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b83f54-c6c9-48b9-b831-a4134faf05fe service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:37.608859 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1236/2465] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:09:37 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:09:39.169630 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21da0e92-ba88-49bf-b561-f7ea32fe613a None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:39.184776 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21da0e92-ba88-49bf-b561-f7ea32fe613a None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:39.189472 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c599ab18-af70-42bd-a7c6-9b4f4103f8cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf8e725cbe0403d943b136235eac057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:39.190666 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c599ab18-af70-42bd-a7c6-9b4f4103f8cd service cinder] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:39.190994 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c599ab18-af70-42bd-a7c6-9b4f4103f8cd service cinder] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:39.191266 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c599ab18-af70-42bd-a7c6-9b4f4103f8cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:39.204836 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c599ab18-af70-42bd-a7c6-9b4f4103f8cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:39.206540 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c599ab18-af70-42bd-a7c6-9b4f4103f8cd service cinder] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:39.225295 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1230/2466] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:09:39 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:09:39.374967 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b83f54-c6c9-48b9-b831-a4134faf05fe service cinder] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:39.376714 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-69b83f54-c6c9-48b9-b831-a4134faf05fe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:09:39.480578 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b83f54-c6c9-48b9-b831-a4134faf05fe service cinder] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:39.485741 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41969227-7f99-49ee-bcd0-8445cc851890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:39.486381 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41969227-7f99-49ee-bcd0-8445cc851890 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:39.486659 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41969227-7f99-49ee-bcd0-8445cc851890 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:39.486931 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41969227-7f99-49ee-bcd0-8445cc851890 admin admin] PATH_INFO: `/v3/users/05de322f3f174bc195a58a108c9387da` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:39.488060 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41969227-7f99-49ee-bcd0-8445cc851890 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05de322f3f174bc195a58a108c9387da)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:39.490112 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41969227-7f99-49ee-bcd0-8445cc851890 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:39.545221 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-41969227-7f99-49ee-bcd0-8445cc851890 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05de322f3f174bc195a58a108c9387da'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:39.559930 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-41969227-7f99-49ee-bcd0-8445cc851890 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05de322f3f174bc195a58a108c9387da'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:39.560479 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-41969227-7f99-49ee-bcd0-8445cc851890 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05de322f3f174bc195a58a108c9387da'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:39.561097 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-41969227-7f99-49ee-bcd0-8445cc851890 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05de322f3f174bc195a58a108c9387da'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:39.568638 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-41969227-7f99-49ee-bcd0-8445cc851890 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05de322f3f174bc195a58a108c9387da'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:39.590150 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1237/2467] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 10 10:09:39 2022] DELETE /identity/v3/users/05de322f3f174bc195a58a108c9387da => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:09:39.780434 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c599ab18-af70-42bd-a7c6-9b4f4103f8cd service cinder] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:39.797038 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c599ab18-af70-42bd-a7c6-9b4f4103f8cd service cinder] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:39.864229 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4541245-b20e-4014-b3b1-9431df3b6b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:39.864767 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4541245-b20e-4014-b3b1-9431df3b6b14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:39.865044 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4541245-b20e-4014-b3b1-9431df3b6b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:39.865345 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4541245-b20e-4014-b3b1-9431df3b6b14 admin admin] PATH_INFO: `/v3/projects/395bed1440b44404bbc7e0ef11836f12` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:39.866525 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4541245-b20e-4014-b3b1-9431df3b6b14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=395bed1440b44404bbc7e0ef11836f12)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:39.868437 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4541245-b20e-4014-b3b1-9431df3b6b14 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:39.919707 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-f4541245-b20e-4014-b3b1-9431df3b6b14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '395bed1440b44404bbc7e0ef11836f12', 'request_id': 'req-f4541245-b20e-4014-b3b1-9431df3b6b14'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:39.927028 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-f4541245-b20e-4014-b3b1-9431df3b6b14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '395bed1440b44404bbc7e0ef11836f12', 'request_id': 'req-f4541245-b20e-4014-b3b1-9431df3b6b14'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:39.928698 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:09:39.937774 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-f4541245-b20e-4014-b3b1-9431df3b6b14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '395bed1440b44404bbc7e0ef11836f12', 'request_id': 'req-f4541245-b20e-4014-b3b1-9431df3b6b14'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:39.951064 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-f4541245-b20e-4014-b3b1-9431df3b6b14 admin admin] The token cache is being invalidate because project 395bed1440b44404bbc7e0ef11836f12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 10:09:39.951362 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-f4541245-b20e-4014-b3b1-9431df3b6b14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:39.952095 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-f4541245-b20e-4014-b3b1-9431df3b6b14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:39.953739 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1231/2468] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 10 10:09:39 2022] DELETE /identity/v3/projects/395bed1440b44404bbc7e0ef11836f12 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:09:39.958796 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d6255c-b1c0-468e-8846-04ce7249dcea None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:39.959084 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d6255c-b1c0-468e-8846-04ce7249dcea None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:39.959442 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d6255c-b1c0-468e-8846-04ce7249dcea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:39.986885 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-37d6255c-b1c0-468e-8846-04ce7249dcea None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:09:39.988294 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-37d6255c-b1c0-468e-8846-04ce7249dcea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:09:40.036368 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:09:40.054201 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1238/2469] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:09:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:09:40.062299 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea5e53b-ad7a-4105-8716-96dbe41fd9f0 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:40.062584 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea5e53b-ad7a-4105-8716-96dbe41fd9f0 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:40.062857 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea5e53b-ad7a-4105-8716-96dbe41fd9f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:40.084801 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-9ea5e53b-ad7a-4105-8716-96dbe41fd9f0 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:09:40.085466 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-9ea5e53b-ad7a-4105-8716-96dbe41fd9f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:09:40.093604 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1232/2470] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:09:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:09:40.097635 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d6255c-b1c0-468e-8846-04ce7249dcea None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:40.109473 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d6255c-b1c0-468e-8846-04ce7249dcea None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:40.115425 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b50c81-da2c-4af5-b406-77b3f073c640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:40.116177 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b50c81-da2c-4af5-b406-77b3f073c640 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:40.116460 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b50c81-da2c-4af5-b406-77b3f073c640 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:40.116738 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b50c81-da2c-4af5-b406-77b3f073c640 admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:40.117497 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b50c81-da2c-4af5-b406-77b3f073c640 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:09:40.117800 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b50c81-da2c-4af5-b406-77b3f073c640 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:40.119414 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b50c81-da2c-4af5-b406-77b3f073c640 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:40.131992 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1239/2471] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 10 10:09:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 10:09:40.137103 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea5e53b-ad7a-4105-8716-96dbe41fd9f0 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:40.146377 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea5e53b-ad7a-4105-8716-96dbe41fd9f0 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:40.151356 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fee48b-cf6b-4495-aae9-bfd31f602c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:40.151964 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fee48b-cf6b-4495-aae9-bfd31f602c0b admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:40.152241 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fee48b-cf6b-4495-aae9-bfd31f602c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:40.152516 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fee48b-cf6b-4495-aae9-bfd31f602c0b admin admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:40.153227 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fee48b-cf6b-4495-aae9-bfd31f602c0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:40.155190 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fee48b-cf6b-4495-aae9-bfd31f602c0b admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:40.193145 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1233/2472] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 10 10:09:40 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 10:09:40.195482 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b50c81-da2c-4af5-b406-77b3f073c640 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:40.205872 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b50c81-da2c-4af5-b406-77b3f073c640 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:40.267310 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261e2681-45ce-44df-981b-aa3952e1d3f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:40.267922 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261e2681-45ce-44df-981b-aa3952e1d3f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:40.268190 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261e2681-45ce-44df-981b-aa3952e1d3f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:40.268460 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261e2681-45ce-44df-981b-aa3952e1d3f7 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:40.269123 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261e2681-45ce-44df-981b-aa3952e1d3f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:40.271178 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261e2681-45ce-44df-981b-aa3952e1d3f7 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:40.297566 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1240/2473] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 10 10:09:40 2022] POST /identity/v3/users => generated 287 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:09:40.299284 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fee48b-cf6b-4495-aae9-bfd31f602c0b admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:40.314193 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fee48b-cf6b-4495-aae9-bfd31f602c0b admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:40.320807 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e88830-bbfb-4430-ae21-8f55a406c833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:40.321682 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e88830-bbfb-4430-ae21-8f55a406c833 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:40.322106 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e88830-bbfb-4430-ae21-8f55a406c833 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:40.322511 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e88830-bbfb-4430-ae21-8f55a406c833 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:40.323500 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e88830-bbfb-4430-ae21-8f55a406c833 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:40.326280 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e88830-bbfb-4430-ae21-8f55a406c833 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:40.337302 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1234/2474] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:09:40 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:09:40.341650 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261e2681-45ce-44df-981b-aa3952e1d3f7 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:40.351884 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261e2681-45ce-44df-981b-aa3952e1d3f7 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:40.356719 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69673233-513f-449b-a365-d8f9ecc0531b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:40.357415 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69673233-513f-449b-a365-d8f9ecc0531b admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:40.357695 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69673233-513f-449b-a365-d8f9ecc0531b admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:40.357994 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69673233-513f-449b-a365-d8f9ecc0531b admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:40.358741 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69673233-513f-449b-a365-d8f9ecc0531b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:40.360332 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69673233-513f-449b-a365-d8f9ecc0531b admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:40.370799 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1241/2475] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:09:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:09:40.375085 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e88830-bbfb-4430-ae21-8f55a406c833 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:40.385364 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e88830-bbfb-4430-ae21-8f55a406c833 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:40.390785 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd2ccd7-4db4-4611-9f31-a59ad493eb9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:40.391456 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd2ccd7-4db4-4611-9f31-a59ad493eb9d admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:40.391718 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd2ccd7-4db4-4611-9f31-a59ad493eb9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:40.391985 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd2ccd7-4db4-4611-9f31-a59ad493eb9d admin admin] PATH_INFO: `/v3/projects/1a50bfeedd584239b9f3e7a736e53daa/users/aadeccd0eb1a46c5940a1a2a69d331dc/roles/8daabcb6b7394e39b06a3453e33e32db` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:40.407479 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd2ccd7-4db4-4611-9f31-a59ad493eb9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a50bfeedd584239b9f3e7a736e53daa, user_id=aadeccd0eb1a46c5940a1a2a69d331dc, role_id=8daabcb6b7394e39b06a3453e33e32db)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:40.410192 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd2ccd7-4db4-4611-9f31-a59ad493eb9d admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:40.429844 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1235/2476] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:09:40 2022] PUT /identity/v3/projects/1a50bfeedd584239b9f3e7a736e53daa/users/aadeccd0eb1a46c5940a1a2a69d331dc/roles/8daabcb6b7394e39b06a3453e33e32db => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:09:40.441378 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce76fb47-ce64-4fc1-8d5c-1aaf16379c6f None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:40.441986 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce76fb47-ce64-4fc1-8d5c-1aaf16379c6f None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:40.441986 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce76fb47-ce64-4fc1-8d5c-1aaf16379c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:40.469628 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-ce76fb47-ce64-4fc1-8d5c-1aaf16379c6f None None] MFA Rules not processed for user `aadeccd0eb1a46c5940a1a2a69d331dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:09:40.470806 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-ce76fb47-ce64-4fc1-8d5c-1aaf16379c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:09:40.541108 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1242/2477] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:09:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:09:40.545115 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd2ccd7-4db4-4611-9f31-a59ad493eb9d admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:40.609392 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd2ccd7-4db4-4611-9f31-a59ad493eb9d admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:40.614351 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7ca49a-112b-4ee6-8d04-fd60ed07aa3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:40.615192 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ca49a-112b-4ee6-8d04-fd60ed07aa3c admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:40.615481 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ca49a-112b-4ee6-8d04-fd60ed07aa3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:40.615741 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ca49a-112b-4ee6-8d04-fd60ed07aa3c admin admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:40.616375 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7ca49a-112b-4ee6-8d04-fd60ed07aa3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:40.618398 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7ca49a-112b-4ee6-8d04-fd60ed07aa3c admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:40.646389 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1236/2478] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 10 10:09:40 2022] POST /identity/v3/projects => generated 373 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 10:09:40.650527 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce76fb47-ce64-4fc1-8d5c-1aaf16379c6f None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:40.666579 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce76fb47-ce64-4fc1-8d5c-1aaf16379c6f None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:40.724643 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:09:40.735506 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feafceff-742b-4640-88f6-9f41c4d5ec3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:40.736263 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feafceff-742b-4640-88f6-9f41c4d5ec3d admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:40.736616 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feafceff-742b-4640-88f6-9f41c4d5ec3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:40.736894 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feafceff-742b-4640-88f6-9f41c4d5ec3d admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:40.737566 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feafceff-742b-4640-88f6-9f41c4d5ec3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:40.739511 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feafceff-742b-4640-88f6-9f41c4d5ec3d admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:40.762140 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1243/2479] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 10 10:09:40 2022] POST /identity/v3/users => generated 293 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:09:40.771424 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7ca49a-112b-4ee6-8d04-fd60ed07aa3c admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:40.783899 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7ca49a-112b-4ee6-8d04-fd60ed07aa3c admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:40.789364 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb01abb-ee1b-411a-8b2f-2eaca1bfeecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:40.789969 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb01abb-ee1b-411a-8b2f-2eaca1bfeecf admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:40.790367 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb01abb-ee1b-411a-8b2f-2eaca1bfeecf admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:40.790561 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb01abb-ee1b-411a-8b2f-2eaca1bfeecf admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:40.791216 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb01abb-ee1b-411a-8b2f-2eaca1bfeecf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:40.793180 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb01abb-ee1b-411a-8b2f-2eaca1bfeecf admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:40.806252 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1237/2480] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:09:40 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:09:40.810187 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feafceff-742b-4640-88f6-9f41c4d5ec3d admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:40.820353 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feafceff-742b-4640-88f6-9f41c4d5ec3d admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:40.825098 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309b53f9-a395-431a-9bac-1075490a15e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:40.825708 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309b53f9-a395-431a-9bac-1075490a15e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:40.825983 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309b53f9-a395-431a-9bac-1075490a15e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:40.826256 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309b53f9-a395-431a-9bac-1075490a15e7 admin admin] PATH_INFO: `/v3/projects/bf0bdeeb8e274748acb0e72345d4e9ee/users/fde70625852a410abd901fdb93088b58/roles/eb04edc46b3742d7a0f0ead26f68bc22` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:40.842300 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309b53f9-a395-431a-9bac-1075490a15e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf0bdeeb8e274748acb0e72345d4e9ee, user_id=fde70625852a410abd901fdb93088b58, role_id=eb04edc46b3742d7a0f0ead26f68bc22)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:40.845111 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309b53f9-a395-431a-9bac-1075490a15e7 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:40.859369 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1244/2481] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:09:40 2022] PUT /identity/v3/projects/bf0bdeeb8e274748acb0e72345d4e9ee/users/fde70625852a410abd901fdb93088b58/roles/eb04edc46b3742d7a0f0ead26f68bc22 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:09:40.863693 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb01abb-ee1b-411a-8b2f-2eaca1bfeecf admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:40.874480 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb01abb-ee1b-411a-8b2f-2eaca1bfeecf admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:40.925949 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:09:40.933043 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac440dee-e1af-480b-8b00-e2f4afd78266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:40.933687 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac440dee-e1af-480b-8b00-e2f4afd78266 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:40.933977 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac440dee-e1af-480b-8b00-e2f4afd78266 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:40.934491 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac440dee-e1af-480b-8b00-e2f4afd78266 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:40.935604 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac440dee-e1af-480b-8b00-e2f4afd78266 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:40.937923 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac440dee-e1af-480b-8b00-e2f4afd78266 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:40.948262 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1238/2482] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:09:40 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:09:40.952978 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309b53f9-a395-431a-9bac-1075490a15e7 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:40.963847 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309b53f9-a395-431a-9bac-1075490a15e7 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:40.969791 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b723e89e-20d9-46a2-9135-12cb3b1c0703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:40.970515 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b723e89e-20d9-46a2-9135-12cb3b1c0703 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:40.970793 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b723e89e-20d9-46a2-9135-12cb3b1c0703 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:40.971069 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b723e89e-20d9-46a2-9135-12cb3b1c0703 admin admin] PATH_INFO: `/v3/projects/bf0bdeeb8e274748acb0e72345d4e9ee/users/fde70625852a410abd901fdb93088b58/roles/eb04edc46b3742d7a0f0ead26f68bc22` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:40.973174 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b723e89e-20d9-46a2-9135-12cb3b1c0703 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf0bdeeb8e274748acb0e72345d4e9ee, user_id=fde70625852a410abd901fdb93088b58, role_id=eb04edc46b3742d7a0f0ead26f68bc22)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:40.975846 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b723e89e-20d9-46a2-9135-12cb3b1c0703 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:40.987121 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1245/2483] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:09:40 2022] PUT /identity/v3/projects/bf0bdeeb8e274748acb0e72345d4e9ee/users/fde70625852a410abd901fdb93088b58/roles/eb04edc46b3742d7a0f0ead26f68bc22 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:09:40.999269 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e34c140-68bd-45dd-a7a4-3a5851c45fca None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:40.999592 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e34c140-68bd-45dd-a7a4-3a5851c45fca None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:40.999892 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e34c140-68bd-45dd-a7a4-3a5851c45fca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:41.029223 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-9e34c140-68bd-45dd-a7a4-3a5851c45fca None None] MFA Rules not processed for user `fde70625852a410abd901fdb93088b58`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:09:41.030461 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-9e34c140-68bd-45dd-a7a4-3a5851c45fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:09:41.102951 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1239/2484] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:09:40 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:09:41.115937 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b723e89e-20d9-46a2-9135-12cb3b1c0703 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:41.117437 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-b723e89e-20d9-46a2-9135-12cb3b1c0703 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:09:41.178167 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b723e89e-20d9-46a2-9135-12cb3b1c0703 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:41.182171 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261a11f2-1f3c-4090-ad7f-878f111df839 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf8e725cbe0403d943b136235eac057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:41.182772 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261a11f2-1f3c-4090-ad7f-878f111df839 service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:41.183052 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261a11f2-1f3c-4090-ad7f-878f111df839 service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:41.183330 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261a11f2-1f3c-4090-ad7f-878f111df839 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:41.192437 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261a11f2-1f3c-4090-ad7f-878f111df839 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:41.193918 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261a11f2-1f3c-4090-ad7f-878f111df839 service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:41.203138 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1246/2485] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:09:41 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:09:41.285979 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e34c140-68bd-45dd-a7a4-3a5851c45fca None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:41.296774 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e34c140-68bd-45dd-a7a4-3a5851c45fca None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:41.300829 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64571c33-ca4f-49e7-b5f9-3ddfb9839f5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf8e725cbe0403d943b136235eac057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:41.301482 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64571c33-ca4f-49e7-b5f9-3ddfb9839f5a service cinder] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:41.301758 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64571c33-ca4f-49e7-b5f9-3ddfb9839f5a service cinder] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:41.302024 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64571c33-ca4f-49e7-b5f9-3ddfb9839f5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:41.359151 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64571c33-ca4f-49e7-b5f9-3ddfb9839f5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:41.360514 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64571c33-ca4f-49e7-b5f9-3ddfb9839f5a service cinder] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:41.369511 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1240/2486] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:09:41 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:09:43.113374 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261a11f2-1f3c-4090-ad7f-878f111df839 service cinder] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:43.114901 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-261a11f2-1f3c-4090-ad7f-878f111df839 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:09:43.180701 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261a11f2-1f3c-4090-ad7f-878f111df839 service cinder] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:43.185646 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ce0f0a-cb92-4e87-86e7-9f73cc59b466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:43.186279 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce0f0a-cb92-4e87-86e7-9f73cc59b466 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:43.186550 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce0f0a-cb92-4e87-86e7-9f73cc59b466 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:43.186819 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce0f0a-cb92-4e87-86e7-9f73cc59b466 admin admin] PATH_INFO: `/v3/users/a5415d9233c84d0eafc44c5f11ce7fe0` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:43.187964 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ce0f0a-cb92-4e87-86e7-9f73cc59b466 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5415d9233c84d0eafc44c5f11ce7fe0)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:43.189902 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ce0f0a-cb92-4e87-86e7-9f73cc59b466 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:43.239150 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-79ce0f0a-cb92-4e87-86e7-9f73cc59b466 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5415d9233c84d0eafc44c5f11ce7fe0'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:43.240938 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:09:43.248410 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-79ce0f0a-cb92-4e87-86e7-9f73cc59b466 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5415d9233c84d0eafc44c5f11ce7fe0'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:43.249965 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-79ce0f0a-cb92-4e87-86e7-9f73cc59b466 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5415d9233c84d0eafc44c5f11ce7fe0'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:43.250612 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-79ce0f0a-cb92-4e87-86e7-9f73cc59b466 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5415d9233c84d0eafc44c5f11ce7fe0'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:43.258607 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-79ce0f0a-cb92-4e87-86e7-9f73cc59b466 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5415d9233c84d0eafc44c5f11ce7fe0'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:43.277719 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1247/2487] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 10 10:09:43 2022] DELETE /identity/v3/users/a5415d9233c84d0eafc44c5f11ce7fe0 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:09:43.282305 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7207b34-75e7-469b-ba89-db69cb79c18f None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:43.282779 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7207b34-75e7-469b-ba89-db69cb79c18f None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:43.283093 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7207b34-75e7-469b-ba89-db69cb79c18f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:43.304169 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-e7207b34-75e7-469b-ba89-db69cb79c18f None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:09:43.305512 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-e7207b34-75e7-469b-ba89-db69cb79c18f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:09:43.364474 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1241/2488] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:09:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:09:43.375850 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ce0f0a-cb92-4e87-86e7-9f73cc59b466 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:43.377365 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-79ce0f0a-cb92-4e87-86e7-9f73cc59b466 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:09:43.435126 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ce0f0a-cb92-4e87-86e7-9f73cc59b466 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:43.440324 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e61d67-afad-43dc-9ad9-cc41b9411b55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4294c170df354fe892831281acd4ea7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:43.440966 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e61d67-afad-43dc-9ad9-cc41b9411b55 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:43.441255 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e61d67-afad-43dc-9ad9-cc41b9411b55 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:43.441561 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e61d67-afad-43dc-9ad9-cc41b9411b55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:43.454705 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e61d67-afad-43dc-9ad9-cc41b9411b55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:43.457028 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e61d67-afad-43dc-9ad9-cc41b9411b55 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:43.469905 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1248/2489] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:09:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:09:43.766085 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7207b34-75e7-469b-ba89-db69cb79c18f None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:43.768288 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-e7207b34-75e7-469b-ba89-db69cb79c18f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:09:43.783123 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7207b34-75e7-469b-ba89-db69cb79c18f None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:43.788228 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d66ed56-d2d0-48c6-ace7-83ed406e7216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:43.789430 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d66ed56-d2d0-48c6-ace7-83ed406e7216 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:43.789674 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d66ed56-d2d0-48c6-ace7-83ed406e7216 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:43.789960 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d66ed56-d2d0-48c6-ace7-83ed406e7216 admin admin] PATH_INFO: `/v3/projects/7ada0c55ab76484eaa29d1c0b21f247b` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:43.791328 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d66ed56-d2d0-48c6-ace7-83ed406e7216 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ada0c55ab76484eaa29d1c0b21f247b)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:43.793291 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d66ed56-d2d0-48c6-ace7-83ed406e7216 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:43.806136 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:09:43.856451 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-9d66ed56-d2d0-48c6-ace7-83ed406e7216 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ada0c55ab76484eaa29d1c0b21f247b', 'request_id': 'req-9d66ed56-d2d0-48c6-ace7-83ed406e7216'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:43.863188 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-9d66ed56-d2d0-48c6-ace7-83ed406e7216 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ada0c55ab76484eaa29d1c0b21f247b', 'request_id': 'req-9d66ed56-d2d0-48c6-ace7-83ed406e7216'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:43.874037 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-9d66ed56-d2d0-48c6-ace7-83ed406e7216 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ada0c55ab76484eaa29d1c0b21f247b', 'request_id': 'req-9d66ed56-d2d0-48c6-ace7-83ed406e7216'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:43.886293 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-9d66ed56-d2d0-48c6-ace7-83ed406e7216 admin admin] The token cache is being invalidate because project 7ada0c55ab76484eaa29d1c0b21f247b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 10:09:43.886587 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-9d66ed56-d2d0-48c6-ace7-83ed406e7216 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:43.887395 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-9d66ed56-d2d0-48c6-ace7-83ed406e7216 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:43.889955 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1242/2490] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 10 10:09:43 2022] DELETE /identity/v3/projects/7ada0c55ab76484eaa29d1c0b21f247b => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:09:43.893934 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e61d67-afad-43dc-9ad9-cc41b9411b55 service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:43.904611 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e61d67-afad-43dc-9ad9-cc41b9411b55 service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:43.975163 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec06104-ad9e-4a22-9cf9-a469e25ec216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:43.975792 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec06104-ad9e-4a22-9cf9-a469e25ec216 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:43.976074 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec06104-ad9e-4a22-9cf9-a469e25ec216 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:43.976349 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec06104-ad9e-4a22-9cf9-a469e25ec216 admin admin] PATH_INFO: `/v3/users/c7dc1dbf154f4b14bc62e42d14b82802` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:43.977552 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec06104-ad9e-4a22-9cf9-a469e25ec216 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7dc1dbf154f4b14bc62e42d14b82802)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:43.979525 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec06104-ad9e-4a22-9cf9-a469e25ec216 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:44.029721 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-6ec06104-ad9e-4a22-9cf9-a469e25ec216 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7dc1dbf154f4b14bc62e42d14b82802'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:44.037990 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-6ec06104-ad9e-4a22-9cf9-a469e25ec216 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7dc1dbf154f4b14bc62e42d14b82802'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:44.038586 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-6ec06104-ad9e-4a22-9cf9-a469e25ec216 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7dc1dbf154f4b14bc62e42d14b82802'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:44.039174 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-6ec06104-ad9e-4a22-9cf9-a469e25ec216 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7dc1dbf154f4b14bc62e42d14b82802'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:44.045953 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-6ec06104-ad9e-4a22-9cf9-a469e25ec216 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7dc1dbf154f4b14bc62e42d14b82802'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:44.051393 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:INSERT=2,keystone:DELETE=12,keystone:SELECT=86 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:09:44.064205 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1249/2491] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 10 10:09:43 2022] DELETE /identity/v3/users/c7dc1dbf154f4b14bc62e42d14b82802 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:09:44.380433 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d66ed56-d2d0-48c6-ace7-83ed406e7216 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:44.382209 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-9d66ed56-d2d0-48c6-ace7-83ed406e7216 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:09:44.400892 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d66ed56-d2d0-48c6-ace7-83ed406e7216 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:44.471618 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa675e9-858e-49bb-b5a5-14f4a813d53e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:44.472252 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa675e9-858e-49bb-b5a5-14f4a813d53e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:44.472648 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa675e9-858e-49bb-b5a5-14f4a813d53e admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:44.472935 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa675e9-858e-49bb-b5a5-14f4a813d53e admin admin] PATH_INFO: `/v3/projects/5789b75d552545429d4258e8df302221` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:44.474143 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa675e9-858e-49bb-b5a5-14f4a813d53e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5789b75d552545429d4258e8df302221)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:44.476214 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa675e9-858e-49bb-b5a5-14f4a813d53e admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:44.524736 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-7fa675e9-858e-49bb-b5a5-14f4a813d53e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5789b75d552545429d4258e8df302221', 'request_id': 'req-7fa675e9-858e-49bb-b5a5-14f4a813d53e'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:44.530631 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-7fa675e9-858e-49bb-b5a5-14f4a813d53e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5789b75d552545429d4258e8df302221', 'request_id': 'req-7fa675e9-858e-49bb-b5a5-14f4a813d53e'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:44.538928 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-7fa675e9-858e-49bb-b5a5-14f4a813d53e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5789b75d552545429d4258e8df302221', 'request_id': 'req-7fa675e9-858e-49bb-b5a5-14f4a813d53e'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:44.553529 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-7fa675e9-858e-49bb-b5a5-14f4a813d53e admin admin] The token cache is being invalidate because project 5789b75d552545429d4258e8df302221 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 10:09:44.553951 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-7fa675e9-858e-49bb-b5a5-14f4a813d53e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:44.554789 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-7fa675e9-858e-49bb-b5a5-14f4a813d53e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:44.556752 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1243/2492] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 10 10:09:44 2022] DELETE /identity/v3/projects/5789b75d552545429d4258e8df302221 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:09:44.561926 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7d9ccc-bb68-4cb1-9a1d-aa0b011eaff4 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:44.562412 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7d9ccc-bb68-4cb1-9a1d-aa0b011eaff4 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:44.562506 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7d9ccc-bb68-4cb1-9a1d-aa0b011eaff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:44.583232 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-1b7d9ccc-bb68-4cb1-9a1d-aa0b011eaff4 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:09:44.584463 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-1b7d9ccc-bb68-4cb1-9a1d-aa0b011eaff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:09:44.645458 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1250/2493] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:09:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:09:44.654410 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55df36cb-7733-48e1-bdf0-7bc8b04ec19d None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:44.654701 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55df36cb-7733-48e1-bdf0-7bc8b04ec19d None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:44.654976 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55df36cb-7733-48e1-bdf0-7bc8b04ec19d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:44.676372 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-55df36cb-7733-48e1-bdf0-7bc8b04ec19d None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:09:44.677659 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-55df36cb-7733-48e1-bdf0-7bc8b04ec19d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:09:44.686682 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1244/2494] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:09:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:09:44.691394 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7d9ccc-bb68-4cb1-9a1d-aa0b011eaff4 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:44.701848 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7d9ccc-bb68-4cb1-9a1d-aa0b011eaff4 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:44.706742 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea84ff1-8227-4b46-a2ac-6be76015dd0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:44.707360 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea84ff1-8227-4b46-a2ac-6be76015dd0e admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:44.707637 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea84ff1-8227-4b46-a2ac-6be76015dd0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:44.707903 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea84ff1-8227-4b46-a2ac-6be76015dd0e admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:44.708547 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea84ff1-8227-4b46-a2ac-6be76015dd0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:09:44.708864 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea84ff1-8227-4b46-a2ac-6be76015dd0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:44.710496 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea84ff1-8227-4b46-a2ac-6be76015dd0e admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:44.722098 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1251/2495] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 10 10:09:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:09:44.726390 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55df36cb-7733-48e1-bdf0-7bc8b04ec19d None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:44.735781 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55df36cb-7733-48e1-bdf0-7bc8b04ec19d None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:44.745011 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747f7dbc-6beb-4ea8-81c5-5158bad97725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:44.745663 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747f7dbc-6beb-4ea8-81c5-5158bad97725 admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:44.745947 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747f7dbc-6beb-4ea8-81c5-5158bad97725 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:44.746219 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747f7dbc-6beb-4ea8-81c5-5158bad97725 admin admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:44.746861 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747f7dbc-6beb-4ea8-81c5-5158bad97725 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:44.748842 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747f7dbc-6beb-4ea8-81c5-5158bad97725 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:44.778074 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1245/2496] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 10 10:09:44 2022] POST /identity/v3/projects => generated 409 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:09:44.782607 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea84ff1-8227-4b46-a2ac-6be76015dd0e admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:44.793300 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea84ff1-8227-4b46-a2ac-6be76015dd0e admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:44.850681 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791eabb4-cd88-493b-9fa5-94740a0868e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:44.851297 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791eabb4-cd88-493b-9fa5-94740a0868e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:44.851577 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791eabb4-cd88-493b-9fa5-94740a0868e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:44.851852 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791eabb4-cd88-493b-9fa5-94740a0868e3 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:44.852527 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791eabb4-cd88-493b-9fa5-94740a0868e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:44.854491 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791eabb4-cd88-493b-9fa5-94740a0868e3 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:44.877648 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1252/2497] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 10 10:09:44 2022] POST /identity/v3/users => generated 305 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:09:44.881769 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747f7dbc-6beb-4ea8-81c5-5158bad97725 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:44.887430 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:09:44.894040 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747f7dbc-6beb-4ea8-81c5-5158bad97725 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:44.900226 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d827dc7e-7bfd-4fd4-9d73-c5748f6da8e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:44.900798 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d827dc7e-7bfd-4fd4-9d73-c5748f6da8e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:44.901099 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d827dc7e-7bfd-4fd4-9d73-c5748f6da8e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:44.901368 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d827dc7e-7bfd-4fd4-9d73-c5748f6da8e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:44.902020 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d827dc7e-7bfd-4fd4-9d73-c5748f6da8e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:44.903653 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d827dc7e-7bfd-4fd4-9d73-c5748f6da8e3 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:44.913702 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1246/2498] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:09:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:09:44.917800 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791eabb4-cd88-493b-9fa5-94740a0868e3 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:44.929320 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791eabb4-cd88-493b-9fa5-94740a0868e3 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:44.935220 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba50e76-f6f6-4739-9d80-ebf5c683d26c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:44.935839 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba50e76-f6f6-4739-9d80-ebf5c683d26c admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:44.936121 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba50e76-f6f6-4739-9d80-ebf5c683d26c admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:44.936390 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba50e76-f6f6-4739-9d80-ebf5c683d26c admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:44.937117 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba50e76-f6f6-4739-9d80-ebf5c683d26c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:44.938766 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba50e76-f6f6-4739-9d80-ebf5c683d26c admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:44.950473 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1253/2499] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:09:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:09:44.954883 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d827dc7e-7bfd-4fd4-9d73-c5748f6da8e3 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:44.965053 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d827dc7e-7bfd-4fd4-9d73-c5748f6da8e3 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:44.970134 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9aa796-541c-4c8f-ab5b-5a1098905028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:44.970773 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9aa796-541c-4c8f-ab5b-5a1098905028 admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:44.971053 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9aa796-541c-4c8f-ab5b-5a1098905028 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:44.971352 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9aa796-541c-4c8f-ab5b-5a1098905028 admin admin] PATH_INFO: `/v3/projects/304d3bc3bb9442088aa240026120ea38/users/1573b8abeeb84dc18872feb0b824ab0e/roles/8daabcb6b7394e39b06a3453e33e32db` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:44.988053 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9aa796-541c-4c8f-ab5b-5a1098905028 admin admin] RBAC: Authorizing `identity:create_grant(project_id=304d3bc3bb9442088aa240026120ea38, user_id=1573b8abeeb84dc18872feb0b824ab0e, role_id=8daabcb6b7394e39b06a3453e33e32db)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:44.990806 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9aa796-541c-4c8f-ab5b-5a1098905028 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:45.009621 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1247/2500] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:09:44 2022] PUT /identity/v3/projects/304d3bc3bb9442088aa240026120ea38/users/1573b8abeeb84dc18872feb0b824ab0e/roles/8daabcb6b7394e39b06a3453e33e32db => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:09:45.020738 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db2da42-1872-4016-8cc4-a05f10044549 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:45.021028 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db2da42-1872-4016-8cc4-a05f10044549 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:45.021334 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db2da42-1872-4016-8cc4-a05f10044549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:45.052307 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-5db2da42-1872-4016-8cc4-a05f10044549 None None] MFA Rules not processed for user `1573b8abeeb84dc18872feb0b824ab0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:09:45.053608 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-5db2da42-1872-4016-8cc4-a05f10044549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:09:45.104136 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:09:45.129094 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1254/2501] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:09:45 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:09:45.133909 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9aa796-541c-4c8f-ab5b-5a1098905028 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:45.199385 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9aa796-541c-4c8f-ab5b-5a1098905028 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:45.204380 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c36eec1-6038-43bd-87df-3d8fd8070870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:45.205018 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c36eec1-6038-43bd-87df-3d8fd8070870 admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:45.205326 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c36eec1-6038-43bd-87df-3d8fd8070870 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:45.205599 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c36eec1-6038-43bd-87df-3d8fd8070870 admin admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:45.206218 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c36eec1-6038-43bd-87df-3d8fd8070870 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:45.208117 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c36eec1-6038-43bd-87df-3d8fd8070870 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:45.241884 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1248/2502] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 10 10:09:45 2022] POST /identity/v3/projects => generated 409 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 10:09:45.246189 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db2da42-1872-4016-8cc4-a05f10044549 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:45.257362 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db2da42-1872-4016-8cc4-a05f10044549 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:45.315668 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662887c5-699d-403d-ae30-a232d325907e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:45.316312 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662887c5-699d-403d-ae30-a232d325907e admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:45.316594 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662887c5-699d-403d-ae30-a232d325907e admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:45.316862 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662887c5-699d-403d-ae30-a232d325907e admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:45.317586 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662887c5-699d-403d-ae30-a232d325907e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:45.319554 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662887c5-699d-403d-ae30-a232d325907e admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:45.342262 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1255/2503] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 10 10:09:45 2022] POST /identity/v3/users => generated 311 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:09:45.346356 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c36eec1-6038-43bd-87df-3d8fd8070870 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:45.357490 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c36eec1-6038-43bd-87df-3d8fd8070870 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:45.363120 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea06bfb-39fd-4850-8424-0321720c2c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:45.367770 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea06bfb-39fd-4850-8424-0321720c2c1d admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:45.367770 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea06bfb-39fd-4850-8424-0321720c2c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:45.367770 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea06bfb-39fd-4850-8424-0321720c2c1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:45.367770 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea06bfb-39fd-4850-8424-0321720c2c1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:45.367770 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea06bfb-39fd-4850-8424-0321720c2c1d admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:45.385605 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1249/2504] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:09:45 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:09:45.386463 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662887c5-699d-403d-ae30-a232d325907e admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:45.396715 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662887c5-699d-403d-ae30-a232d325907e admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:45.403566 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa01fe77-bf39-4842-88e7-e26a704d1628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:45.404667 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa01fe77-bf39-4842-88e7-e26a704d1628 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:45.404995 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa01fe77-bf39-4842-88e7-e26a704d1628 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:45.405612 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa01fe77-bf39-4842-88e7-e26a704d1628 admin admin] PATH_INFO: `/v3/projects/7a997d209ce3415ea9c4c04d0ba52cdf/users/3ebde99d49db4cf384a619c61377a3fd/roles/eb04edc46b3742d7a0f0ead26f68bc22` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:45.420850 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa01fe77-bf39-4842-88e7-e26a704d1628 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a997d209ce3415ea9c4c04d0ba52cdf, user_id=3ebde99d49db4cf384a619c61377a3fd, role_id=eb04edc46b3742d7a0f0ead26f68bc22)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:45.424115 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa01fe77-bf39-4842-88e7-e26a704d1628 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:45.439400 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1256/2505] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:09:45 2022] PUT /identity/v3/projects/7a997d209ce3415ea9c4c04d0ba52cdf/users/3ebde99d49db4cf384a619c61377a3fd/roles/eb04edc46b3742d7a0f0ead26f68bc22 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:09:45.443399 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea06bfb-39fd-4850-8424-0321720c2c1d admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:45.454533 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea06bfb-39fd-4850-8424-0321720c2c1d admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:45.530007 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8550f2c9-7876-4fa0-958c-625d181c7e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:45.530620 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8550f2c9-7876-4fa0-958c-625d181c7e2b admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:45.530900 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8550f2c9-7876-4fa0-958c-625d181c7e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:45.531164 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8550f2c9-7876-4fa0-958c-625d181c7e2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:45.531806 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8550f2c9-7876-4fa0-958c-625d181c7e2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:45.533448 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8550f2c9-7876-4fa0-958c-625d181c7e2b admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:45.546406 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1250/2506] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:09:45 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:09:45.550384 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa01fe77-bf39-4842-88e7-e26a704d1628 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:45.561623 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa01fe77-bf39-4842-88e7-e26a704d1628 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:45.567117 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6996d559-647e-4ccf-8483-3e070d6920b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:45.567779 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6996d559-647e-4ccf-8483-3e070d6920b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:45.568059 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6996d559-647e-4ccf-8483-3e070d6920b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:45.568332 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6996d559-647e-4ccf-8483-3e070d6920b7 admin admin] PATH_INFO: `/v3/projects/7a997d209ce3415ea9c4c04d0ba52cdf/users/3ebde99d49db4cf384a619c61377a3fd/roles/eb04edc46b3742d7a0f0ead26f68bc22` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:45.570261 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6996d559-647e-4ccf-8483-3e070d6920b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a997d209ce3415ea9c4c04d0ba52cdf, user_id=3ebde99d49db4cf384a619c61377a3fd, role_id=eb04edc46b3742d7a0f0ead26f68bc22)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:45.572893 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6996d559-647e-4ccf-8483-3e070d6920b7 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:45.583555 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1257/2507] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:09:45 2022] PUT /identity/v3/projects/7a997d209ce3415ea9c4c04d0ba52cdf/users/3ebde99d49db4cf384a619c61377a3fd/roles/eb04edc46b3742d7a0f0ead26f68bc22 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:09:45.595061 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4761ed-929a-444c-83ce-83050f830b66 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:45.595344 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4761ed-929a-444c-83ce-83050f830b66 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:45.595616 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4761ed-929a-444c-83ce-83050f830b66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:45.625281 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-bb4761ed-929a-444c-83ce-83050f830b66 None None] MFA Rules not processed for user `3ebde99d49db4cf384a619c61377a3fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:09:45.626526 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-bb4761ed-929a-444c-83ce-83050f830b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:09:45.653410 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:09:45.699748 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1251/2508] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:09:45 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:09:45.710580 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6996d559-647e-4ccf-8483-3e070d6920b7 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:45.712326 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-6996d559-647e-4ccf-8483-3e070d6920b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:09:45.773819 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6996d559-647e-4ccf-8483-3e070d6920b7 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:45.777558 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61322638-0990-4d28-970f-800e78f14839 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf8e725cbe0403d943b136235eac057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:45.778867 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61322638-0990-4d28-970f-800e78f14839 service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:45.778867 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61322638-0990-4d28-970f-800e78f14839 service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:45.779096 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61322638-0990-4d28-970f-800e78f14839 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:45.789269 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61322638-0990-4d28-970f-800e78f14839 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:45.790706 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61322638-0990-4d28-970f-800e78f14839 service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:45.800556 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1258/2509] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:09:45 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:09:45.974073 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4761ed-929a-444c-83ce-83050f830b66 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:45.983752 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4761ed-929a-444c-83ce-83050f830b66 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:45.987591 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec1ef64-95de-44d3-b2a2-b773bc9b5e5e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf8e725cbe0403d943b136235eac057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:45.988194 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec1ef64-95de-44d3-b2a2-b773bc9b5e5e service cinder] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:45.988469 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec1ef64-95de-44d3-b2a2-b773bc9b5e5e service cinder] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:45.988741 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec1ef64-95de-44d3-b2a2-b773bc9b5e5e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:46.046852 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec1ef64-95de-44d3-b2a2-b773bc9b5e5e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:46.048744 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec1ef64-95de-44d3-b2a2-b773bc9b5e5e service cinder] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:46.061697 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1252/2510] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:09:45 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 10:09:51.510829 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61322638-0990-4d28-970f-800e78f14839 service cinder] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:51.573781 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:09:51.626393 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61322638-0990-4d28-970f-800e78f14839 service cinder] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:51.633620 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc8679d-900b-49d2-9636-015176898da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:51.634507 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc8679d-900b-49d2-9636-015176898da1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:51.635124 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc8679d-900b-49d2-9636-015176898da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:51.635683 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc8679d-900b-49d2-9636-015176898da1 admin admin] PATH_INFO: `/v3/users/1573b8abeeb84dc18872feb0b824ab0e` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:51.637652 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc8679d-900b-49d2-9636-015176898da1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1573b8abeeb84dc18872feb0b824ab0e)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:51.640259 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc8679d-900b-49d2-9636-015176898da1 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:51.695156 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-7cc8679d-900b-49d2-9636-015176898da1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1573b8abeeb84dc18872feb0b824ab0e'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:51.703565 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-7cc8679d-900b-49d2-9636-015176898da1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1573b8abeeb84dc18872feb0b824ab0e'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:51.704226 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-7cc8679d-900b-49d2-9636-015176898da1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1573b8abeeb84dc18872feb0b824ab0e'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:51.704948 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-7cc8679d-900b-49d2-9636-015176898da1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1573b8abeeb84dc18872feb0b824ab0e'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:51.712884 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-7cc8679d-900b-49d2-9636-015176898da1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1573b8abeeb84dc18872feb0b824ab0e'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:51.732344 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1259/2511] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 10 10:09:51 2022] DELETE /identity/v3/users/1573b8abeeb84dc18872feb0b824ab0e => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:09:51.742772 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023f8c46-6a23-4e63-bc22-1b998b7ae792 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:51.743709 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023f8c46-6a23-4e63-bc22-1b998b7ae792 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:51.744545 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023f8c46-6a23-4e63-bc22-1b998b7ae792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:51.767114 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-023f8c46-6a23-4e63-bc22-1b998b7ae792 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:09:51.768463 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-023f8c46-6a23-4e63-bc22-1b998b7ae792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:09:51.838189 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1253/2512] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:09:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:09:51.848675 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc8679d-900b-49d2-9636-015176898da1 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:51.850180 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-7cc8679d-900b-49d2-9636-015176898da1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:09:51.910688 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc8679d-900b-49d2-9636-015176898da1 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:51.917809 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc389d9-f066-4bfe-aed6-d02be162c87d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4294c170df354fe892831281acd4ea7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:51.918447 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc389d9-f066-4bfe-aed6-d02be162c87d service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:51.918726 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc389d9-f066-4bfe-aed6-d02be162c87d service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:51.918994 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc389d9-f066-4bfe-aed6-d02be162c87d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:51.929692 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc389d9-f066-4bfe-aed6-d02be162c87d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:51.931461 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc389d9-f066-4bfe-aed6-d02be162c87d service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:51.941574 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1260/2513] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:09:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:09:52.224890 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023f8c46-6a23-4e63-bc22-1b998b7ae792 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:52.226397 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-023f8c46-6a23-4e63-bc22-1b998b7ae792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:09:52.238656 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023f8c46-6a23-4e63-bc22-1b998b7ae792 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:52.243748 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b692e4a-a64b-431f-92dd-0b94d5fc22a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:52.244537 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b692e4a-a64b-431f-92dd-0b94d5fc22a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:52.244905 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b692e4a-a64b-431f-92dd-0b94d5fc22a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:52.245800 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b692e4a-a64b-431f-92dd-0b94d5fc22a4 admin admin] PATH_INFO: `/v3/projects/304d3bc3bb9442088aa240026120ea38` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:52.247314 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b692e4a-a64b-431f-92dd-0b94d5fc22a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=304d3bc3bb9442088aa240026120ea38)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:52.250085 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b692e4a-a64b-431f-92dd-0b94d5fc22a4 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:52.298869 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-4b692e4a-a64b-431f-92dd-0b94d5fc22a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '304d3bc3bb9442088aa240026120ea38', 'request_id': 'req-4b692e4a-a64b-431f-92dd-0b94d5fc22a4'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:52.304717 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:09:52.306121 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-4b692e4a-a64b-431f-92dd-0b94d5fc22a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '304d3bc3bb9442088aa240026120ea38', 'request_id': 'req-4b692e4a-a64b-431f-92dd-0b94d5fc22a4'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:52.316223 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-4b692e4a-a64b-431f-92dd-0b94d5fc22a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '304d3bc3bb9442088aa240026120ea38', 'request_id': 'req-4b692e4a-a64b-431f-92dd-0b94d5fc22a4'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:52.328251 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-4b692e4a-a64b-431f-92dd-0b94d5fc22a4 admin admin] The token cache is being invalidate because project 304d3bc3bb9442088aa240026120ea38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 10:09:52.328556 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-4b692e4a-a64b-431f-92dd-0b94d5fc22a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:52.329254 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-4b692e4a-a64b-431f-92dd-0b94d5fc22a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:52.330922 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1254/2514] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 10 10:09:52 2022] DELETE /identity/v3/projects/304d3bc3bb9442088aa240026120ea38 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:09:52.335241 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc389d9-f066-4bfe-aed6-d02be162c87d service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:52.345328 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc389d9-f066-4bfe-aed6-d02be162c87d service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:52.403869 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51befa83-37cf-4b7a-92b7-de408027f8c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:52.404496 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51befa83-37cf-4b7a-92b7-de408027f8c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:52.404803 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51befa83-37cf-4b7a-92b7-de408027f8c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:52.405087 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51befa83-37cf-4b7a-92b7-de408027f8c3 admin admin] PATH_INFO: `/v3/users/3ebde99d49db4cf384a619c61377a3fd` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:52.406352 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51befa83-37cf-4b7a-92b7-de408027f8c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ebde99d49db4cf384a619c61377a3fd)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:52.408439 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51befa83-37cf-4b7a-92b7-de408027f8c3 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:52.410124 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:09:52.460064 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-51befa83-37cf-4b7a-92b7-de408027f8c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ebde99d49db4cf384a619c61377a3fd'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:52.467125 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-51befa83-37cf-4b7a-92b7-de408027f8c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ebde99d49db4cf384a619c61377a3fd'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:52.467757 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-51befa83-37cf-4b7a-92b7-de408027f8c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ebde99d49db4cf384a619c61377a3fd'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:52.468367 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-51befa83-37cf-4b7a-92b7-de408027f8c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ebde99d49db4cf384a619c61377a3fd'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:52.475363 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-51befa83-37cf-4b7a-92b7-de408027f8c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ebde99d49db4cf384a619c61377a3fd'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:52.494467 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1261/2515] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 10 10:09:52 2022] DELETE /identity/v3/users/3ebde99d49db4cf384a619c61377a3fd => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:09:52.774830 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b692e4a-a64b-431f-92dd-0b94d5fc22a4 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:52.776551 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-4b692e4a-a64b-431f-92dd-0b94d5fc22a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:09:52.796104 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b692e4a-a64b-431f-92dd-0b94d5fc22a4 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:52.870153 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f949edf-e104-4d61-8dff-71cbe98741de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:52.870919 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f949edf-e104-4d61-8dff-71cbe98741de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:52.871266 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f949edf-e104-4d61-8dff-71cbe98741de admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:52.871606 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f949edf-e104-4d61-8dff-71cbe98741de admin admin] PATH_INFO: `/v3/projects/7a997d209ce3415ea9c4c04d0ba52cdf` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:52.872856 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f949edf-e104-4d61-8dff-71cbe98741de admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a997d209ce3415ea9c4c04d0ba52cdf)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:52.875129 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f949edf-e104-4d61-8dff-71cbe98741de admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:52.932529 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-4f949edf-e104-4d61-8dff-71cbe98741de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a997d209ce3415ea9c4c04d0ba52cdf', 'request_id': 'req-4f949edf-e104-4d61-8dff-71cbe98741de'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:52.938952 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-4f949edf-e104-4d61-8dff-71cbe98741de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a997d209ce3415ea9c4c04d0ba52cdf', 'request_id': 'req-4f949edf-e104-4d61-8dff-71cbe98741de'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:52.947558 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-4f949edf-e104-4d61-8dff-71cbe98741de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a997d209ce3415ea9c4c04d0ba52cdf', 'request_id': 'req-4f949edf-e104-4d61-8dff-71cbe98741de'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:52.958766 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-4f949edf-e104-4d61-8dff-71cbe98741de admin admin] The token cache is being invalidate because project 7a997d209ce3415ea9c4c04d0ba52cdf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 10:09:52.959049 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-4f949edf-e104-4d61-8dff-71cbe98741de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:52.959660 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-4f949edf-e104-4d61-8dff-71cbe98741de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:52.961164 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1255/2516] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 10 10:09:52 2022] DELETE /identity/v3/projects/7a997d209ce3415ea9c4c04d0ba52cdf => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:09:52.966040 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83abbd33-b9de-45b5-941f-b4376c4ab8bd None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:52.966514 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83abbd33-b9de-45b5-941f-b4376c4ab8bd None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:52.966637 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83abbd33-b9de-45b5-941f-b4376c4ab8bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:52.986042 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-83abbd33-b9de-45b5-941f-b4376c4ab8bd None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:09:52.987340 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-83abbd33-b9de-45b5-941f-b4376c4ab8bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:09:53.052323 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1262/2517] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:09:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 10:09:53.060506 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c1a9d5-4687-4214-bc19-1f738f8c2a94 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:53.060792 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c1a9d5-4687-4214-bc19-1f738f8c2a94 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:53.061040 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c1a9d5-4687-4214-bc19-1f738f8c2a94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:53.082775 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-78c1a9d5-4687-4214-bc19-1f738f8c2a94 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:09:53.084004 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-78c1a9d5-4687-4214-bc19-1f738f8c2a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:09:53.093443 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1256/2518] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:09:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:09:53.097771 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83abbd33-b9de-45b5-941f-b4376c4ab8bd None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:53.107310 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83abbd33-b9de-45b5-941f-b4376c4ab8bd None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:53.112151 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc59c303-d071-431f-8066-ae7a81aa0613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:53.112748 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc59c303-d071-431f-8066-ae7a81aa0613 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:53.113024 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc59c303-d071-431f-8066-ae7a81aa0613 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:53.113325 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc59c303-d071-431f-8066-ae7a81aa0613 admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:53.113998 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc59c303-d071-431f-8066-ae7a81aa0613 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:09:53.114296 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc59c303-d071-431f-8066-ae7a81aa0613 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:53.115914 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc59c303-d071-431f-8066-ae7a81aa0613 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:53.127732 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1263/2519] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 10 10:09:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:09:53.131966 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c1a9d5-4687-4214-bc19-1f738f8c2a94 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:53.142269 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c1a9d5-4687-4214-bc19-1f738f8c2a94 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:53.148600 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255ebf11-b828-4c9e-a4d6-05ce55bbd358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:53.149233 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255ebf11-b828-4c9e-a4d6-05ce55bbd358 admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:53.149514 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255ebf11-b828-4c9e-a4d6-05ce55bbd358 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:53.149784 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255ebf11-b828-4c9e-a4d6-05ce55bbd358 admin admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:53.150407 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255ebf11-b828-4c9e-a4d6-05ce55bbd358 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:53.152324 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255ebf11-b828-4c9e-a4d6-05ce55bbd358 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:53.182115 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1257/2520] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 10 10:09:53 2022] POST /identity/v3/projects => generated 361 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:09:53.186407 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc59c303-d071-431f-8066-ae7a81aa0613 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:53.196650 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc59c303-d071-431f-8066-ae7a81aa0613 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:53.257274 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f474c8-40a2-48d1-9cc9-d76f78170a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:53.257893 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f474c8-40a2-48d1-9cc9-d76f78170a70 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:53.258174 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f474c8-40a2-48d1-9cc9-d76f78170a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:53.258450 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f474c8-40a2-48d1-9cc9-d76f78170a70 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:53.259114 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f474c8-40a2-48d1-9cc9-d76f78170a70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:53.261022 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f474c8-40a2-48d1-9cc9-d76f78170a70 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:53.275148 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:09:53.287973 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1264/2521] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 10 10:09:53 2022] POST /identity/v3/users => generated 281 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:09:53.292014 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255ebf11-b828-4c9e-a4d6-05ce55bbd358 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:53.303339 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255ebf11-b828-4c9e-a4d6-05ce55bbd358 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:53.311283 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b043b94c-06b7-478e-8091-b203bb5dbd6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:53.311283 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b043b94c-06b7-478e-8091-b203bb5dbd6d admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:53.311283 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b043b94c-06b7-478e-8091-b203bb5dbd6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:53.311283 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b043b94c-06b7-478e-8091-b203bb5dbd6d admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:53.311889 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b043b94c-06b7-478e-8091-b203bb5dbd6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:53.311889 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b043b94c-06b7-478e-8091-b203bb5dbd6d admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:53.322705 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1258/2522] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:09:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:09:53.326688 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f474c8-40a2-48d1-9cc9-d76f78170a70 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:53.337220 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f474c8-40a2-48d1-9cc9-d76f78170a70 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:53.341932 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918fa5ec-ab3d-4b6b-bc8e-dab8b37d646d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:53.342567 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918fa5ec-ab3d-4b6b-bc8e-dab8b37d646d admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:53.342827 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918fa5ec-ab3d-4b6b-bc8e-dab8b37d646d admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:53.343099 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918fa5ec-ab3d-4b6b-bc8e-dab8b37d646d admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:53.343754 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918fa5ec-ab3d-4b6b-bc8e-dab8b37d646d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:53.345384 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918fa5ec-ab3d-4b6b-bc8e-dab8b37d646d admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:53.360812 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1265/2523] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:09:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 10:09:53.362127 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b043b94c-06b7-478e-8091-b203bb5dbd6d admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:53.372728 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b043b94c-06b7-478e-8091-b203bb5dbd6d admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:53.378042 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d62c2b-c750-4392-a705-7a147735e21f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:53.378959 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d62c2b-c750-4392-a705-7a147735e21f admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:53.379447 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d62c2b-c750-4392-a705-7a147735e21f admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:53.379715 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d62c2b-c750-4392-a705-7a147735e21f admin admin] PATH_INFO: `/v3/projects/f467bda8cab14e6cb91d97db3b3c901d/users/330a75763d8b45dea09e093cd259785f/roles/8daabcb6b7394e39b06a3453e33e32db` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:53.399121 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d62c2b-c750-4392-a705-7a147735e21f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f467bda8cab14e6cb91d97db3b3c901d, user_id=330a75763d8b45dea09e093cd259785f, role_id=8daabcb6b7394e39b06a3453e33e32db)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:53.403362 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d62c2b-c750-4392-a705-7a147735e21f admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:53.421129 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1259/2524] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:09:53 2022] PUT /identity/v3/projects/f467bda8cab14e6cb91d97db3b3c901d/users/330a75763d8b45dea09e093cd259785f/roles/8daabcb6b7394e39b06a3453e33e32db => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:09:53.430064 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a57026-0e4e-48ce-9f01-ef9c1470d110 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:53.430348 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a57026-0e4e-48ce-9f01-ef9c1470d110 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:53.430622 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a57026-0e4e-48ce-9f01-ef9c1470d110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:53.458837 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-95a57026-0e4e-48ce-9f01-ef9c1470d110 None None] MFA Rules not processed for user `330a75763d8b45dea09e093cd259785f`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:09:53.460038 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-95a57026-0e4e-48ce-9f01-ef9c1470d110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:09:53.528115 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1266/2525] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:09:53 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:09:53.561783 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d62c2b-c750-4392-a705-7a147735e21f admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:53.563787 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-49d62c2b-c750-4392-a705-7a147735e21f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:09:53.578157 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:09:53.624467 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d62c2b-c750-4392-a705-7a147735e21f admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:53.628835 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f414fff4-6103-4185-b785-d573b5a7c2cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf8e725cbe0403d943b136235eac057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:53.629505 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f414fff4-6103-4185-b785-d573b5a7c2cd service cinder] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:53.629778 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f414fff4-6103-4185-b785-d573b5a7c2cd service cinder] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:53.630048 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f414fff4-6103-4185-b785-d573b5a7c2cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:53.639321 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f414fff4-6103-4185-b785-d573b5a7c2cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:53.640838 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f414fff4-6103-4185-b785-d573b5a7c2cd service cinder] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:53.650430 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1260/2526] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:09:53 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:09:53.666143 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a57026-0e4e-48ce-9f01-ef9c1470d110 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:53.736980 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a57026-0e4e-48ce-9f01-ef9c1470d110 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:53.742802 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26475d9-0e75-423a-9887-4261e2541d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:53.743437 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26475d9-0e75-423a-9887-4261e2541d77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:53.743710 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26475d9-0e75-423a-9887-4261e2541d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:53.743976 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26475d9-0e75-423a-9887-4261e2541d77 admin admin] PATH_INFO: `/v3/users/330a75763d8b45dea09e093cd259785f` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:53.745319 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26475d9-0e75-423a-9887-4261e2541d77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=330a75763d8b45dea09e093cd259785f)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:53.747213 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26475d9-0e75-423a-9887-4261e2541d77 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:53.804894 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-c26475d9-0e75-423a-9887-4261e2541d77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '330a75763d8b45dea09e093cd259785f'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:53.813931 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-c26475d9-0e75-423a-9887-4261e2541d77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '330a75763d8b45dea09e093cd259785f'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:53.814574 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-c26475d9-0e75-423a-9887-4261e2541d77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '330a75763d8b45dea09e093cd259785f'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:53.815197 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-c26475d9-0e75-423a-9887-4261e2541d77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '330a75763d8b45dea09e093cd259785f'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:53.822344 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-c26475d9-0e75-423a-9887-4261e2541d77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '330a75763d8b45dea09e093cd259785f'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:53.832594 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:09:53.841015 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1267/2527] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 10 10:09:53 2022] DELETE /identity/v3/users/330a75763d8b45dea09e093cd259785f => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:09:53.845554 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe760421-ae6c-44f2-b97b-ec2293beacd2 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:53.846340 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe760421-ae6c-44f2-b97b-ec2293beacd2 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:53.846954 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe760421-ae6c-44f2-b97b-ec2293beacd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:53.867183 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-fe760421-ae6c-44f2-b97b-ec2293beacd2 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:09:53.868335 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-fe760421-ae6c-44f2-b97b-ec2293beacd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:09:53.926927 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1261/2528] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:09:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:09:53.936926 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26475d9-0e75-423a-9887-4261e2541d77 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:53.938468 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-c26475d9-0e75-423a-9887-4261e2541d77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:09:54.002490 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26475d9-0e75-423a-9887-4261e2541d77 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:54.006666 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391b1528-934a-4884-b73c-24448aec3ef2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4294c170df354fe892831281acd4ea7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:54.007305 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391b1528-934a-4884-b73c-24448aec3ef2 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:54.007583 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391b1528-934a-4884-b73c-24448aec3ef2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:54.007854 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391b1528-934a-4884-b73c-24448aec3ef2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:54.021444 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391b1528-934a-4884-b73c-24448aec3ef2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:54.022866 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391b1528-934a-4884-b73c-24448aec3ef2 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:54.032204 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1268/2529] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:09:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:09:54.320760 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe760421-ae6c-44f2-b97b-ec2293beacd2 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:54.325243 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-fe760421-ae6c-44f2-b97b-ec2293beacd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:09:54.345391 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe760421-ae6c-44f2-b97b-ec2293beacd2 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:54.356539 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3789ed57-8424-4226-9ac8-7ab87c425871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:54.357600 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3789ed57-8424-4226-9ac8-7ab87c425871 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:54.358139 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3789ed57-8424-4226-9ac8-7ab87c425871 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:54.358616 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3789ed57-8424-4226-9ac8-7ab87c425871 admin admin] PATH_INFO: `/v3/projects/f467bda8cab14e6cb91d97db3b3c901d` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:54.360067 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3789ed57-8424-4226-9ac8-7ab87c425871 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f467bda8cab14e6cb91d97db3b3c901d)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:54.363073 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3789ed57-8424-4226-9ac8-7ab87c425871 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:54.413033 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-3789ed57-8424-4226-9ac8-7ab87c425871 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f467bda8cab14e6cb91d97db3b3c901d', 'request_id': 'req-3789ed57-8424-4226-9ac8-7ab87c425871'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:54.418638 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-3789ed57-8424-4226-9ac8-7ab87c425871 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f467bda8cab14e6cb91d97db3b3c901d', 'request_id': 'req-3789ed57-8424-4226-9ac8-7ab87c425871'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:54.428542 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-3789ed57-8424-4226-9ac8-7ab87c425871 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f467bda8cab14e6cb91d97db3b3c901d', 'request_id': 'req-3789ed57-8424-4226-9ac8-7ab87c425871'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:54.440749 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-3789ed57-8424-4226-9ac8-7ab87c425871 admin admin] The token cache is being invalidate because project f467bda8cab14e6cb91d97db3b3c901d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 10:09:54.441040 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-3789ed57-8424-4226-9ac8-7ab87c425871 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:54.442916 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-3789ed57-8424-4226-9ac8-7ab87c425871 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:54.444451 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1262/2530] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 10 10:09:54 2022] DELETE /identity/v3/projects/f467bda8cab14e6cb91d97db3b3c901d => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:09:54.449625 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aaf764-2e4e-4d87-99d6-52a6f96c2cf2 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:54.449908 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aaf764-2e4e-4d87-99d6-52a6f96c2cf2 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:54.450207 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aaf764-2e4e-4d87-99d6-52a6f96c2cf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:54.470327 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-79aaf764-2e4e-4d87-99d6-52a6f96c2cf2 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:09:54.471538 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-79aaf764-2e4e-4d87-99d6-52a6f96c2cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:09:54.532150 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3789ed57-8424-4226-9ac8-7ab87c425871 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:54.533675 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-3789ed57-8424-4226-9ac8-7ab87c425871 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:09:54.541158 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1269/2531] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:09:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 10:09:54.550182 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295b8f21-b1e8-4f9f-840d-f256bcb14e38 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:54.550466 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295b8f21-b1e8-4f9f-840d-f256bcb14e38 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:54.550741 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295b8f21-b1e8-4f9f-840d-f256bcb14e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:54.570129 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-295b8f21-b1e8-4f9f-840d-f256bcb14e38 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:09:54.571345 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-295b8f21-b1e8-4f9f-840d-f256bcb14e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:09:54.579549 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1270/2532] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:09:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 10:09:54.583822 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295b8f21-b1e8-4f9f-840d-f256bcb14e38 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:54.584018 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:09:54.593037 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295b8f21-b1e8-4f9f-840d-f256bcb14e38 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:54.597686 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a623a9-a430-4c01-9687-c53b0a069bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:54.598293 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a623a9-a430-4c01-9687-c53b0a069bdc admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:54.598742 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a623a9-a430-4c01-9687-c53b0a069bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:54.599045 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a623a9-a430-4c01-9687-c53b0a069bdc admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:54.599791 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a623a9-a430-4c01-9687-c53b0a069bdc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:09:54.600089 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a623a9-a430-4c01-9687-c53b0a069bdc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:54.601718 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a623a9-a430-4c01-9687-c53b0a069bdc admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:54.603403 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3789ed57-8424-4226-9ac8-7ab87c425871 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:54.607093 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3743547c-8041-47f9-a216-db80bae85f6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4294c170df354fe892831281acd4ea7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:54.607698 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3743547c-8041-47f9-a216-db80bae85f6a service neutron] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:54.607977 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3743547c-8041-47f9-a216-db80bae85f6a service neutron] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:54.608648 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3743547c-8041-47f9-a216-db80bae85f6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:54.610525 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-3743547c-8041-47f9-a216-db80bae85f6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:09:54.613312 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1271/2533] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 10 10:09:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 10:09:54.617568 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a623a9-a430-4c01-9687-c53b0a069bdc admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:54.625750 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3743547c-8041-47f9-a216-db80bae85f6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:54.627343 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3743547c-8041-47f9-a216-db80bae85f6a service neutron] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:54.627489 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a623a9-a430-4c01-9687-c53b0a069bdc admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:54.632549 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eda8846-e888-4d49-9b01-32f8f84f7c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:54.633197 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eda8846-e888-4d49-9b01-32f8f84f7c50 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:54.633482 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eda8846-e888-4d49-9b01-32f8f84f7c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:54.633782 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eda8846-e888-4d49-9b01-32f8f84f7c50 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:54.634603 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eda8846-e888-4d49-9b01-32f8f84f7c50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:54.636540 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eda8846-e888-4d49-9b01-32f8f84f7c50 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:54.639100 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1263/2534] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:09:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 10:09:54.673823 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1272/2535] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 10 10:09:54 2022] POST /identity/v3/projects => generated 375 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 10:09:54.674791 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3743547c-8041-47f9-a216-db80bae85f6a service neutron] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:54.688846 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3743547c-8041-47f9-a216-db80bae85f6a service neutron] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:54.758613 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716ae8ad-8ba7-4173-948f-894fbe021bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:54.759767 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716ae8ad-8ba7-4173-948f-894fbe021bca admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:54.760049 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716ae8ad-8ba7-4173-948f-894fbe021bca admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:54.760825 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716ae8ad-8ba7-4173-948f-894fbe021bca admin admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:54.762133 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716ae8ad-8ba7-4173-948f-894fbe021bca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:54.763317 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716ae8ad-8ba7-4173-948f-894fbe021bca admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:54.788409 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1264/2536] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 10 10:09:54 2022] POST /identity/v3/users => generated 288 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:09:54.792416 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eda8846-e888-4d49-9b01-32f8f84f7c50 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:54.803264 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eda8846-e888-4d49-9b01-32f8f84f7c50 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:54.808722 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986f2441-9c91-4426-a2f5-d2439502a1a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:54.809436 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986f2441-9c91-4426-a2f5-d2439502a1a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:54.809775 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986f2441-9c91-4426-a2f5-d2439502a1a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:54.810104 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986f2441-9c91-4426-a2f5-d2439502a1a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:54.810821 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986f2441-9c91-4426-a2f5-d2439502a1a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:54.812500 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986f2441-9c91-4426-a2f5-d2439502a1a2 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:54.827730 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1273/2537] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:09:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:09:54.829116 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716ae8ad-8ba7-4173-948f-894fbe021bca admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:54.839672 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716ae8ad-8ba7-4173-948f-894fbe021bca admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:54.845186 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e49b68-d1e6-491f-9c4f-4c184f39712a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:54.845930 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e49b68-d1e6-491f-9c4f-4c184f39712a admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:54.846510 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e49b68-d1e6-491f-9c4f-4c184f39712a admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:54.846626 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e49b68-d1e6-491f-9c4f-4c184f39712a admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:54.847403 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e49b68-d1e6-491f-9c4f-4c184f39712a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:54.849242 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e49b68-d1e6-491f-9c4f-4c184f39712a admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:54.867301 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1265/2538] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:09:54 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:09:54.871619 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986f2441-9c91-4426-a2f5-d2439502a1a2 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:54.882052 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986f2441-9c91-4426-a2f5-d2439502a1a2 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:54.886859 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da279635-f35a-4589-ad4e-05e5b3d63be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:54.887513 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da279635-f35a-4589-ad4e-05e5b3d63be9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:54.887793 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da279635-f35a-4589-ad4e-05e5b3d63be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:54.888067 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da279635-f35a-4589-ad4e-05e5b3d63be9 admin admin] PATH_INFO: `/v3/projects/92879d1545b14e28b0e15dccbdfdd3af/users/b5f05c3c438546ea9da423660c7eeba4/roles/8daabcb6b7394e39b06a3453e33e32db` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:54.906163 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da279635-f35a-4589-ad4e-05e5b3d63be9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92879d1545b14e28b0e15dccbdfdd3af, user_id=b5f05c3c438546ea9da423660c7eeba4, role_id=8daabcb6b7394e39b06a3453e33e32db)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:54.909096 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da279635-f35a-4589-ad4e-05e5b3d63be9 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:54.926020 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1274/2539] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:09:54 2022] PUT /identity/v3/projects/92879d1545b14e28b0e15dccbdfdd3af/users/b5f05c3c438546ea9da423660c7eeba4/roles/8daabcb6b7394e39b06a3453e33e32db => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:09:54.936632 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb52fa1-7316-425e-b931-3553318519c2 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:54.936926 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb52fa1-7316-425e-b931-3553318519c2 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:54.937230 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb52fa1-7316-425e-b931-3553318519c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:54.966546 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-6eb52fa1-7316-425e-b931-3553318519c2 None None] MFA Rules not processed for user `b5f05c3c438546ea9da423660c7eeba4`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:09:54.967773 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-6eb52fa1-7316-425e-b931-3553318519c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:09:55.045111 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1266/2540] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:09:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:09:55.046745 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da279635-f35a-4589-ad4e-05e5b3d63be9 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:55.069105 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:DELETE=1,keystone:SELECT=97,keystone:INSERT=2 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:09:55.112608 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da279635-f35a-4589-ad4e-05e5b3d63be9 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:55.119340 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f94862-3c08-44de-b603-9d5f46fb80fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:55.120071 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f94862-3c08-44de-b603-9d5f46fb80fb admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:55.120448 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f94862-3c08-44de-b603-9d5f46fb80fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:55.120791 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f94862-3c08-44de-b603-9d5f46fb80fb admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:55.121544 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f94862-3c08-44de-b603-9d5f46fb80fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:55.123696 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f94862-3c08-44de-b603-9d5f46fb80fb admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:55.156128 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1275/2541] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 10 10:09:55 2022] POST /identity/v3/projects => generated 373 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 10:09:55.160152 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb52fa1-7316-425e-b931-3553318519c2 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:55.173640 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb52fa1-7316-425e-b931-3553318519c2 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:55.236645 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:09:55.250750 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db12d3ea-bb17-435b-86ef-da9a7b39115f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:55.251488 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db12d3ea-bb17-435b-86ef-da9a7b39115f admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:55.251863 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db12d3ea-bb17-435b-86ef-da9a7b39115f admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:55.252207 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db12d3ea-bb17-435b-86ef-da9a7b39115f admin admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:55.252934 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db12d3ea-bb17-435b-86ef-da9a7b39115f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:55.255040 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db12d3ea-bb17-435b-86ef-da9a7b39115f admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:55.283811 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1267/2542] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 10 10:09:55 2022] POST /identity/v3/users => generated 293 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:09:55.287988 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f94862-3c08-44de-b603-9d5f46fb80fb admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:55.314397 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f94862-3c08-44de-b603-9d5f46fb80fb admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:55.318242 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db12d3ea-bb17-435b-86ef-da9a7b39115f admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:55.319821 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b159611-493e-4c61-8233-974a466df5f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:55.320190 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-db12d3ea-bb17-435b-86ef-da9a7b39115f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:09:55.320636 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b159611-493e-4c61-8233-974a466df5f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:55.321029 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b159611-493e-4c61-8233-974a466df5f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:55.321471 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b159611-493e-4c61-8233-974a466df5f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:55.322157 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b159611-493e-4c61-8233-974a466df5f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:55.323828 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b159611-493e-4c61-8233-974a466df5f6 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:55.337105 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1276/2543] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:09:55 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:09:55.341290 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b159611-493e-4c61-8233-974a466df5f6 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:55.352091 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b159611-493e-4c61-8233-974a466df5f6 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:55.356880 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db7d8ae-28ac-4be1-878e-675d757987d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:55.357619 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db7d8ae-28ac-4be1-878e-675d757987d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:55.357948 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db7d8ae-28ac-4be1-878e-675d757987d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:55.358126 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db7d8ae-28ac-4be1-878e-675d757987d1 admin admin] PATH_INFO: `/v3/projects/de9ae088518f4d30992dded7f562639f/users/2a7f1cb93c32481aac6eb64da7a0ea0a/roles/eb04edc46b3742d7a0f0ead26f68bc22` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:55.374965 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db7d8ae-28ac-4be1-878e-675d757987d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de9ae088518f4d30992dded7f562639f, user_id=2a7f1cb93c32481aac6eb64da7a0ea0a, role_id=eb04edc46b3742d7a0f0ead26f68bc22)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:55.377705 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db7d8ae-28ac-4be1-878e-675d757987d1 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:55.395134 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db12d3ea-bb17-435b-86ef-da9a7b39115f admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:55.402186 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1277/2544] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:09:55 2022] PUT /identity/v3/projects/de9ae088518f4d30992dded7f562639f/users/2a7f1cb93c32481aac6eb64da7a0ea0a/roles/eb04edc46b3742d7a0f0ead26f68bc22 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:09:55.403353 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db7d8ae-28ac-4be1-878e-675d757987d1 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:55.471047 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f0de0f-844b-4e08-b8cf-b16ec92d9bbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4294c170df354fe892831281acd4ea7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:55.471831 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f0de0f-844b-4e08-b8cf-b16ec92d9bbe service neutron] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:55.472571 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f0de0f-844b-4e08-b8cf-b16ec92d9bbe service neutron] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:55.472571 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f0de0f-844b-4e08-b8cf-b16ec92d9bbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:55.474967 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-39f0de0f-844b-4e08-b8cf-b16ec92d9bbe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:09:55.491775 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db7d8ae-28ac-4be1-878e-675d757987d1 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:55.496784 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd85ef12-8bf5-4784-b62d-179767af80f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:55.497423 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd85ef12-8bf5-4784-b62d-179767af80f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:55.499496 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd85ef12-8bf5-4784-b62d-179767af80f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:55.499496 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd85ef12-8bf5-4784-b62d-179767af80f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:55.499909 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f0de0f-844b-4e08-b8cf-b16ec92d9bbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:55.500027 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd85ef12-8bf5-4784-b62d-179767af80f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:55.501439 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f0de0f-844b-4e08-b8cf-b16ec92d9bbe service neutron] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:55.501606 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd85ef12-8bf5-4784-b62d-179767af80f1 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:55.512800 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1278/2545] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:09:55 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:09:55.517118 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd85ef12-8bf5-4784-b62d-179767af80f1 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:55.529525 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd85ef12-8bf5-4784-b62d-179767af80f1 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:55.531139 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1268/2546] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:09:55 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 10:09:55.536805 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a59213a-71a5-447d-b5ca-b2981c01c138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:55.537445 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a59213a-71a5-447d-b5ca-b2981c01c138 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:55.537794 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a59213a-71a5-447d-b5ca-b2981c01c138 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:55.538129 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a59213a-71a5-447d-b5ca-b2981c01c138 admin admin] PATH_INFO: `/v3/projects/de9ae088518f4d30992dded7f562639f/users/2a7f1cb93c32481aac6eb64da7a0ea0a/roles/eb04edc46b3742d7a0f0ead26f68bc22` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:55.540626 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a59213a-71a5-447d-b5ca-b2981c01c138 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de9ae088518f4d30992dded7f562639f, user_id=2a7f1cb93c32481aac6eb64da7a0ea0a, role_id=eb04edc46b3742d7a0f0ead26f68bc22)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:55.543249 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a59213a-71a5-447d-b5ca-b2981c01c138 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:55.559130 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1279/2547] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:09:55 2022] PUT /identity/v3/projects/de9ae088518f4d30992dded7f562639f/users/2a7f1cb93c32481aac6eb64da7a0ea0a/roles/eb04edc46b3742d7a0f0ead26f68bc22 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 10:09:55.570148 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed98c7a3-eb5e-4d4b-b652-96f60744dcf0 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:55.570754 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed98c7a3-eb5e-4d4b-b652-96f60744dcf0 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:55.571043 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed98c7a3-eb5e-4d4b-b652-96f60744dcf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:55.603973 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-ed98c7a3-eb5e-4d4b-b652-96f60744dcf0 None None] MFA Rules not processed for user `2a7f1cb93c32481aac6eb64da7a0ea0a`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:09:55.605593 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-ed98c7a3-eb5e-4d4b-b652-96f60744dcf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:09:55.698532 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1269/2548] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:09:55 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:09:55.709777 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a59213a-71a5-447d-b5ca-b2981c01c138 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:55.711571 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-0a59213a-71a5-447d-b5ca-b2981c01c138 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:09:55.781860 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a59213a-71a5-447d-b5ca-b2981c01c138 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:55.786828 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394f3943-27b5-439e-8adf-b10dba5c03ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf8e725cbe0403d943b136235eac057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:55.787794 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394f3943-27b5-439e-8adf-b10dba5c03ef service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:55.788720 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394f3943-27b5-439e-8adf-b10dba5c03ef service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:55.789598 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394f3943-27b5-439e-8adf-b10dba5c03ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:55.799034 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:09:55.887228 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394f3943-27b5-439e-8adf-b10dba5c03ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:55.889044 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394f3943-27b5-439e-8adf-b10dba5c03ef service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:55.904877 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1280/2549] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:09:55 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:09:58.357022 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed98c7a3-eb5e-4d4b-b652-96f60744dcf0 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:58.359073 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-ed98c7a3-eb5e-4d4b-b652-96f60744dcf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:09:58.411683 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:09:58.471625 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed98c7a3-eb5e-4d4b-b652-96f60744dcf0 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:58.483085 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dff463-ddf5-45a0-8115-7d9d7457b5e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:58.484348 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dff463-ddf5-45a0-8115-7d9d7457b5e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:58.484348 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dff463-ddf5-45a0-8115-7d9d7457b5e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:58.484645 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dff463-ddf5-45a0-8115-7d9d7457b5e4 admin admin] PATH_INFO: `/v3/users/3027050c9e124590971f3930146522d1` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:58.486060 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dff463-ddf5-45a0-8115-7d9d7457b5e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3027050c9e124590971f3930146522d1)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:58.487944 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dff463-ddf5-45a0-8115-7d9d7457b5e4 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:58.542160 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-96dff463-ddf5-45a0-8115-7d9d7457b5e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3027050c9e124590971f3930146522d1'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:58.554103 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-96dff463-ddf5-45a0-8115-7d9d7457b5e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3027050c9e124590971f3930146522d1'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:58.563126 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-96dff463-ddf5-45a0-8115-7d9d7457b5e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3027050c9e124590971f3930146522d1'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:58.564172 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-96dff463-ddf5-45a0-8115-7d9d7457b5e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3027050c9e124590971f3930146522d1'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:58.565164 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-96dff463-ddf5-45a0-8115-7d9d7457b5e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3027050c9e124590971f3930146522d1'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:58.590693 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1270/2550] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 10 10:09:58 2022] DELETE /identity/v3/users/3027050c9e124590971f3930146522d1 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:09:58.732284 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394f3943-27b5-439e-8adf-b10dba5c03ef service cinder] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:58.747002 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394f3943-27b5-439e-8adf-b10dba5c03ef service cinder] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:58.787514 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dff463-ddf5-45a0-8115-7d9d7457b5e4 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:58.789164 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-96dff463-ddf5-45a0-8115-7d9d7457b5e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:09:58.837895 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccb10bf-e200-4de2-8993-4ebd1ca7a1c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:58.838226 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccb10bf-e200-4de2-8993-4ebd1ca7a1c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:58.838504 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccb10bf-e200-4de2-8993-4ebd1ca7a1c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:58.838778 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccb10bf-e200-4de2-8993-4ebd1ca7a1c4 admin admin] PATH_INFO: `/v3/users/b5f05c3c438546ea9da423660c7eeba4` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:58.839907 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccb10bf-e200-4de2-8993-4ebd1ca7a1c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5f05c3c438546ea9da423660c7eeba4)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:58.842671 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccb10bf-e200-4de2-8993-4ebd1ca7a1c4 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:58.879612 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dff463-ddf5-45a0-8115-7d9d7457b5e4 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:58.884748 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722cdb90-fe0a-4cf5-bff1-b46cfc3e1a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:58.885418 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722cdb90-fe0a-4cf5-bff1-b46cfc3e1a52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:58.885695 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722cdb90-fe0a-4cf5-bff1-b46cfc3e1a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:58.885965 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722cdb90-fe0a-4cf5-bff1-b46cfc3e1a52 admin admin] PATH_INFO: `/v3/projects/7874da1d05f54801b0724eb40ffa2317` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:58.887091 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722cdb90-fe0a-4cf5-bff1-b46cfc3e1a52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7874da1d05f54801b0724eb40ffa2317)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:58.889207 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722cdb90-fe0a-4cf5-bff1-b46cfc3e1a52 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:58.898898 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-4ccb10bf-e200-4de2-8993-4ebd1ca7a1c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5f05c3c438546ea9da423660c7eeba4'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:58.907312 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-4ccb10bf-e200-4de2-8993-4ebd1ca7a1c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5f05c3c438546ea9da423660c7eeba4'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:58.908080 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-4ccb10bf-e200-4de2-8993-4ebd1ca7a1c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5f05c3c438546ea9da423660c7eeba4'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:58.908693 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-4ccb10bf-e200-4de2-8993-4ebd1ca7a1c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5f05c3c438546ea9da423660c7eeba4'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:58.921827 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-4ccb10bf-e200-4de2-8993-4ebd1ca7a1c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5f05c3c438546ea9da423660c7eeba4'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:58.940217 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:09:58.943688 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1281/2551] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 10 10:09:58 2022] DELETE /identity/v3/users/b5f05c3c438546ea9da423660c7eeba4 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:09:58.943844 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-722cdb90-fe0a-4cf5-bff1-b46cfc3e1a52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7874da1d05f54801b0724eb40ffa2317', 'request_id': 'req-722cdb90-fe0a-4cf5-bff1-b46cfc3e1a52'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:58.947926 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aeb15a-8d16-4aee-abbb-65acbdebef9d None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:58.948763 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aeb15a-8d16-4aee-abbb-65acbdebef9d None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:58.948763 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aeb15a-8d16-4aee-abbb-65acbdebef9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:58.950510 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-722cdb90-fe0a-4cf5-bff1-b46cfc3e1a52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7874da1d05f54801b0724eb40ffa2317', 'request_id': 'req-722cdb90-fe0a-4cf5-bff1-b46cfc3e1a52'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:58.961106 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-722cdb90-fe0a-4cf5-bff1-b46cfc3e1a52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7874da1d05f54801b0724eb40ffa2317', 'request_id': 'req-722cdb90-fe0a-4cf5-bff1-b46cfc3e1a52'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:58.968634 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-66aeb15a-8d16-4aee-abbb-65acbdebef9d None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:09:58.970015 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-66aeb15a-8d16-4aee-abbb-65acbdebef9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:09:58.974107 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-722cdb90-fe0a-4cf5-bff1-b46cfc3e1a52 admin admin] The token cache is being invalidate because project 7874da1d05f54801b0724eb40ffa2317 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 10:09:58.974107 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-722cdb90-fe0a-4cf5-bff1-b46cfc3e1a52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:58.974768 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-722cdb90-fe0a-4cf5-bff1-b46cfc3e1a52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:58.976488 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1271/2552] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 10 10:09:58 2022] DELETE /identity/v3/projects/7874da1d05f54801b0724eb40ffa2317 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 10:09:58.981521 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feb9926-3826-448a-ac58-6ec20bdfce27 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:58.981802 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feb9926-3826-448a-ac58-6ec20bdfce27 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:58.982396 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feb9926-3826-448a-ac58-6ec20bdfce27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:58.996729 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:09:59.004294 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-9feb9926-3826-448a-ac58-6ec20bdfce27 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:09:59.005856 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-9feb9926-3826-448a-ac58-6ec20bdfce27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:09:59.063777 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1282/2553] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:09:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 10:09:59.076582 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aeb15a-8d16-4aee-abbb-65acbdebef9d None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:59.079259 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-66aeb15a-8d16-4aee-abbb-65acbdebef9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:09:59.118130 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1272/2554] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:09:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 10:09:59.127118 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe77940b-b523-4742-98d4-eb1d5b3be1b3 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:59.129513 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe77940b-b523-4742-98d4-eb1d5b3be1b3 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:59.129513 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe77940b-b523-4742-98d4-eb1d5b3be1b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:59.152428 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-fe77940b-b523-4742-98d4-eb1d5b3be1b3 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:09:59.153804 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-fe77940b-b523-4742-98d4-eb1d5b3be1b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:09:59.170870 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1273/2555] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:09:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:09:59.172054 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe77940b-b523-4742-98d4-eb1d5b3be1b3 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:59.173875 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aeb15a-8d16-4aee-abbb-65acbdebef9d None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:59.178007 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8e86ff-9481-45b7-ada4-6d5a47113ade service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4294c170df354fe892831281acd4ea7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:59.178690 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8e86ff-9481-45b7-ada4-6d5a47113ade service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:59.179059 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8e86ff-9481-45b7-ada4-6d5a47113ade service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:59.179396 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8e86ff-9481-45b7-ada4-6d5a47113ade service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:59.182539 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe77940b-b523-4742-98d4-eb1d5b3be1b3 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:59.187393 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1123c1-aea4-4b35-b39e-7c5f5b9f8ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:59.187996 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1123c1-aea4-4b35-b39e-7c5f5b9f8ab0 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:59.189044 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1123c1-aea4-4b35-b39e-7c5f5b9f8ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:59.189404 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1123c1-aea4-4b35-b39e-7c5f5b9f8ab0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:59.190010 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1123c1-aea4-4b35-b39e-7c5f5b9f8ab0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:09:59.190443 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1123c1-aea4-4b35-b39e-7c5f5b9f8ab0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:59.191391 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8e86ff-9481-45b7-ada4-6d5a47113ade service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:59.192298 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1123c1-aea4-4b35-b39e-7c5f5b9f8ab0 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:59.193325 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8e86ff-9481-45b7-ada4-6d5a47113ade service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:59.206804 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1274/2556] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 10 10:09:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 10:09:59.212151 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1123c1-aea4-4b35-b39e-7c5f5b9f8ab0 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:59.214333 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1283/2557] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:09:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:09:59.225821 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1123c1-aea4-4b35-b39e-7c5f5b9f8ab0 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:59.231148 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f29ce7b-d8cd-4fef-a3d8-00ac423e455a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:59.232260 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f29ce7b-d8cd-4fef-a3d8-00ac423e455a admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:59.232404 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f29ce7b-d8cd-4fef-a3d8-00ac423e455a admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:59.232634 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f29ce7b-d8cd-4fef-a3d8-00ac423e455a admin admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:59.233303 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f29ce7b-d8cd-4fef-a3d8-00ac423e455a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:59.236635 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f29ce7b-d8cd-4fef-a3d8-00ac423e455a admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:59.272001 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1275/2558] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 10 10:09:59 2022] POST /identity/v3/projects => generated 383 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:09:59.276227 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8e86ff-9481-45b7-ada4-6d5a47113ade service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:59.289909 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8e86ff-9481-45b7-ada4-6d5a47113ade service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:59.504352 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfa2bb7-4bee-4be6-82a4-e3726338e88e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:59.505023 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfa2bb7-4bee-4be6-82a4-e3726338e88e admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:59.505318 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfa2bb7-4bee-4be6-82a4-e3726338e88e admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:59.505582 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfa2bb7-4bee-4be6-82a4-e3726338e88e admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:59.506215 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfa2bb7-4bee-4be6-82a4-e3726338e88e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:59.508124 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfa2bb7-4bee-4be6-82a4-e3726338e88e admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:59.527384 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f29ce7b-d8cd-4fef-a3d8-00ac423e455a admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:59.529758 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-6f29ce7b-d8cd-4fef-a3d8-00ac423e455a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:09:59.537438 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1284/2559] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 10 10:09:59 2022] POST /identity/v3/users => generated 292 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:09:59.541888 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfa2bb7-4bee-4be6-82a4-e3726338e88e admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:59.544423 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f29ce7b-d8cd-4fef-a3d8-00ac423e455a admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:59.549822 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704fedca-a69f-4f11-af9b-fe13b88c9285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:59.550690 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704fedca-a69f-4f11-af9b-fe13b88c9285 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:59.551190 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704fedca-a69f-4f11-af9b-fe13b88c9285 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:59.551803 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704fedca-a69f-4f11-af9b-fe13b88c9285 admin admin] PATH_INFO: `/v3/projects/92879d1545b14e28b0e15dccbdfdd3af` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:59.553219 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704fedca-a69f-4f11-af9b-fe13b88c9285 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92879d1545b14e28b0e15dccbdfdd3af)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:59.556024 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704fedca-a69f-4f11-af9b-fe13b88c9285 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:59.556812 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfa2bb7-4bee-4be6-82a4-e3726338e88e admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:59.562155 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d34119-0399-4f3e-a4d5-df37ddd6485d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:59.562760 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d34119-0399-4f3e-a4d5-df37ddd6485d admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:59.563034 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d34119-0399-4f3e-a4d5-df37ddd6485d admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:59.563303 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d34119-0399-4f3e-a4d5-df37ddd6485d admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:59.564330 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d34119-0399-4f3e-a4d5-df37ddd6485d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:59.566027 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d34119-0399-4f3e-a4d5-df37ddd6485d admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:59.576800 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1285/2560] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:09:59 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:09:59.580882 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d34119-0399-4f3e-a4d5-df37ddd6485d admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:59.591777 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d34119-0399-4f3e-a4d5-df37ddd6485d admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:59.600066 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751e374b-24dd-4308-8460-e07408a38775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:59.600804 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751e374b-24dd-4308-8460-e07408a38775 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:59.601175 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751e374b-24dd-4308-8460-e07408a38775 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:59.601517 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751e374b-24dd-4308-8460-e07408a38775 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:59.602372 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751e374b-24dd-4308-8460-e07408a38775 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:59.604169 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751e374b-24dd-4308-8460-e07408a38775 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:59.619100 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1286/2561] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:09:59 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 10:09:59.619267 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-704fedca-a69f-4f11-af9b-fe13b88c9285 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92879d1545b14e28b0e15dccbdfdd3af', 'request_id': 'req-704fedca-a69f-4f11-af9b-fe13b88c9285'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:59.620202 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751e374b-24dd-4308-8460-e07408a38775 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:59.622585 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-704fedca-a69f-4f11-af9b-fe13b88c9285 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92879d1545b14e28b0e15dccbdfdd3af', 'request_id': 'req-704fedca-a69f-4f11-af9b-fe13b88c9285'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:59.631862 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751e374b-24dd-4308-8460-e07408a38775 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:59.632045 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-704fedca-a69f-4f11-af9b-fe13b88c9285 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92879d1545b14e28b0e15dccbdfdd3af', 'request_id': 'req-704fedca-a69f-4f11-af9b-fe13b88c9285'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:59.646296 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-704fedca-a69f-4f11-af9b-fe13b88c9285 admin admin] The token cache is being invalidate because project 92879d1545b14e28b0e15dccbdfdd3af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 10:09:59.646589 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-704fedca-a69f-4f11-af9b-fe13b88c9285 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:59.647230 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-704fedca-a69f-4f11-af9b-fe13b88c9285 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:59.654982 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1276/2562] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 10 10:09:59 2022] DELETE /identity/v3/projects/92879d1545b14e28b0e15dccbdfdd3af => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 10:09:59.654982 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704fedca-a69f-4f11-af9b-fe13b88c9285 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:59.658415 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-704fedca-a69f-4f11-af9b-fe13b88c9285 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:09:59.685296 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:09:59.690319 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:09:59.712814 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7692074e-aaf0-4a39-abe3-46296e8ca4d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:59.713522 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7692074e-aaf0-4a39-abe3-46296e8ca4d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:59.713798 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7692074e-aaf0-4a39-abe3-46296e8ca4d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:59.714065 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7692074e-aaf0-4a39-abe3-46296e8ca4d9 admin admin] PATH_INFO: `/v3/projects/d6a74d857690466ca80d4d3525778d15/users/21e6896833f84a9ead20b483218e1a71/roles/8daabcb6b7394e39b06a3453e33e32db` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:59.732781 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7692074e-aaf0-4a39-abe3-46296e8ca4d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6a74d857690466ca80d4d3525778d15, user_id=21e6896833f84a9ead20b483218e1a71, role_id=8daabcb6b7394e39b06a3453e33e32db)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:59.736174 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7692074e-aaf0-4a39-abe3-46296e8ca4d9 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:59.752032 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1287/2563] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:09:59 2022] PUT /identity/v3/projects/d6a74d857690466ca80d4d3525778d15/users/21e6896833f84a9ead20b483218e1a71/roles/8daabcb6b7394e39b06a3453e33e32db => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 10:09:59.757317 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704fedca-a69f-4f11-af9b-fe13b88c9285 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:09:59.762015 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d5d7f7-013e-4722-99cd-62afccc48fa6 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:59.762302 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d5d7f7-013e-4722-99cd-62afccc48fa6 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:59.762572 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d5d7f7-013e-4722-99cd-62afccc48fa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:59.799044 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-86d5d7f7-013e-4722-99cd-62afccc48fa6 None None] MFA Rules not processed for user `21e6896833f84a9ead20b483218e1a71`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:09:59.800903 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-86d5d7f7-013e-4722-99cd-62afccc48fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:09:59.827547 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eee57f-5c33-4c27-8ff7-c8d90f04885f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:09:59.828221 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eee57f-5c33-4c27-8ff7-c8d90f04885f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:09:59.828499 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eee57f-5c33-4c27-8ff7-c8d90f04885f admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:09:59.828771 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eee57f-5c33-4c27-8ff7-c8d90f04885f admin admin] PATH_INFO: `/v3/users/2a7f1cb93c32481aac6eb64da7a0ea0a` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:09:59.830359 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eee57f-5c33-4c27-8ff7-c8d90f04885f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a7f1cb93c32481aac6eb64da7a0ea0a)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:09:59.832115 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eee57f-5c33-4c27-8ff7-c8d90f04885f admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:09:59.882620 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-c2eee57f-5c33-4c27-8ff7-c8d90f04885f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a7f1cb93c32481aac6eb64da7a0ea0a'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:59.890473 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-c2eee57f-5c33-4c27-8ff7-c8d90f04885f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a7f1cb93c32481aac6eb64da7a0ea0a'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:59.899581 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1288/2564] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:09:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:09:59.904991 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-c2eee57f-5c33-4c27-8ff7-c8d90f04885f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a7f1cb93c32481aac6eb64da7a0ea0a'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:59.905778 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-c2eee57f-5c33-4c27-8ff7-c8d90f04885f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a7f1cb93c32481aac6eb64da7a0ea0a'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:59.906625 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-c2eee57f-5c33-4c27-8ff7-c8d90f04885f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a7f1cb93c32481aac6eb64da7a0ea0a'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:09:59.921409 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d5d7f7-013e-4722-99cd-62afccc48fa6 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:09:59.921409 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-86d5d7f7-013e-4722-99cd-62afccc48fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:09:59.934899 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1277/2565] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 10 10:09:59 2022] DELETE /identity/v3/users/2a7f1cb93c32481aac6eb64da7a0ea0a => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 10:09:59.989646 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d5d7f7-013e-4722-99cd-62afccc48fa6 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:00.035287 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:10:00.056174 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8da48ee-6dbc-4b5b-a0ce-fe73bad6d019 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd8580888cba41a88566da4540b1130c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:00.056912 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8da48ee-6dbc-4b5b-a0ce-fe73bad6d019 service nova] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:00.057500 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8da48ee-6dbc-4b5b-a0ce-fe73bad6d019 service nova] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:00.057851 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8da48ee-6dbc-4b5b-a0ce-fe73bad6d019 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:00.059654 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-d8da48ee-6dbc-4b5b-a0ce-fe73bad6d019 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:00.120721 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8da48ee-6dbc-4b5b-a0ce-fe73bad6d019 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:00.122359 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8da48ee-6dbc-4b5b-a0ce-fe73bad6d019 service nova] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:00.131266 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1289/2566] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:09:59 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 10:10:00.222871 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eee57f-5c33-4c27-8ff7-c8d90f04885f admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:00.224342 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-c2eee57f-5c33-4c27-8ff7-c8d90f04885f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:00.276904 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:10:00.308463 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eee57f-5c33-4c27-8ff7-c8d90f04885f admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:00.314936 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796feeb5-603a-4cd9-a807-03082ee98381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:00.316027 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796feeb5-603a-4cd9-a807-03082ee98381 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:00.316471 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796feeb5-603a-4cd9-a807-03082ee98381 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:00.316756 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796feeb5-603a-4cd9-a807-03082ee98381 admin admin] PATH_INFO: `/v3/projects/de9ae088518f4d30992dded7f562639f` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:00.318135 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796feeb5-603a-4cd9-a807-03082ee98381 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de9ae088518f4d30992dded7f562639f)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:00.320061 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796feeb5-603a-4cd9-a807-03082ee98381 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:00.381055 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-796feeb5-603a-4cd9-a807-03082ee98381 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de9ae088518f4d30992dded7f562639f', 'request_id': 'req-796feeb5-603a-4cd9-a807-03082ee98381'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:00.391805 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-796feeb5-603a-4cd9-a807-03082ee98381 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de9ae088518f4d30992dded7f562639f', 'request_id': 'req-796feeb5-603a-4cd9-a807-03082ee98381'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:00.403718 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-796feeb5-603a-4cd9-a807-03082ee98381 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de9ae088518f4d30992dded7f562639f', 'request_id': 'req-796feeb5-603a-4cd9-a807-03082ee98381'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:00.418441 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-796feeb5-603a-4cd9-a807-03082ee98381 admin admin] The token cache is being invalidate because project de9ae088518f4d30992dded7f562639f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 10:10:00.418847 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-796feeb5-603a-4cd9-a807-03082ee98381 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:00.419608 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-796feeb5-603a-4cd9-a807-03082ee98381 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:00.421246 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1278/2567] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 10 10:10:00 2022] DELETE /identity/v3/projects/de9ae088518f4d30992dded7f562639f => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:10:00.426696 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643c5545-1481-48a5-9d33-16495c6ee285 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:00.427244 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643c5545-1481-48a5-9d33-16495c6ee285 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:00.427577 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643c5545-1481-48a5-9d33-16495c6ee285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:00.456704 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-643c5545-1481-48a5-9d33-16495c6ee285 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:10:00.458354 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-643c5545-1481-48a5-9d33-16495c6ee285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:00.552244 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1290/2568] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:10:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:10:00.624338 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cf3325-4b9d-492d-acf7-66f3c978502b None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:00.624906 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cf3325-4b9d-492d-acf7-66f3c978502b None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:00.625142 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cf3325-4b9d-492d-acf7-66f3c978502b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:00.644690 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-41cf3325-4b9d-492d-acf7-66f3c978502b None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:10:00.646166 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-41cf3325-4b9d-492d-acf7-66f3c978502b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:00.654231 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1279/2569] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:10:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:10:00.658921 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643c5545-1481-48a5-9d33-16495c6ee285 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:00.669667 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643c5545-1481-48a5-9d33-16495c6ee285 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:00.682488 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ffe7fd-1d52-422a-96e7-a1ec3f382074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:00.683141 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ffe7fd-1d52-422a-96e7-a1ec3f382074 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:00.683418 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ffe7fd-1d52-422a-96e7-a1ec3f382074 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:00.683687 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ffe7fd-1d52-422a-96e7-a1ec3f382074 admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:00.684370 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ffe7fd-1d52-422a-96e7-a1ec3f382074 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:10:00.684666 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ffe7fd-1d52-422a-96e7-a1ec3f382074 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:00.686362 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ffe7fd-1d52-422a-96e7-a1ec3f382074 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:00.698724 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1291/2570] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 10 10:10:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:10:00.703211 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cf3325-4b9d-492d-acf7-66f3c978502b None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:00.712995 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cf3325-4b9d-492d-acf7-66f3c978502b None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:00.717766 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39663269-4b46-474c-b819-3d338d5eb012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:00.718373 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39663269-4b46-474c-b819-3d338d5eb012 admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:00.718651 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39663269-4b46-474c-b819-3d338d5eb012 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:00.718921 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39663269-4b46-474c-b819-3d338d5eb012 admin admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:00.719540 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39663269-4b46-474c-b819-3d338d5eb012 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:00.721505 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39663269-4b46-474c-b819-3d338d5eb012 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:00.749492 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1280/2571] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 10 10:10:00 2022] POST /identity/v3/projects => generated 399 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:10:00.753772 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ffe7fd-1d52-422a-96e7-a1ec3f382074 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:00.763747 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ffe7fd-1d52-422a-96e7-a1ec3f382074 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:00.819684 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79024497-7045-411a-a450-5c0e7b103f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:00.820249 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79024497-7045-411a-a450-5c0e7b103f7f admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:00.820598 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79024497-7045-411a-a450-5c0e7b103f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:00.820804 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79024497-7045-411a-a450-5c0e7b103f7f admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:00.821461 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79024497-7045-411a-a450-5c0e7b103f7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:00.823364 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79024497-7045-411a-a450-5c0e7b103f7f admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:00.844862 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1292/2572] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 10 10:10:00 2022] POST /identity/v3/users => generated 300 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:10:00.849310 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39663269-4b46-474c-b819-3d338d5eb012 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:00.860454 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39663269-4b46-474c-b819-3d338d5eb012 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:00.866536 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f26dc9-47b2-4658-9958-123b06cc8b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:00.867205 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f26dc9-47b2-4658-9958-123b06cc8b1d admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:00.867484 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f26dc9-47b2-4658-9958-123b06cc8b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:00.867755 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f26dc9-47b2-4658-9958-123b06cc8b1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:00.868404 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f26dc9-47b2-4658-9958-123b06cc8b1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:00.870206 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f26dc9-47b2-4658-9958-123b06cc8b1d admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:00.880743 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1281/2573] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:10:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:10:00.886971 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79024497-7045-411a-a450-5c0e7b103f7f admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:00.896589 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:10:00.901370 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79024497-7045-411a-a450-5c0e7b103f7f admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:00.909295 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a452565-7259-4f96-ad82-717b0dcfbb8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:00.910249 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a452565-7259-4f96-ad82-717b0dcfbb8f admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:00.910720 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a452565-7259-4f96-ad82-717b0dcfbb8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:00.911324 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a452565-7259-4f96-ad82-717b0dcfbb8f admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:00.912098 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a452565-7259-4f96-ad82-717b0dcfbb8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:00.913745 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a452565-7259-4f96-ad82-717b0dcfbb8f admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:00.925294 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1293/2574] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:10:00 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:10:00.929809 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f26dc9-47b2-4658-9958-123b06cc8b1d admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:00.943312 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f26dc9-47b2-4658-9958-123b06cc8b1d admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:00.951390 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a4dce5-b468-4bd6-b176-20101077fe88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:00.952089 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a4dce5-b468-4bd6-b176-20101077fe88 admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:00.952372 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a4dce5-b468-4bd6-b176-20101077fe88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:00.952653 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a4dce5-b468-4bd6-b176-20101077fe88 admin admin] PATH_INFO: `/v3/projects/330be15c01444726a35befc0d9c8e772/users/b3ebcb59216e481d9f8a6ee1ac1ecd0a/roles/8daabcb6b7394e39b06a3453e33e32db` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:00.969894 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a4dce5-b468-4bd6-b176-20101077fe88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=330be15c01444726a35befc0d9c8e772, user_id=b3ebcb59216e481d9f8a6ee1ac1ecd0a, role_id=8daabcb6b7394e39b06a3453e33e32db)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:00.972583 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a4dce5-b468-4bd6-b176-20101077fe88 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:00.986705 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1282/2575] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:10:00 2022] PUT /identity/v3/projects/330be15c01444726a35befc0d9c8e772/users/b3ebcb59216e481d9f8a6ee1ac1ecd0a/roles/8daabcb6b7394e39b06a3453e33e32db => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:10:00.996970 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c246b1b9-4269-4fba-aa60-d779e4f67473 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:00.997469 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c246b1b9-4269-4fba-aa60-d779e4f67473 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:00.997823 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c246b1b9-4269-4fba-aa60-d779e4f67473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:01.030356 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-c246b1b9-4269-4fba-aa60-d779e4f67473 None None] MFA Rules not processed for user `b3ebcb59216e481d9f8a6ee1ac1ecd0a`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:10:01.032193 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-c246b1b9-4269-4fba-aa60-d779e4f67473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:01.107991 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1294/2576] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:10:00 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:10:01.120650 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a4dce5-b468-4bd6-b176-20101077fe88 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:01.122450 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-98a4dce5-b468-4bd6-b176-20101077fe88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:01.185482 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a4dce5-b468-4bd6-b176-20101077fe88 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:01.189626 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b288960-b93c-46ff-be0a-e92c63da7d2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf8e725cbe0403d943b136235eac057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:01.190449 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b288960-b93c-46ff-be0a-e92c63da7d2a service cinder] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:01.190679 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b288960-b93c-46ff-be0a-e92c63da7d2a service cinder] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:01.191564 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b288960-b93c-46ff-be0a-e92c63da7d2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:01.203367 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b288960-b93c-46ff-be0a-e92c63da7d2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:01.205090 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b288960-b93c-46ff-be0a-e92c63da7d2a service cinder] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:01.216018 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1283/2577] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:10:01 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:10:05.487615 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c246b1b9-4269-4fba-aa60-d779e4f67473 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:05.488450 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-c246b1b9-4269-4fba-aa60-d779e4f67473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:05.556456 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c246b1b9-4269-4fba-aa60-d779e4f67473 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:05.561230 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a55ecd-e5c8-46fe-9879-11961170b1dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:05.561855 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a55ecd-e5c8-46fe-9879-11961170b1dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:05.562130 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a55ecd-e5c8-46fe-9879-11961170b1dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:05.562405 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a55ecd-e5c8-46fe-9879-11961170b1dd admin admin] PATH_INFO: `/v3/users/21e6896833f84a9ead20b483218e1a71` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:05.563545 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a55ecd-e5c8-46fe-9879-11961170b1dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=21e6896833f84a9ead20b483218e1a71)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:05.565487 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a55ecd-e5c8-46fe-9879-11961170b1dd admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:05.616767 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-43a55ecd-e5c8-46fe-9879-11961170b1dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21e6896833f84a9ead20b483218e1a71'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:05.625994 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-43a55ecd-e5c8-46fe-9879-11961170b1dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21e6896833f84a9ead20b483218e1a71'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:05.626745 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-43a55ecd-e5c8-46fe-9879-11961170b1dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21e6896833f84a9ead20b483218e1a71'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:05.627381 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-43a55ecd-e5c8-46fe-9879-11961170b1dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21e6896833f84a9ead20b483218e1a71'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:05.634718 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-43a55ecd-e5c8-46fe-9879-11961170b1dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21e6896833f84a9ead20b483218e1a71'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:05.648145 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:10:05.653218 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1295/2578] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 10 10:10:05 2022] DELETE /identity/v3/users/21e6896833f84a9ead20b483218e1a71 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:10:05.657984 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4827bef6-2136-4f02-8ebc-973b25307de1 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:05.658476 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4827bef6-2136-4f02-8ebc-973b25307de1 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:05.658573 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4827bef6-2136-4f02-8ebc-973b25307de1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:05.678392 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-4827bef6-2136-4f02-8ebc-973b25307de1 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:10:05.679596 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-4827bef6-2136-4f02-8ebc-973b25307de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:05.684000 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:10:05.742668 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1284/2579] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:10:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:10:05.752604 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a55ecd-e5c8-46fe-9879-11961170b1dd admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:05.754199 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-43a55ecd-e5c8-46fe-9879-11961170b1dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:05.818130 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a55ecd-e5c8-46fe-9879-11961170b1dd admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:05.822215 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632ba967-df71-4b82-93ab-1ee6de6f7817 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4294c170df354fe892831281acd4ea7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:05.822874 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632ba967-df71-4b82-93ab-1ee6de6f7817 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:05.823107 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632ba967-df71-4b82-93ab-1ee6de6f7817 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:05.823381 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632ba967-df71-4b82-93ab-1ee6de6f7817 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:05.834737 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632ba967-df71-4b82-93ab-1ee6de6f7817 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:05.836225 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632ba967-df71-4b82-93ab-1ee6de6f7817 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:05.846982 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1296/2580] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:10:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:10:06.199610 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4827bef6-2136-4f02-8ebc-973b25307de1 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:06.201271 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-4827bef6-2136-4f02-8ebc-973b25307de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:06.224943 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4827bef6-2136-4f02-8ebc-973b25307de1 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:06.235986 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d628823f-14e5-40d0-9c50-4201785e4d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:06.236650 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d628823f-14e5-40d0-9c50-4201785e4d2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:06.236930 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d628823f-14e5-40d0-9c50-4201785e4d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:06.237789 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d628823f-14e5-40d0-9c50-4201785e4d2c admin admin] PATH_INFO: `/v3/projects/d6a74d857690466ca80d4d3525778d15` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:06.239045 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d628823f-14e5-40d0-9c50-4201785e4d2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6a74d857690466ca80d4d3525778d15)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:06.241236 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d628823f-14e5-40d0-9c50-4201785e4d2c admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:06.268653 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632ba967-df71-4b82-93ab-1ee6de6f7817 service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:06.270592 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-632ba967-df71-4b82-93ab-1ee6de6f7817 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:06.290731 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632ba967-df71-4b82-93ab-1ee6de6f7817 service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:06.297146 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-d628823f-14e5-40d0-9c50-4201785e4d2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6a74d857690466ca80d4d3525778d15', 'request_id': 'req-d628823f-14e5-40d0-9c50-4201785e4d2c'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:06.303335 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-d628823f-14e5-40d0-9c50-4201785e4d2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6a74d857690466ca80d4d3525778d15', 'request_id': 'req-d628823f-14e5-40d0-9c50-4201785e4d2c'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:06.311503 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-d628823f-14e5-40d0-9c50-4201785e4d2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6a74d857690466ca80d4d3525778d15', 'request_id': 'req-d628823f-14e5-40d0-9c50-4201785e4d2c'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:06.325247 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-d628823f-14e5-40d0-9c50-4201785e4d2c admin admin] The token cache is being invalidate because project d6a74d857690466ca80d4d3525778d15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 10:10:06.325547 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-d628823f-14e5-40d0-9c50-4201785e4d2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:06.326213 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-d628823f-14e5-40d0-9c50-4201785e4d2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:06.327959 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1285/2581] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 10 10:10:06 2022] DELETE /identity/v3/projects/d6a74d857690466ca80d4d3525778d15 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:10:06.332608 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ac7026-195a-479e-bb98-a46dd28ecab0 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:06.332891 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ac7026-195a-479e-bb98-a46dd28ecab0 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:06.333196 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ac7026-195a-479e-bb98-a46dd28ecab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:06.350722 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6ad040-4e7a-450e-8e95-db0d65e711f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:06.351357 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6ad040-4e7a-450e-8e95-db0d65e711f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:06.351663 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6ad040-4e7a-450e-8e95-db0d65e711f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:06.351934 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6ad040-4e7a-450e-8e95-db0d65e711f8 admin admin] PATH_INFO: `/v3/users/b3ebcb59216e481d9f8a6ee1ac1ecd0a` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:06.353106 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6ad040-4e7a-450e-8e95-db0d65e711f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3ebcb59216e481d9f8a6ee1ac1ecd0a)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:06.354241 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-f6ac7026-195a-479e-bb98-a46dd28ecab0 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:10:06.355017 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6ad040-4e7a-450e-8e95-db0d65e711f8 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:06.355446 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-f6ac7026-195a-479e-bb98-a46dd28ecab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:06.363719 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1286/2582] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:10:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 10:10:06.371651 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a466f7f-0260-4355-bc6d-298ad116cf18 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:06.371934 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a466f7f-0260-4355-bc6d-298ad116cf18 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:06.372209 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a466f7f-0260-4355-bc6d-298ad116cf18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:06.392127 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-6a466f7f-0260-4355-bc6d-298ad116cf18 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:10:06.393270 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-6a466f7f-0260-4355-bc6d-298ad116cf18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:06.402194 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1287/2583] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:10:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 10:10:06.404597 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-7a6ad040-4e7a-450e-8e95-db0d65e711f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3ebcb59216e481d9f8a6ee1ac1ecd0a'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:06.406407 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a466f7f-0260-4355-bc6d-298ad116cf18 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:06.413422 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-7a6ad040-4e7a-450e-8e95-db0d65e711f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3ebcb59216e481d9f8a6ee1ac1ecd0a'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:06.414079 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-7a6ad040-4e7a-450e-8e95-db0d65e711f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3ebcb59216e481d9f8a6ee1ac1ecd0a'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:06.414719 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-7a6ad040-4e7a-450e-8e95-db0d65e711f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3ebcb59216e481d9f8a6ee1ac1ecd0a'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:06.415691 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a466f7f-0260-4355-bc6d-298ad116cf18 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:06.420726 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f79b6d1-53a9-46f0-b9f6-ff0b0d335f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:06.421572 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f79b6d1-53a9-46f0-b9f6-ff0b0d335f7d admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:06.421856 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f79b6d1-53a9-46f0-b9f6-ff0b0d335f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:06.422224 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f79b6d1-53a9-46f0-b9f6-ff0b0d335f7d admin admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:06.422550 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-7a6ad040-4e7a-450e-8e95-db0d65e711f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3ebcb59216e481d9f8a6ee1ac1ecd0a'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:06.423281 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f79b6d1-53a9-46f0-b9f6-ff0b0d335f7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:10:06.423591 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f79b6d1-53a9-46f0-b9f6-ff0b0d335f7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:06.425239 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f79b6d1-53a9-46f0-b9f6-ff0b0d335f7d admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:06.441244 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1288/2584] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 10 10:10:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 10:10:06.442378 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f79b6d1-53a9-46f0-b9f6-ff0b0d335f7d admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:06.443340 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1297/2585] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 10 10:10:06 2022] DELETE /identity/v3/users/b3ebcb59216e481d9f8a6ee1ac1ecd0a => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 10:10:06.444413 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-4f79b6d1-53a9-46f0-b9f6-ff0b0d335f7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:06.447576 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fe495d-75ed-49b9-87b5-c2a25039a33b None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:06.447867 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fe495d-75ed-49b9-87b5-c2a25039a33b None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:06.448272 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fe495d-75ed-49b9-87b5-c2a25039a33b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:06.457133 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f79b6d1-53a9-46f0-b9f6-ff0b0d335f7d admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:06.466578 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-13fe495d-75ed-49b9-87b5-c2a25039a33b None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:10:06.467769 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-13fe495d-75ed-49b9-87b5-c2a25039a33b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:06.484608 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:10:06.516835 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d2a90a-2c9f-435c-b1a3-ac9282116759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:06.517484 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d2a90a-2c9f-435c-b1a3-ac9282116759 admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:06.517781 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d2a90a-2c9f-435c-b1a3-ac9282116759 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:06.518074 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d2a90a-2c9f-435c-b1a3-ac9282116759 admin admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:06.518666 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d2a90a-2c9f-435c-b1a3-ac9282116759 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:06.520629 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d2a90a-2c9f-435c-b1a3-ac9282116759 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:06.530026 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1298/2586] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:10:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 10:10:06.533282 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:10:06.540869 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fe495d-75ed-49b9-87b5-c2a25039a33b None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:06.542297 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-13fe495d-75ed-49b9-87b5-c2a25039a33b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:06.551388 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1289/2587] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 10 10:10:06 2022] POST /identity/v3/projects => generated 385 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 10:10:06.555200 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d2a90a-2c9f-435c-b1a3-ac9282116759 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:06.604549 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fe495d-75ed-49b9-87b5-c2a25039a33b None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:06.616790 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d2a90a-2c9f-435c-b1a3-ac9282116759 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:06.621918 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a0b75f-85aa-41fd-8317-bef596d6a7cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:06.622579 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a0b75f-85aa-41fd-8317-bef596d6a7cf admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:06.622862 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a0b75f-85aa-41fd-8317-bef596d6a7cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:06.623137 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a0b75f-85aa-41fd-8317-bef596d6a7cf admin admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:06.623809 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a0b75f-85aa-41fd-8317-bef596d6a7cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:06.625788 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a0b75f-85aa-41fd-8317-bef596d6a7cf admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:06.653048 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1290/2588] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 10 10:10:06 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:10:06.654095 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a0b75f-85aa-41fd-8317-bef596d6a7cf admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:06.656743 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78e5b06-ed1b-4d0e-8dbb-4c5931702309 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4294c170df354fe892831281acd4ea7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:06.657392 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78e5b06-ed1b-4d0e-8dbb-4c5931702309 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:06.657673 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78e5b06-ed1b-4d0e-8dbb-4c5931702309 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:06.657945 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78e5b06-ed1b-4d0e-8dbb-4c5931702309 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:06.665004 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a0b75f-85aa-41fd-8317-bef596d6a7cf admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:06.667968 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78e5b06-ed1b-4d0e-8dbb-4c5931702309 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:06.669449 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78e5b06-ed1b-4d0e-8dbb-4c5931702309 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:06.670828 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3874ff37-be94-41ca-b259-1a6086f3aea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:06.671434 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3874ff37-be94-41ca-b259-1a6086f3aea5 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:06.671709 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3874ff37-be94-41ca-b259-1a6086f3aea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:06.671974 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3874ff37-be94-41ca-b259-1a6086f3aea5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:06.672618 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3874ff37-be94-41ca-b259-1a6086f3aea5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:06.674646 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3874ff37-be94-41ca-b259-1a6086f3aea5 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:06.680046 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1299/2589] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:10:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 10:10:06.688399 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1291/2590] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:10:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:10:06.690165 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78e5b06-ed1b-4d0e-8dbb-4c5931702309 service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:06.699769 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78e5b06-ed1b-4d0e-8dbb-4c5931702309 service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:06.704362 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417cfbc3-8097-4b68-8f1a-73bbbb5a8550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:06.704956 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417cfbc3-8097-4b68-8f1a-73bbbb5a8550 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:06.705265 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417cfbc3-8097-4b68-8f1a-73bbbb5a8550 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:06.705538 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417cfbc3-8097-4b68-8f1a-73bbbb5a8550 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:06.706174 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417cfbc3-8097-4b68-8f1a-73bbbb5a8550 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:06.707762 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417cfbc3-8097-4b68-8f1a-73bbbb5a8550 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:06.721107 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1300/2591] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:10:06 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:10:06.722503 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3874ff37-be94-41ca-b259-1a6086f3aea5 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:06.733149 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3874ff37-be94-41ca-b259-1a6086f3aea5 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:06.739439 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d029577f-c7f7-463f-b771-65dae61b0d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:06.740098 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d029577f-c7f7-463f-b771-65dae61b0d99 admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:06.740412 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d029577f-c7f7-463f-b771-65dae61b0d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:06.741056 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d029577f-c7f7-463f-b771-65dae61b0d99 admin admin] PATH_INFO: `/v3/projects/ca4497faed864c809cfa15b3b90800dd/users/3866e3f32a074224b185d4276f247648/roles/8daabcb6b7394e39b06a3453e33e32db` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:06.758866 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d029577f-c7f7-463f-b771-65dae61b0d99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca4497faed864c809cfa15b3b90800dd, user_id=3866e3f32a074224b185d4276f247648, role_id=8daabcb6b7394e39b06a3453e33e32db)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:06.761723 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d029577f-c7f7-463f-b771-65dae61b0d99 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:06.775366 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1292/2592] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:10:06 2022] PUT /identity/v3/projects/ca4497faed864c809cfa15b3b90800dd/users/3866e3f32a074224b185d4276f247648/roles/8daabcb6b7394e39b06a3453e33e32db => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:10:06.787606 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364e356c-4c6e-48e7-9319-8a6a00b64f49 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:06.787984 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364e356c-4c6e-48e7-9319-8a6a00b64f49 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:06.788328 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364e356c-4c6e-48e7-9319-8a6a00b64f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:06.817467 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-364e356c-4c6e-48e7-9319-8a6a00b64f49 None None] MFA Rules not processed for user `3866e3f32a074224b185d4276f247648`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:10:06.818686 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-364e356c-4c6e-48e7-9319-8a6a00b64f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:06.890433 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:10:06.898349 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1301/2593] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:10:06 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:10:06.899898 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d029577f-c7f7-463f-b771-65dae61b0d99 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:06.965960 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364e356c-4c6e-48e7-9319-8a6a00b64f49 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:06.967109 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d029577f-c7f7-463f-b771-65dae61b0d99 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:06.967406 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-364e356c-4c6e-48e7-9319-8a6a00b64f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:06.972060 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed5e2f2-23cc-4055-baf5-71b0e40b6b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:06.972773 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed5e2f2-23cc-4055-baf5-71b0e40b6b51 admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:06.973243 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed5e2f2-23cc-4055-baf5-71b0e40b6b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:06.973689 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed5e2f2-23cc-4055-baf5-71b0e40b6b51 admin admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:06.974639 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed5e2f2-23cc-4055-baf5-71b0e40b6b51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:06.976690 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed5e2f2-23cc-4055-baf5-71b0e40b6b51 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:06.983142 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364e356c-4c6e-48e7-9319-8a6a00b64f49 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:06.987736 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f74a73e-e387-4d08-b551-5c2a3895e951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:06.988916 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f74a73e-e387-4d08-b551-5c2a3895e951 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:06.990873 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f74a73e-e387-4d08-b551-5c2a3895e951 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:06.991163 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f74a73e-e387-4d08-b551-5c2a3895e951 admin admin] PATH_INFO: `/v3/projects/330be15c01444726a35befc0d9c8e772` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:06.992720 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f74a73e-e387-4d08-b551-5c2a3895e951 admin admin] RBAC: Authorizing `identity:delete_project(project_id=330be15c01444726a35befc0d9c8e772)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:06.996106 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f74a73e-e387-4d08-b551-5c2a3895e951 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:07.019897 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1293/2594] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 10 10:10:06 2022] POST /identity/v3/projects => generated 385 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:10:07.022599 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed5e2f2-23cc-4055-baf5-71b0e40b6b51 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:07.053672 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-7f74a73e-e387-4d08-b551-5c2a3895e951 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '330be15c01444726a35befc0d9c8e772', 'request_id': 'req-7f74a73e-e387-4d08-b551-5c2a3895e951'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:07.059626 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-7f74a73e-e387-4d08-b551-5c2a3895e951 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '330be15c01444726a35befc0d9c8e772', 'request_id': 'req-7f74a73e-e387-4d08-b551-5c2a3895e951'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:07.063120 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:10:07.070211 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-7f74a73e-e387-4d08-b551-5c2a3895e951 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '330be15c01444726a35befc0d9c8e772', 'request_id': 'req-7f74a73e-e387-4d08-b551-5c2a3895e951'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:07.085009 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-7f74a73e-e387-4d08-b551-5c2a3895e951 admin admin] The token cache is being invalidate because project 330be15c01444726a35befc0d9c8e772 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 10:10:07.085417 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-7f74a73e-e387-4d08-b551-5c2a3895e951 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:07.086305 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-7f74a73e-e387-4d08-b551-5c2a3895e951 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:07.088127 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1302/2595] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 10 10:10:06 2022] DELETE /identity/v3/projects/330be15c01444726a35befc0d9c8e772 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 10:10:07.101399 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed5e2f2-23cc-4055-baf5-71b0e40b6b51 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:07.174196 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a1f6f8-57f7-4cec-9cb6-a222706e625c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:07.174981 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a1f6f8-57f7-4cec-9cb6-a222706e625c admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:07.175351 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a1f6f8-57f7-4cec-9cb6-a222706e625c admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:07.175684 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a1f6f8-57f7-4cec-9cb6-a222706e625c admin admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:07.176378 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a1f6f8-57f7-4cec-9cb6-a222706e625c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:07.178471 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a1f6f8-57f7-4cec-9cb6-a222706e625c admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:07.210099 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1294/2596] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 10 10:10:07 2022] POST /identity/v3/users => generated 299 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:10:07.211589 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f74a73e-e387-4d08-b551-5c2a3895e951 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:07.213403 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-7f74a73e-e387-4d08-b551-5c2a3895e951 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:07.234027 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f74a73e-e387-4d08-b551-5c2a3895e951 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:07.239656 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbac0d54-0c5f-49f5-90c1-487a191208fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:07.240897 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbac0d54-0c5f-49f5-90c1-487a191208fc admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:07.241312 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbac0d54-0c5f-49f5-90c1-487a191208fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:07.241738 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbac0d54-0c5f-49f5-90c1-487a191208fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:07.244474 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbac0d54-0c5f-49f5-90c1-487a191208fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:07.246783 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbac0d54-0c5f-49f5-90c1-487a191208fc admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:07.261488 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1303/2597] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:10:07 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:10:07.266122 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a1f6f8-57f7-4cec-9cb6-a222706e625c admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:07.285669 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a1f6f8-57f7-4cec-9cb6-a222706e625c admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:07.292382 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3db5117-5ca0-4542-9bc4-b9550eed3f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:07.294204 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3db5117-5ca0-4542-9bc4-b9550eed3f59 admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:07.294601 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3db5117-5ca0-4542-9bc4-b9550eed3f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:07.295035 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3db5117-5ca0-4542-9bc4-b9550eed3f59 admin admin] PATH_INFO: `/v3/projects/a6cfb73a3a5449a79de613f95505eb16/users/4f7a072bf17e464cac9ec92d81fa387e/roles/eb04edc46b3742d7a0f0ead26f68bc22` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:07.317422 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3db5117-5ca0-4542-9bc4-b9550eed3f59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6cfb73a3a5449a79de613f95505eb16, user_id=4f7a072bf17e464cac9ec92d81fa387e, role_id=eb04edc46b3742d7a0f0ead26f68bc22)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:07.320772 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3db5117-5ca0-4542-9bc4-b9550eed3f59 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:07.345383 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1295/2598] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:10:07 2022] PUT /identity/v3/projects/a6cfb73a3a5449a79de613f95505eb16/users/4f7a072bf17e464cac9ec92d81fa387e/roles/eb04edc46b3742d7a0f0ead26f68bc22 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:10:07.350336 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbac0d54-0c5f-49f5-90c1-487a191208fc admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:07.365873 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbac0d54-0c5f-49f5-90c1-487a191208fc admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:07.416837 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3db5117-5ca0-4542-9bc4-b9550eed3f59 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:07.419346 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-c3db5117-5ca0-4542-9bc4-b9550eed3f59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:07.452810 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddd8022-b881-4e1f-9b83-333a97632ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:07.453694 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddd8022-b881-4e1f-9b83-333a97632ce9 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:07.454047 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddd8022-b881-4e1f-9b83-333a97632ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:07.454366 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddd8022-b881-4e1f-9b83-333a97632ce9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:07.455079 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddd8022-b881-4e1f-9b83-333a97632ce9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:07.456824 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddd8022-b881-4e1f-9b83-333a97632ce9 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:07.468405 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1304/2599] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:10:07 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:10:07.472633 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddd8022-b881-4e1f-9b83-333a97632ce9 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:07.483237 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddd8022-b881-4e1f-9b83-333a97632ce9 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:07.488171 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3db5117-5ca0-4542-9bc4-b9550eed3f59 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:07.488314 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b00ad23-29fd-4b94-8e8e-3fc347440dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:07.489050 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b00ad23-29fd-4b94-8e8e-3fc347440dce admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:07.489356 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b00ad23-29fd-4b94-8e8e-3fc347440dce admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:07.489625 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b00ad23-29fd-4b94-8e8e-3fc347440dce admin admin] PATH_INFO: `/v3/projects/a6cfb73a3a5449a79de613f95505eb16/users/4f7a072bf17e464cac9ec92d81fa387e/roles/eb04edc46b3742d7a0f0ead26f68bc22` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:07.491927 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b00ad23-29fd-4b94-8e8e-3fc347440dce admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6cfb73a3a5449a79de613f95505eb16, user_id=4f7a072bf17e464cac9ec92d81fa387e, role_id=eb04edc46b3742d7a0f0ead26f68bc22)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:07.492097 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f020e5-f23e-420f-bf13-9274f7c4ba8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4294c170df354fe892831281acd4ea7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:07.492904 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f020e5-f23e-420f-bf13-9274f7c4ba8d service neutron] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:07.493342 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f020e5-f23e-420f-bf13-9274f7c4ba8d service neutron] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:07.493727 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f020e5-f23e-420f-bf13-9274f7c4ba8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:07.494794 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b00ad23-29fd-4b94-8e8e-3fc347440dce admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:07.495754 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-e9f020e5-f23e-420f-bf13-9274f7c4ba8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:07.506935 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1305/2600] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:10:07 2022] PUT /identity/v3/projects/a6cfb73a3a5449a79de613f95505eb16/users/4f7a072bf17e464cac9ec92d81fa387e/roles/eb04edc46b3742d7a0f0ead26f68bc22 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 10:10:07.517655 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc4590-4e5e-46d9-8f81-5a1d80eec4f7 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:07.517935 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc4590-4e5e-46d9-8f81-5a1d80eec4f7 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:07.518208 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc4590-4e5e-46d9-8f81-5a1d80eec4f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:07.548975 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-46cc4590-4e5e-46d9-8f81-5a1d80eec4f7 None None] MFA Rules not processed for user `4f7a072bf17e464cac9ec92d81fa387e`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:10:07.550219 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-46cc4590-4e5e-46d9-8f81-5a1d80eec4f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:07.569227 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:10:07.574392 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f020e5-f23e-420f-bf13-9274f7c4ba8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:07.576033 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f020e5-f23e-420f-bf13-9274f7c4ba8d service neutron] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:07.587552 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1296/2601] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:10:07 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 10:10:07.594579 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:10:07.622266 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1306/2602] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:10:07 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 10:10:07.633750 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f020e5-f23e-420f-bf13-9274f7c4ba8d service neutron] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:07.635317 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-e9f020e5-f23e-420f-bf13-9274f7c4ba8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:07.707991 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f020e5-f23e-420f-bf13-9274f7c4ba8d service neutron] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:07.761866 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaa9f61-6dc0-4080-a04d-e2a35a5710e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf8e725cbe0403d943b136235eac057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:07.762475 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaa9f61-6dc0-4080-a04d-e2a35a5710e0 service cinder] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:07.762751 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaa9f61-6dc0-4080-a04d-e2a35a5710e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:07.763019 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaa9f61-6dc0-4080-a04d-e2a35a5710e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:07.764876 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-fdaa9f61-6dc0-4080-a04d-e2a35a5710e0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:07.825461 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaa9f61-6dc0-4080-a04d-e2a35a5710e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:07.826923 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaa9f61-6dc0-4080-a04d-e2a35a5710e0 service cinder] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:07.836800 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1297/2603] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:10:07 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:10:11.684779 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cc4590-4e5e-46d9-8f81-5a1d80eec4f7 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:11.686206 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-46cc4590-4e5e-46d9-8f81-5a1d80eec4f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:11.752628 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cc4590-4e5e-46d9-8f81-5a1d80eec4f7 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:11.757489 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f621d3c-e01f-4ef6-b479-cdb988350de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:11.758200 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f621d3c-e01f-4ef6-b479-cdb988350de6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:11.758561 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f621d3c-e01f-4ef6-b479-cdb988350de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:11.758834 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f621d3c-e01f-4ef6-b479-cdb988350de6 admin admin] PATH_INFO: `/v3/users/aadeccd0eb1a46c5940a1a2a69d331dc` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:11.759989 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f621d3c-e01f-4ef6-b479-cdb988350de6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aadeccd0eb1a46c5940a1a2a69d331dc)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:11.761938 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f621d3c-e01f-4ef6-b479-cdb988350de6 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:11.807860 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-0f621d3c-e01f-4ef6-b479-cdb988350de6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aadeccd0eb1a46c5940a1a2a69d331dc'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:11.816911 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-0f621d3c-e01f-4ef6-b479-cdb988350de6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aadeccd0eb1a46c5940a1a2a69d331dc'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:11.817710 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-0f621d3c-e01f-4ef6-b479-cdb988350de6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aadeccd0eb1a46c5940a1a2a69d331dc'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:11.818403 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-0f621d3c-e01f-4ef6-b479-cdb988350de6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aadeccd0eb1a46c5940a1a2a69d331dc'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:11.825693 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-0f621d3c-e01f-4ef6-b479-cdb988350de6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aadeccd0eb1a46c5940a1a2a69d331dc'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:11.842603 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1307/2604] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 10 10:10:11 2022] DELETE /identity/v3/users/aadeccd0eb1a46c5940a1a2a69d331dc => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:10:11.847205 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c5c09f-2740-4b06-9456-c439e75cf001 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:11.847692 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c5c09f-2740-4b06-9456-c439e75cf001 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:11.847788 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c5c09f-2740-4b06-9456-c439e75cf001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:11.867960 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-e6c5c09f-2740-4b06-9456-c439e75cf001 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:10:11.869211 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-e6c5c09f-2740-4b06-9456-c439e75cf001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:11.930778 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1298/2605] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:10:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:10:11.943578 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f621d3c-e01f-4ef6-b479-cdb988350de6 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:11.945484 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-0f621d3c-e01f-4ef6-b479-cdb988350de6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:12.004137 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f621d3c-e01f-4ef6-b479-cdb988350de6 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:12.008326 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f991e4-caf5-4236-9659-996079e9b07e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4294c170df354fe892831281acd4ea7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:12.008941 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f991e4-caf5-4236-9659-996079e9b07e service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:12.009252 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f991e4-caf5-4236-9659-996079e9b07e service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:12.009528 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f991e4-caf5-4236-9659-996079e9b07e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:12.020017 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f991e4-caf5-4236-9659-996079e9b07e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:12.021518 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f991e4-caf5-4236-9659-996079e9b07e service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:12.031727 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1308/2606] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:10:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:10:12.124531 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c5c09f-2740-4b06-9456-c439e75cf001 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:12.126113 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-e6c5c09f-2740-4b06-9456-c439e75cf001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:12.132949 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:10:12.187206 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c5c09f-2740-4b06-9456-c439e75cf001 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:12.191070 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac49d209-40d1-49c6-b3fc-ab3961efb112 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf8e725cbe0403d943b136235eac057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:12.191681 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac49d209-40d1-49c6-b3fc-ab3961efb112 service cinder] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:12.191961 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac49d209-40d1-49c6-b3fc-ab3961efb112 service cinder] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:12.192230 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac49d209-40d1-49c6-b3fc-ab3961efb112 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:12.193953 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-ac49d209-40d1-49c6-b3fc-ab3961efb112 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:12.256803 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac49d209-40d1-49c6-b3fc-ab3961efb112 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:12.258457 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac49d209-40d1-49c6-b3fc-ab3961efb112 service cinder] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:12.268195 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1299/2607] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:10:12 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:10:12.311307 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f991e4-caf5-4236-9659-996079e9b07e service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:12.313027 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-49f991e4-caf5-4236-9659-996079e9b07e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:12.322526 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:10:12.328631 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f991e4-caf5-4236-9659-996079e9b07e service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:12.334836 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef64c513-3052-4bf0-96a1-b5aeca8daf4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:12.335975 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef64c513-3052-4bf0-96a1-b5aeca8daf4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:12.336326 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef64c513-3052-4bf0-96a1-b5aeca8daf4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:12.343731 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef64c513-3052-4bf0-96a1-b5aeca8daf4e admin admin] PATH_INFO: `/v3/projects/1a50bfeedd584239b9f3e7a736e53daa` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:12.344991 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef64c513-3052-4bf0-96a1-b5aeca8daf4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a50bfeedd584239b9f3e7a736e53daa)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:12.346967 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef64c513-3052-4bf0-96a1-b5aeca8daf4e admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:12.395830 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-ef64c513-3052-4bf0-96a1-b5aeca8daf4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a50bfeedd584239b9f3e7a736e53daa', 'request_id': 'req-ef64c513-3052-4bf0-96a1-b5aeca8daf4e'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:12.403556 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-ef64c513-3052-4bf0-96a1-b5aeca8daf4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a50bfeedd584239b9f3e7a736e53daa', 'request_id': 'req-ef64c513-3052-4bf0-96a1-b5aeca8daf4e'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:12.413245 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-ef64c513-3052-4bf0-96a1-b5aeca8daf4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a50bfeedd584239b9f3e7a736e53daa', 'request_id': 'req-ef64c513-3052-4bf0-96a1-b5aeca8daf4e'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:12.425384 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-ef64c513-3052-4bf0-96a1-b5aeca8daf4e admin admin] The token cache is being invalidate because project 1a50bfeedd584239b9f3e7a736e53daa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 10:10:12.425669 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-ef64c513-3052-4bf0-96a1-b5aeca8daf4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:12.426320 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-ef64c513-3052-4bf0-96a1-b5aeca8daf4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:12.428258 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1309/2608] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 10 10:10:12 2022] DELETE /identity/v3/projects/1a50bfeedd584239b9f3e7a736e53daa => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 10:10:12.432329 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac49d209-40d1-49c6-b3fc-ab3961efb112 service cinder] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:12.442956 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac49d209-40d1-49c6-b3fc-ab3961efb112 service cinder] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:12.502620 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e145eb41-5dce-4a2c-be2c-b1f336870ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:12.503256 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e145eb41-5dce-4a2c-be2c-b1f336870ef1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:12.503537 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e145eb41-5dce-4a2c-be2c-b1f336870ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:12.503808 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e145eb41-5dce-4a2c-be2c-b1f336870ef1 admin admin] PATH_INFO: `/v3/users/fde70625852a410abd901fdb93088b58` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:12.505028 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e145eb41-5dce-4a2c-be2c-b1f336870ef1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fde70625852a410abd901fdb93088b58)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:12.507042 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e145eb41-5dce-4a2c-be2c-b1f336870ef1 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:12.574415 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-e145eb41-5dce-4a2c-be2c-b1f336870ef1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fde70625852a410abd901fdb93088b58'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:12.583208 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-e145eb41-5dce-4a2c-be2c-b1f336870ef1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fde70625852a410abd901fdb93088b58'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:12.584992 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:10:12.593517 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-e145eb41-5dce-4a2c-be2c-b1f336870ef1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fde70625852a410abd901fdb93088b58'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:12.594263 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-e145eb41-5dce-4a2c-be2c-b1f336870ef1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fde70625852a410abd901fdb93088b58'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:12.594983 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-e145eb41-5dce-4a2c-be2c-b1f336870ef1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fde70625852a410abd901fdb93088b58'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:12.618141 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1300/2609] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 10 10:10:12 2022] DELETE /identity/v3/users/fde70625852a410abd901fdb93088b58 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:10:12.893914 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef64c513-3052-4bf0-96a1-b5aeca8daf4e admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:12.895524 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-ef64c513-3052-4bf0-96a1-b5aeca8daf4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:12.909366 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef64c513-3052-4bf0-96a1-b5aeca8daf4e admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:12.968114 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca58976-fdb2-452f-bf38-c6504b83bfdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:12.968749 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca58976-fdb2-452f-bf38-c6504b83bfdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:12.969029 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca58976-fdb2-452f-bf38-c6504b83bfdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:12.969333 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca58976-fdb2-452f-bf38-c6504b83bfdc admin admin] PATH_INFO: `/v3/projects/bf0bdeeb8e274748acb0e72345d4e9ee` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:12.970450 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca58976-fdb2-452f-bf38-c6504b83bfdc admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf0bdeeb8e274748acb0e72345d4e9ee)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:12.972353 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca58976-fdb2-452f-bf38-c6504b83bfdc admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:13.019451 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-cca58976-fdb2-452f-bf38-c6504b83bfdc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf0bdeeb8e274748acb0e72345d4e9ee', 'request_id': 'req-cca58976-fdb2-452f-bf38-c6504b83bfdc'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:13.025276 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-cca58976-fdb2-452f-bf38-c6504b83bfdc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf0bdeeb8e274748acb0e72345d4e9ee', 'request_id': 'req-cca58976-fdb2-452f-bf38-c6504b83bfdc'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:13.033237 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-cca58976-fdb2-452f-bf38-c6504b83bfdc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf0bdeeb8e274748acb0e72345d4e9ee', 'request_id': 'req-cca58976-fdb2-452f-bf38-c6504b83bfdc'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:13.044311 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-cca58976-fdb2-452f-bf38-c6504b83bfdc admin admin] The token cache is being invalidate because project bf0bdeeb8e274748acb0e72345d4e9ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 10:10:13.044599 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-cca58976-fdb2-452f-bf38-c6504b83bfdc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:13.045305 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-cca58976-fdb2-452f-bf38-c6504b83bfdc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:13.046852 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1310/2610] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 10 10:10:12 2022] DELETE /identity/v3/projects/bf0bdeeb8e274748acb0e72345d4e9ee => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:10:13.052391 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e608f70-bdd3-4b8d-a349-c1a4f2aaeadb None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:13.052899 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e608f70-bdd3-4b8d-a349-c1a4f2aaeadb None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:13.053019 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e608f70-bdd3-4b8d-a349-c1a4f2aaeadb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:13.073695 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-6e608f70-bdd3-4b8d-a349-c1a4f2aaeadb None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:10:13.074902 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-6e608f70-bdd3-4b8d-a349-c1a4f2aaeadb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:13.146591 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1301/2611] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:10:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:10:13.156133 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357a6e1-37c3-4ca9-8508-eaef75cccb78 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:13.156411 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357a6e1-37c3-4ca9-8508-eaef75cccb78 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:13.156681 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357a6e1-37c3-4ca9-8508-eaef75cccb78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:13.176836 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-c357a6e1-37c3-4ca9-8508-eaef75cccb78 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:10:13.178081 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-c357a6e1-37c3-4ca9-8508-eaef75cccb78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:13.186849 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1311/2612] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:10:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:10:13.191249 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e608f70-bdd3-4b8d-a349-c1a4f2aaeadb None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:13.201513 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e608f70-bdd3-4b8d-a349-c1a4f2aaeadb None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:13.209133 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4b140b-c2fc-49f0-b020-940eba0733a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:13.210155 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4b140b-c2fc-49f0-b020-940eba0733a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:13.210500 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4b140b-c2fc-49f0-b020-940eba0733a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:13.210906 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4b140b-c2fc-49f0-b020-940eba0733a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:13.211577 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4b140b-c2fc-49f0-b020-940eba0733a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:10:13.211883 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4b140b-c2fc-49f0-b020-940eba0733a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:13.213616 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4b140b-c2fc-49f0-b020-940eba0733a3 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:13.225732 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1302/2613] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 10 10:10:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:10:13.230110 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c357a6e1-37c3-4ca9-8508-eaef75cccb78 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:13.239499 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c357a6e1-37c3-4ca9-8508-eaef75cccb78 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:13.244979 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7febc36-97c3-46e3-b0a4-f7933e79dfd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:13.245607 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7febc36-97c3-46e3-b0a4-f7933e79dfd3 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:13.245890 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7febc36-97c3-46e3-b0a4-f7933e79dfd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:13.246150 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7febc36-97c3-46e3-b0a4-f7933e79dfd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:13.246767 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7febc36-97c3-46e3-b0a4-f7933e79dfd3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:13.248631 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7febc36-97c3-46e3-b0a4-f7933e79dfd3 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:13.254112 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:10:13.278589 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1312/2614] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 10 10:10:13 2022] POST /identity/v3/projects => generated 363 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:10:13.282768 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4b140b-c2fc-49f0-b020-940eba0733a3 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:13.293263 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4b140b-c2fc-49f0-b020-940eba0733a3 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:13.355380 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6a2a09-3650-4e52-958b-dce35b14b561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:13.356006 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6a2a09-3650-4e52-958b-dce35b14b561 admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:13.356272 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6a2a09-3650-4e52-958b-dce35b14b561 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:13.356553 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6a2a09-3650-4e52-958b-dce35b14b561 admin admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:13.357221 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6a2a09-3650-4e52-958b-dce35b14b561 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:13.359159 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6a2a09-3650-4e52-958b-dce35b14b561 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:13.385287 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1303/2615] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 10 10:10:13 2022] POST /identity/v3/users => generated 282 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:10:13.390117 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7febc36-97c3-46e3-b0a4-f7933e79dfd3 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:13.402823 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7febc36-97c3-46e3-b0a4-f7933e79dfd3 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:13.408003 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e51778-75c5-44df-85ef-41e85b56ce5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:13.408613 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e51778-75c5-44df-85ef-41e85b56ce5e admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:13.408891 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e51778-75c5-44df-85ef-41e85b56ce5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:13.409196 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e51778-75c5-44df-85ef-41e85b56ce5e admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:13.410000 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e51778-75c5-44df-85ef-41e85b56ce5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:13.411655 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e51778-75c5-44df-85ef-41e85b56ce5e admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:13.423698 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1313/2616] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:10:13 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:10:13.427998 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6a2a09-3650-4e52-958b-dce35b14b561 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:13.438948 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6a2a09-3650-4e52-958b-dce35b14b561 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:13.444405 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afcdbc5-8a90-421e-94fa-6dcbed5b1cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:13.445016 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afcdbc5-8a90-421e-94fa-6dcbed5b1cd9 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:13.445360 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afcdbc5-8a90-421e-94fa-6dcbed5b1cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:13.445633 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afcdbc5-8a90-421e-94fa-6dcbed5b1cd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:13.446291 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afcdbc5-8a90-421e-94fa-6dcbed5b1cd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:13.447911 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afcdbc5-8a90-421e-94fa-6dcbed5b1cd9 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:13.458350 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1304/2617] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:10:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:10:13.463004 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e51778-75c5-44df-85ef-41e85b56ce5e admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:13.473246 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e51778-75c5-44df-85ef-41e85b56ce5e admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:13.478640 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d88bd20-2e3c-4ffb-9c01-779dd5de06b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:13.479278 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d88bd20-2e3c-4ffb-9c01-779dd5de06b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:13.479554 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d88bd20-2e3c-4ffb-9c01-779dd5de06b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:13.479825 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d88bd20-2e3c-4ffb-9c01-779dd5de06b3 admin admin] PATH_INFO: `/v3/projects/b1c217d13e484000922953c86360c516/users/64edfd43e3f24c1e9e1cbb898d4c1d63/roles/8daabcb6b7394e39b06a3453e33e32db` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:13.495751 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d88bd20-2e3c-4ffb-9c01-779dd5de06b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1c217d13e484000922953c86360c516, user_id=64edfd43e3f24c1e9e1cbb898d4c1d63, role_id=8daabcb6b7394e39b06a3453e33e32db)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:13.498784 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d88bd20-2e3c-4ffb-9c01-779dd5de06b3 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:13.513794 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1314/2618] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:10:13 2022] PUT /identity/v3/projects/b1c217d13e484000922953c86360c516/users/64edfd43e3f24c1e9e1cbb898d4c1d63/roles/8daabcb6b7394e39b06a3453e33e32db => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:10:13.524316 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608e8d9c-14c7-482b-8d3e-eaf3f1437bed None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:13.524620 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608e8d9c-14c7-482b-8d3e-eaf3f1437bed None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:13.524892 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608e8d9c-14c7-482b-8d3e-eaf3f1437bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:13.554773 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-608e8d9c-14c7-482b-8d3e-eaf3f1437bed None None] MFA Rules not processed for user `64edfd43e3f24c1e9e1cbb898d4c1d63`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:10:13.556060 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-608e8d9c-14c7-482b-8d3e-eaf3f1437bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:13.587396 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:10:13.626204 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1305/2619] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:10:13 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 10:10:13.630923 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d88bd20-2e3c-4ffb-9c01-779dd5de06b3 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:13.702161 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d88bd20-2e3c-4ffb-9c01-779dd5de06b3 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:13.707813 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ed2b35-f9c6-41d6-ba5f-574bc4f6d04b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:13.708486 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ed2b35-f9c6-41d6-ba5f-574bc4f6d04b admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:13.708838 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ed2b35-f9c6-41d6-ba5f-574bc4f6d04b admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:13.709218 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ed2b35-f9c6-41d6-ba5f-574bc4f6d04b admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:13.709941 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ed2b35-f9c6-41d6-ba5f-574bc4f6d04b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:13.711946 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ed2b35-f9c6-41d6-ba5f-574bc4f6d04b admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:13.744059 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1315/2620] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 10 10:10:13 2022] POST /identity/v3/projects => generated 363 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:10:13.745268 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608e8d9c-14c7-482b-8d3e-eaf3f1437bed None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:13.756925 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608e8d9c-14c7-482b-8d3e-eaf3f1437bed None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:13.826542 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274e2e8c-41dd-498d-a340-b0dab1012b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:13.827502 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274e2e8c-41dd-498d-a340-b0dab1012b97 admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:13.827904 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274e2e8c-41dd-498d-a340-b0dab1012b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:13.828302 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274e2e8c-41dd-498d-a340-b0dab1012b97 admin admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:13.829057 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274e2e8c-41dd-498d-a340-b0dab1012b97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:13.831185 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274e2e8c-41dd-498d-a340-b0dab1012b97 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:13.856172 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1306/2621] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 10 10:10:13 2022] POST /identity/v3/users => generated 288 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 10:10:13.860406 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ed2b35-f9c6-41d6-ba5f-574bc4f6d04b admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:13.871130 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ed2b35-f9c6-41d6-ba5f-574bc4f6d04b admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:13.875654 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0b9ca9-cf3d-4c99-b599-174ee82f3ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:13.876272 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0b9ca9-cf3d-4c99-b599-174ee82f3ed5 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:13.876528 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0b9ca9-cf3d-4c99-b599-174ee82f3ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:13.876780 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0b9ca9-cf3d-4c99-b599-174ee82f3ed5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:13.877592 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0b9ca9-cf3d-4c99-b599-174ee82f3ed5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:13.879018 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0b9ca9-cf3d-4c99-b599-174ee82f3ed5 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:13.889741 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1316/2622] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:10:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:10:13.897640 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274e2e8c-41dd-498d-a340-b0dab1012b97 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:13.908328 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274e2e8c-41dd-498d-a340-b0dab1012b97 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:13.913454 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476d7b22-2774-4163-847b-f829cfa020a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:13.914132 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476d7b22-2774-4163-847b-f829cfa020a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:13.914468 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476d7b22-2774-4163-847b-f829cfa020a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:13.914759 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476d7b22-2774-4163-847b-f829cfa020a0 admin admin] PATH_INFO: `/v3/projects/b0f0e94bdf8c459a872e2ece0fc183fb/users/a53e5a55a8d14bb7978bfae82bb8f87f/roles/eb04edc46b3742d7a0f0ead26f68bc22` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:13.931150 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476d7b22-2774-4163-847b-f829cfa020a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0f0e94bdf8c459a872e2ece0fc183fb, user_id=a53e5a55a8d14bb7978bfae82bb8f87f, role_id=eb04edc46b3742d7a0f0ead26f68bc22)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:13.934124 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476d7b22-2774-4163-847b-f829cfa020a0 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:13.949021 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1307/2623] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:10:13 2022] PUT /identity/v3/projects/b0f0e94bdf8c459a872e2ece0fc183fb/users/a53e5a55a8d14bb7978bfae82bb8f87f/roles/eb04edc46b3742d7a0f0ead26f68bc22 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:10:13.953229 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0b9ca9-cf3d-4c99-b599-174ee82f3ed5 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:13.964284 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0b9ca9-cf3d-4c99-b599-174ee82f3ed5 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:14.022179 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43be19dd-1664-490a-a9bb-be2e3995cbbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:14.022856 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43be19dd-1664-490a-a9bb-be2e3995cbbd admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:14.023132 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43be19dd-1664-490a-a9bb-be2e3995cbbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:14.023400 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43be19dd-1664-490a-a9bb-be2e3995cbbd admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:14.024045 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43be19dd-1664-490a-a9bb-be2e3995cbbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:14.025975 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43be19dd-1664-490a-a9bb-be2e3995cbbd admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:14.036632 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1317/2624] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:10:13 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:10:14.041327 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476d7b22-2774-4163-847b-f829cfa020a0 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:14.052666 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476d7b22-2774-4163-847b-f829cfa020a0 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:14.057958 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cac045b-2e91-40bf-af88-41907091d0f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:14.058654 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac045b-2e91-40bf-af88-41907091d0f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:14.059002 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac045b-2e91-40bf-af88-41907091d0f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:14.059275 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac045b-2e91-40bf-af88-41907091d0f0 admin admin] PATH_INFO: `/v3/projects/b0f0e94bdf8c459a872e2ece0fc183fb/users/a53e5a55a8d14bb7978bfae82bb8f87f/roles/eb04edc46b3742d7a0f0ead26f68bc22` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:14.061505 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cac045b-2e91-40bf-af88-41907091d0f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0f0e94bdf8c459a872e2ece0fc183fb, user_id=a53e5a55a8d14bb7978bfae82bb8f87f, role_id=eb04edc46b3742d7a0f0ead26f68bc22)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:14.064433 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cac045b-2e91-40bf-af88-41907091d0f0 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:14.074819 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1308/2625] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:10:14 2022] PUT /identity/v3/projects/b0f0e94bdf8c459a872e2ece0fc183fb/users/a53e5a55a8d14bb7978bfae82bb8f87f/roles/eb04edc46b3742d7a0f0ead26f68bc22 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 10:10:14.085272 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b42d1-ab1b-42f2-b8b0-49d1cad9e2f6 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:14.085574 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b42d1-ab1b-42f2-b8b0-49d1cad9e2f6 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:14.085846 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b42d1-ab1b-42f2-b8b0-49d1cad9e2f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:14.115786 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-d50b42d1-ab1b-42f2-b8b0-49d1cad9e2f6 None None] MFA Rules not processed for user `a53e5a55a8d14bb7978bfae82bb8f87f`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:10:14.117096 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-d50b42d1-ab1b-42f2-b8b0-49d1cad9e2f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:14.129423 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:10:14.208463 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1318/2626] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:10:14 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:10:14.219933 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cac045b-2e91-40bf-af88-41907091d0f0 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:14.221959 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-3cac045b-2e91-40bf-af88-41907091d0f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:14.282639 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cac045b-2e91-40bf-af88-41907091d0f0 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:14.286377 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be5c773-c3dd-4317-b147-19c56956b464 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf8e725cbe0403d943b136235eac057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:14.286971 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be5c773-c3dd-4317-b147-19c56956b464 service cinder] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:14.287246 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be5c773-c3dd-4317-b147-19c56956b464 service cinder] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:14.287513 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be5c773-c3dd-4317-b147-19c56956b464 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:14.296389 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be5c773-c3dd-4317-b147-19c56956b464 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:14.298236 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be5c773-c3dd-4317-b147-19c56956b464 service cinder] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:14.307716 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1309/2627] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:10:14 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:10:14.394753 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50b42d1-ab1b-42f2-b8b0-49d1cad9e2f6 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:14.407419 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50b42d1-ab1b-42f2-b8b0-49d1cad9e2f6 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:14.412045 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a62fdc0-af4d-4289-89e5-d6645fe5e806 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf8e725cbe0403d943b136235eac057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:14.412646 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a62fdc0-af4d-4289-89e5-d6645fe5e806 service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:14.412926 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a62fdc0-af4d-4289-89e5-d6645fe5e806 service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:14.413240 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a62fdc0-af4d-4289-89e5-d6645fe5e806 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:14.486571 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a62fdc0-af4d-4289-89e5-d6645fe5e806 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:14.488126 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a62fdc0-af4d-4289-89e5-d6645fe5e806 service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:14.497698 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1319/2628] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:10:14 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:10:17.203049 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be5c773-c3dd-4317-b147-19c56956b464 service cinder] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:17.204606 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-3be5c773-c3dd-4317-b147-19c56956b464 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:17.237275 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:10:17.280147 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be5c773-c3dd-4317-b147-19c56956b464 service cinder] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:17.285007 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3c2bb1-bf3f-47c0-bde5-9be8a224e25b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:17.285860 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3c2bb1-bf3f-47c0-bde5-9be8a224e25b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:17.286205 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3c2bb1-bf3f-47c0-bde5-9be8a224e25b admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:17.286545 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3c2bb1-bf3f-47c0-bde5-9be8a224e25b admin admin] PATH_INFO: `/v3/users/3866e3f32a074224b185d4276f247648` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:17.287770 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3c2bb1-bf3f-47c0-bde5-9be8a224e25b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3866e3f32a074224b185d4276f247648)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:17.289785 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3c2bb1-bf3f-47c0-bde5-9be8a224e25b admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:17.336786 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-cd3c2bb1-bf3f-47c0-bde5-9be8a224e25b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3866e3f32a074224b185d4276f247648'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:17.344528 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-cd3c2bb1-bf3f-47c0-bde5-9be8a224e25b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3866e3f32a074224b185d4276f247648'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:17.353850 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-cd3c2bb1-bf3f-47c0-bde5-9be8a224e25b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3866e3f32a074224b185d4276f247648'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:17.354538 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-cd3c2bb1-bf3f-47c0-bde5-9be8a224e25b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3866e3f32a074224b185d4276f247648'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:17.355145 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-cd3c2bb1-bf3f-47c0-bde5-9be8a224e25b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3866e3f32a074224b185d4276f247648'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:17.372795 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1310/2629] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 10 10:10:17 2022] DELETE /identity/v3/users/3866e3f32a074224b185d4276f247648 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:10:17.377499 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0005be-7170-406d-b97e-1483b5ee9fe4 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:17.377986 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0005be-7170-406d-b97e-1483b5ee9fe4 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:17.378173 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0005be-7170-406d-b97e-1483b5ee9fe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:17.399054 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-4d0005be-7170-406d-b97e-1483b5ee9fe4 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:10:17.400668 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-4d0005be-7170-406d-b97e-1483b5ee9fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:17.467471 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1320/2630] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:10:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:10:17.477342 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3c2bb1-bf3f-47c0-bde5-9be8a224e25b admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:17.479094 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-cd3c2bb1-bf3f-47c0-bde5-9be8a224e25b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:17.542383 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3c2bb1-bf3f-47c0-bde5-9be8a224e25b admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:17.547612 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1373c9c4-1985-42fa-b4b5-a8fd11ee50ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4294c170df354fe892831281acd4ea7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:17.548706 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1373c9c4-1985-42fa-b4b5-a8fd11ee50ca service neutron] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:17.548981 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1373c9c4-1985-42fa-b4b5-a8fd11ee50ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:17.549283 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1373c9c4-1985-42fa-b4b5-a8fd11ee50ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:17.560093 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1373c9c4-1985-42fa-b4b5-a8fd11ee50ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:17.561534 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1373c9c4-1985-42fa-b4b5-a8fd11ee50ca service neutron] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:17.571942 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1311/2631] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:10:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:10:17.885727 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0005be-7170-406d-b97e-1483b5ee9fe4 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:17.887443 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-4d0005be-7170-406d-b97e-1483b5ee9fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:17.904276 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0005be-7170-406d-b97e-1483b5ee9fe4 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:17.909847 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbca636-27ff-43f2-ba9e-a019b8dae232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:17.910435 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbca636-27ff-43f2-ba9e-a019b8dae232 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:17.910693 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbca636-27ff-43f2-ba9e-a019b8dae232 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:17.910959 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbca636-27ff-43f2-ba9e-a019b8dae232 admin admin] PATH_INFO: `/v3/projects/ca4497faed864c809cfa15b3b90800dd` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:17.912267 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbca636-27ff-43f2-ba9e-a019b8dae232 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca4497faed864c809cfa15b3b90800dd)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:17.914234 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbca636-27ff-43f2-ba9e-a019b8dae232 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:17.963926 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:10:17.973811 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-fdbca636-27ff-43f2-ba9e-a019b8dae232 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca4497faed864c809cfa15b3b90800dd', 'request_id': 'req-fdbca636-27ff-43f2-ba9e-a019b8dae232'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:17.980703 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-fdbca636-27ff-43f2-ba9e-a019b8dae232 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca4497faed864c809cfa15b3b90800dd', 'request_id': 'req-fdbca636-27ff-43f2-ba9e-a019b8dae232'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:17.992277 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-fdbca636-27ff-43f2-ba9e-a019b8dae232 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca4497faed864c809cfa15b3b90800dd', 'request_id': 'req-fdbca636-27ff-43f2-ba9e-a019b8dae232'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:18.004328 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-fdbca636-27ff-43f2-ba9e-a019b8dae232 admin admin] The token cache is being invalidate because project ca4497faed864c809cfa15b3b90800dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 10:10:18.004623 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-fdbca636-27ff-43f2-ba9e-a019b8dae232 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:18.005832 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-fdbca636-27ff-43f2-ba9e-a019b8dae232 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:18.007481 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1321/2632] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 10 10:10:17 2022] DELETE /identity/v3/projects/ca4497faed864c809cfa15b3b90800dd => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:10:18.011831 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1373c9c4-1985-42fa-b4b5-a8fd11ee50ca service neutron] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:18.021811 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1373c9c4-1985-42fa-b4b5-a8fd11ee50ca service neutron] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:18.066605 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:10:18.082421 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd65bd87-dc99-4e94-bc7b-0c29c74e47e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:18.082976 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd65bd87-dc99-4e94-bc7b-0c29c74e47e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:18.083266 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd65bd87-dc99-4e94-bc7b-0c29c74e47e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:18.083537 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd65bd87-dc99-4e94-bc7b-0c29c74e47e3 admin admin] PATH_INFO: `/v3/users/4f7a072bf17e464cac9ec92d81fa387e` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:18.084746 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd65bd87-dc99-4e94-bc7b-0c29c74e47e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f7a072bf17e464cac9ec92d81fa387e)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:18.086738 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd65bd87-dc99-4e94-bc7b-0c29c74e47e3 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:18.137319 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-fd65bd87-dc99-4e94-bc7b-0c29c74e47e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f7a072bf17e464cac9ec92d81fa387e'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:18.144416 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-fd65bd87-dc99-4e94-bc7b-0c29c74e47e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f7a072bf17e464cac9ec92d81fa387e'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:18.151578 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-fd65bd87-dc99-4e94-bc7b-0c29c74e47e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f7a072bf17e464cac9ec92d81fa387e'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:18.152188 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-fd65bd87-dc99-4e94-bc7b-0c29c74e47e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f7a072bf17e464cac9ec92d81fa387e'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:18.153089 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-fd65bd87-dc99-4e94-bc7b-0c29c74e47e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f7a072bf17e464cac9ec92d81fa387e'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:18.171299 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1312/2633] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 10 10:10:18 2022] DELETE /identity/v3/users/4f7a072bf17e464cac9ec92d81fa387e => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:10:18.527767 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbca636-27ff-43f2-ba9e-a019b8dae232 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:18.529927 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-fdbca636-27ff-43f2-ba9e-a019b8dae232 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:18.543140 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbca636-27ff-43f2-ba9e-a019b8dae232 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:18.610198 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3459fe-2b4e-4dd5-8690-e322e3208d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:18.610843 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3459fe-2b4e-4dd5-8690-e322e3208d69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:18.611189 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3459fe-2b4e-4dd5-8690-e322e3208d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:18.611537 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3459fe-2b4e-4dd5-8690-e322e3208d69 admin admin] PATH_INFO: `/v3/projects/a6cfb73a3a5449a79de613f95505eb16` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:18.612779 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3459fe-2b4e-4dd5-8690-e322e3208d69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6cfb73a3a5449a79de613f95505eb16)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:18.614832 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3459fe-2b4e-4dd5-8690-e322e3208d69 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:18.664359 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-fd3459fe-2b4e-4dd5-8690-e322e3208d69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6cfb73a3a5449a79de613f95505eb16', 'request_id': 'req-fd3459fe-2b4e-4dd5-8690-e322e3208d69'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:18.670983 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-fd3459fe-2b4e-4dd5-8690-e322e3208d69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6cfb73a3a5449a79de613f95505eb16', 'request_id': 'req-fd3459fe-2b4e-4dd5-8690-e322e3208d69'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:18.686573 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-fd3459fe-2b4e-4dd5-8690-e322e3208d69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6cfb73a3a5449a79de613f95505eb16', 'request_id': 'req-fd3459fe-2b4e-4dd5-8690-e322e3208d69'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:18.698834 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-fd3459fe-2b4e-4dd5-8690-e322e3208d69 admin admin] The token cache is being invalidate because project a6cfb73a3a5449a79de613f95505eb16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 10:10:18.699126 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-fd3459fe-2b4e-4dd5-8690-e322e3208d69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:18.699786 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-fd3459fe-2b4e-4dd5-8690-e322e3208d69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:18.701352 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1322/2634] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 10 10:10:18 2022] DELETE /identity/v3/projects/a6cfb73a3a5449a79de613f95505eb16 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 10:10:18.707381 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d30dc3-99a7-4f1a-b407-87009490dea4 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:18.707858 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d30dc3-99a7-4f1a-b407-87009490dea4 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:18.707971 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d30dc3-99a7-4f1a-b407-87009490dea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:18.729518 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-93d30dc3-99a7-4f1a-b407-87009490dea4 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:10:18.730762 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-93d30dc3-99a7-4f1a-b407-87009490dea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:18.804717 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1313/2635] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:10:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:10:18.814640 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5149c0cb-f1bb-4288-8362-60929dbc3bac None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:18.814968 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5149c0cb-f1bb-4288-8362-60929dbc3bac None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:18.815237 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5149c0cb-f1bb-4288-8362-60929dbc3bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:18.836330 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-5149c0cb-f1bb-4288-8362-60929dbc3bac None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:10:18.837566 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-5149c0cb-f1bb-4288-8362-60929dbc3bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:18.846700 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1323/2636] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:10:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 10:10:18.850965 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d30dc3-99a7-4f1a-b407-87009490dea4 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:18.862350 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d30dc3-99a7-4f1a-b407-87009490dea4 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:18.867961 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3b9d39-957b-4053-a4e2-aabef8c2dcb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:18.868579 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3b9d39-957b-4053-a4e2-aabef8c2dcb0 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:18.868863 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3b9d39-957b-4053-a4e2-aabef8c2dcb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:18.869187 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3b9d39-957b-4053-a4e2-aabef8c2dcb0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:18.870110 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3b9d39-957b-4053-a4e2-aabef8c2dcb0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:10:18.870417 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3b9d39-957b-4053-a4e2-aabef8c2dcb0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:18.872802 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3b9d39-957b-4053-a4e2-aabef8c2dcb0 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:18.887341 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1314/2637] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 10 10:10:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:10:18.891844 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5149c0cb-f1bb-4288-8362-60929dbc3bac None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:18.901641 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5149c0cb-f1bb-4288-8362-60929dbc3bac None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:18.906576 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c85d64d-e11b-4bd8-af07-adec4e4760ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:18.907191 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c85d64d-e11b-4bd8-af07-adec4e4760ed admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:18.907496 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c85d64d-e11b-4bd8-af07-adec4e4760ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:18.907768 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c85d64d-e11b-4bd8-af07-adec4e4760ed admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:18.908477 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c85d64d-e11b-4bd8-af07-adec4e4760ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:18.910344 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c85d64d-e11b-4bd8-af07-adec4e4760ed admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:18.938463 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1324/2638] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 10 10:10:18 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 10:10:18.942709 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3b9d39-957b-4053-a4e2-aabef8c2dcb0 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:18.953236 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3b9d39-957b-4053-a4e2-aabef8c2dcb0 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:19.003749 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:10:19.015536 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ae7b57-1b93-4a77-9428-e60a1b0d692f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:19.016151 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae7b57-1b93-4a77-9428-e60a1b0d692f admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:19.016462 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae7b57-1b93-4a77-9428-e60a1b0d692f admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:19.016734 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae7b57-1b93-4a77-9428-e60a1b0d692f admin admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:19.017424 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ae7b57-1b93-4a77-9428-e60a1b0d692f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:19.019374 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ae7b57-1b93-4a77-9428-e60a1b0d692f admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:19.042051 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1315/2639] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 10 10:10:18 2022] POST /identity/v3/users => generated 289 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:10:19.046724 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c85d64d-e11b-4bd8-af07-adec4e4760ed admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:19.057402 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c85d64d-e11b-4bd8-af07-adec4e4760ed admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:19.062220 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a61664-8c62-49bd-b1b9-e6bfc4c504f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:19.062930 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a61664-8c62-49bd-b1b9-e6bfc4c504f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:19.063299 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a61664-8c62-49bd-b1b9-e6bfc4c504f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:19.063638 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a61664-8c62-49bd-b1b9-e6bfc4c504f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:19.064393 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a61664-8c62-49bd-b1b9-e6bfc4c504f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:19.066086 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a61664-8c62-49bd-b1b9-e6bfc4c504f7 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:19.076857 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1325/2640] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:10:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:10:19.081110 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ae7b57-1b93-4a77-9428-e60a1b0d692f admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:19.092016 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ae7b57-1b93-4a77-9428-e60a1b0d692f admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:19.097488 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768c7191-96b0-4341-b7a5-1c6f3512b47e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:19.098108 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c7191-96b0-4341-b7a5-1c6f3512b47e admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:19.098433 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c7191-96b0-4341-b7a5-1c6f3512b47e admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:19.098767 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c7191-96b0-4341-b7a5-1c6f3512b47e admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:19.099652 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768c7191-96b0-4341-b7a5-1c6f3512b47e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:19.101580 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768c7191-96b0-4341-b7a5-1c6f3512b47e admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:19.113322 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1316/2641] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:10:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:10:19.117328 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a61664-8c62-49bd-b1b9-e6bfc4c504f7 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:19.128627 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a61664-8c62-49bd-b1b9-e6bfc4c504f7 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:19.134227 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb41618-a0cc-46d6-aea5-cfedd943fb31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:19.134909 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb41618-a0cc-46d6-aea5-cfedd943fb31 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:19.135189 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb41618-a0cc-46d6-aea5-cfedd943fb31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:19.135462 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb41618-a0cc-46d6-aea5-cfedd943fb31 admin admin] PATH_INFO: `/v3/projects/655c2ba04cb94cc89a4aeb88e40faebf/users/af618bda6918401fa18f9c08c3a5d74c/roles/8daabcb6b7394e39b06a3453e33e32db` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:19.151428 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb41618-a0cc-46d6-aea5-cfedd943fb31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=655c2ba04cb94cc89a4aeb88e40faebf, user_id=af618bda6918401fa18f9c08c3a5d74c, role_id=8daabcb6b7394e39b06a3453e33e32db)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:19.155218 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb41618-a0cc-46d6-aea5-cfedd943fb31 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:19.158534 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:10:19.171753 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1326/2642] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:10:19 2022] PUT /identity/v3/projects/655c2ba04cb94cc89a4aeb88e40faebf/users/af618bda6918401fa18f9c08c3a5d74c/roles/8daabcb6b7394e39b06a3453e33e32db => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:10:19.188619 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f043af-5acc-4ba0-aaca-b7cdd0f85bb3 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:19.188619 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f043af-5acc-4ba0-aaca-b7cdd0f85bb3 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:19.188619 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f043af-5acc-4ba0-aaca-b7cdd0f85bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:19.211793 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-33f043af-5acc-4ba0-aaca-b7cdd0f85bb3 None None] MFA Rules not processed for user `af618bda6918401fa18f9c08c3a5d74c`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:10:19.213177 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-33f043af-5acc-4ba0-aaca-b7cdd0f85bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:19.279525 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1317/2643] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:10:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:10:19.284790 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb41618-a0cc-46d6-aea5-cfedd943fb31 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:19.349920 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb41618-a0cc-46d6-aea5-cfedd943fb31 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:19.354790 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8957f4-ac3f-445d-8752-301e1350d6bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:19.355389 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8957f4-ac3f-445d-8752-301e1350d6bd admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:19.355650 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8957f4-ac3f-445d-8752-301e1350d6bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:19.355914 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8957f4-ac3f-445d-8752-301e1350d6bd admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:19.356539 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8957f4-ac3f-445d-8752-301e1350d6bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:19.358473 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8957f4-ac3f-445d-8752-301e1350d6bd admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:19.385272 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1327/2644] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 10 10:10:19 2022] POST /identity/v3/projects => generated 375 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:10:19.389645 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f043af-5acc-4ba0-aaca-b7cdd0f85bb3 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:19.400619 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f043af-5acc-4ba0-aaca-b7cdd0f85bb3 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:19.464914 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84a2340-57e6-4076-9049-ad3da4a0944b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:19.465550 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84a2340-57e6-4076-9049-ad3da4a0944b admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:19.465831 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84a2340-57e6-4076-9049-ad3da4a0944b admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:19.466104 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84a2340-57e6-4076-9049-ad3da4a0944b admin admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:19.466737 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84a2340-57e6-4076-9049-ad3da4a0944b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:19.468677 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84a2340-57e6-4076-9049-ad3da4a0944b admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:19.492909 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1318/2645] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 10 10:10:19 2022] POST /identity/v3/users => generated 288 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:10:19.497136 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8957f4-ac3f-445d-8752-301e1350d6bd admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:19.508639 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8957f4-ac3f-445d-8752-301e1350d6bd admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:19.514852 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48892647-4a49-42c1-96a0-2803efa2bb46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:19.515453 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48892647-4a49-42c1-96a0-2803efa2bb46 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:19.515731 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48892647-4a49-42c1-96a0-2803efa2bb46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:19.515998 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48892647-4a49-42c1-96a0-2803efa2bb46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:19.516649 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48892647-4a49-42c1-96a0-2803efa2bb46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:19.518356 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48892647-4a49-42c1-96a0-2803efa2bb46 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:19.529577 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1328/2646] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:10:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:10:19.533798 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84a2340-57e6-4076-9049-ad3da4a0944b admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:19.544617 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84a2340-57e6-4076-9049-ad3da4a0944b admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:19.550652 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace59910-2670-4758-820b-ed6f604b695b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:19.551249 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace59910-2670-4758-820b-ed6f604b695b admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:19.551526 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace59910-2670-4758-820b-ed6f604b695b admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:19.551806 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace59910-2670-4758-820b-ed6f604b695b admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:19.552452 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace59910-2670-4758-820b-ed6f604b695b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:19.554092 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace59910-2670-4758-820b-ed6f604b695b admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:19.563973 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1319/2647] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:10:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:10:19.568275 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48892647-4a49-42c1-96a0-2803efa2bb46 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:19.578780 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48892647-4a49-42c1-96a0-2803efa2bb46 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:19.583797 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb83eb6-e35b-465a-b9fa-c2232ec88a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:19.584454 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb83eb6-e35b-465a-b9fa-c2232ec88a79 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:19.584732 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb83eb6-e35b-465a-b9fa-c2232ec88a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:19.585003 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb83eb6-e35b-465a-b9fa-c2232ec88a79 admin admin] PATH_INFO: `/v3/projects/a15c147fe4e74f69adc95940d33b2bcb/users/d09b080f652f42bcbfd7dbf0180e5ef1/roles/8daabcb6b7394e39b06a3453e33e32db` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:19.600137 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb83eb6-e35b-465a-b9fa-c2232ec88a79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a15c147fe4e74f69adc95940d33b2bcb, user_id=d09b080f652f42bcbfd7dbf0180e5ef1, role_id=8daabcb6b7394e39b06a3453e33e32db)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:19.602795 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb83eb6-e35b-465a-b9fa-c2232ec88a79 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:19.618341 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1329/2648] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:10:19 2022] PUT /identity/v3/projects/a15c147fe4e74f69adc95940d33b2bcb/users/d09b080f652f42bcbfd7dbf0180e5ef1/roles/8daabcb6b7394e39b06a3453e33e32db => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:10:19.631571 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099e1200-9339-49a6-9907-85e93246bd43 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:19.632012 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099e1200-9339-49a6-9907-85e93246bd43 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:19.632460 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099e1200-9339-49a6-9907-85e93246bd43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:19.663134 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-099e1200-9339-49a6-9907-85e93246bd43 None None] MFA Rules not processed for user `d09b080f652f42bcbfd7dbf0180e5ef1`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:10:19.664367 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-099e1200-9339-49a6-9907-85e93246bd43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:19.694652 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:10:19.732228 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1320/2649] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:10:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:10:19.737011 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb83eb6-e35b-465a-b9fa-c2232ec88a79 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:19.800066 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb83eb6-e35b-465a-b9fa-c2232ec88a79 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:19.805044 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadd5b96-0ebd-4fc6-ac1e-e3eaf15ff2f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:19.805674 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadd5b96-0ebd-4fc6-ac1e-e3eaf15ff2f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:19.805958 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadd5b96-0ebd-4fc6-ac1e-e3eaf15ff2f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:19.806234 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadd5b96-0ebd-4fc6-ac1e-e3eaf15ff2f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:19.806956 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadd5b96-0ebd-4fc6-ac1e-e3eaf15ff2f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:19.808859 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadd5b96-0ebd-4fc6-ac1e-e3eaf15ff2f9 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:19.839518 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1330/2650] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 10 10:10:19 2022] POST /identity/v3/projects => generated 371 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:10:19.844192 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099e1200-9339-49a6-9907-85e93246bd43 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:19.855507 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099e1200-9339-49a6-9907-85e93246bd43 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:19.915072 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7d2e25-8e5c-4dd9-8052-6cbc6baa310c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:19.915591 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7d2e25-8e5c-4dd9-8052-6cbc6baa310c admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:19.915868 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7d2e25-8e5c-4dd9-8052-6cbc6baa310c admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:19.916259 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7d2e25-8e5c-4dd9-8052-6cbc6baa310c admin admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:19.916954 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7d2e25-8e5c-4dd9-8052-6cbc6baa310c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:19.919146 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7d2e25-8e5c-4dd9-8052-6cbc6baa310c admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:19.943811 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1321/2651] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 10 10:10:19 2022] POST /identity/v3/users => generated 292 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 10:10:19.948459 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadd5b96-0ebd-4fc6-ac1e-e3eaf15ff2f9 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:19.959494 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadd5b96-0ebd-4fc6-ac1e-e3eaf15ff2f9 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:19.966329 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22a9ab1-edc0-4db5-879e-2f2f0b7ccc07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:19.967214 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22a9ab1-edc0-4db5-879e-2f2f0b7ccc07 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:19.967636 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22a9ab1-edc0-4db5-879e-2f2f0b7ccc07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:19.968046 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22a9ab1-edc0-4db5-879e-2f2f0b7ccc07 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:19.969047 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22a9ab1-edc0-4db5-879e-2f2f0b7ccc07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:19.971624 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22a9ab1-edc0-4db5-879e-2f2f0b7ccc07 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:19.989641 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1331/2652] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:10:19 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:10:19.994592 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7d2e25-8e5c-4dd9-8052-6cbc6baa310c admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:20.007608 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7d2e25-8e5c-4dd9-8052-6cbc6baa310c admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:20.013715 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2533e042-52b3-4782-934d-be0d174bac3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:20.014359 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2533e042-52b3-4782-934d-be0d174bac3b admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:20.014644 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2533e042-52b3-4782-934d-be0d174bac3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:20.014913 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2533e042-52b3-4782-934d-be0d174bac3b admin admin] PATH_INFO: `/v3/projects/7b2b9e4817204fe2b437f52078f5c607/users/a1ee4b757c614b0ab6320c5e0347499e/roles/eb04edc46b3742d7a0f0ead26f68bc22` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:20.030063 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2533e042-52b3-4782-934d-be0d174bac3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b2b9e4817204fe2b437f52078f5c607, user_id=a1ee4b757c614b0ab6320c5e0347499e, role_id=eb04edc46b3742d7a0f0ead26f68bc22)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:20.032739 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2533e042-52b3-4782-934d-be0d174bac3b admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:20.048658 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1322/2653] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:10:19 2022] PUT /identity/v3/projects/7b2b9e4817204fe2b437f52078f5c607/users/a1ee4b757c614b0ab6320c5e0347499e/roles/eb04edc46b3742d7a0f0ead26f68bc22 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:10:20.053003 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22a9ab1-edc0-4db5-879e-2f2f0b7ccc07 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:20.063323 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22a9ab1-edc0-4db5-879e-2f2f0b7ccc07 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:20.080688 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:10:20.134982 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da998d4f-5385-4ade-8aa8-91d7e2d90481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:20.135605 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da998d4f-5385-4ade-8aa8-91d7e2d90481 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:20.135906 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da998d4f-5385-4ade-8aa8-91d7e2d90481 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:20.136180 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da998d4f-5385-4ade-8aa8-91d7e2d90481 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:20.136827 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da998d4f-5385-4ade-8aa8-91d7e2d90481 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:20.138468 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da998d4f-5385-4ade-8aa8-91d7e2d90481 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:20.149452 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1332/2654] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:10:20 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:10:20.156408 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2533e042-52b3-4782-934d-be0d174bac3b admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:20.168478 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2533e042-52b3-4782-934d-be0d174bac3b admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:20.173923 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc36a98b-d2ed-4e02-af10-f879151ec9fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:20.174574 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc36a98b-d2ed-4e02-af10-f879151ec9fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:20.174854 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc36a98b-d2ed-4e02-af10-f879151ec9fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:20.175126 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc36a98b-d2ed-4e02-af10-f879151ec9fe admin admin] PATH_INFO: `/v3/projects/7b2b9e4817204fe2b437f52078f5c607/users/a1ee4b757c614b0ab6320c5e0347499e/roles/eb04edc46b3742d7a0f0ead26f68bc22` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:20.177115 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc36a98b-d2ed-4e02-af10-f879151ec9fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b2b9e4817204fe2b437f52078f5c607, user_id=a1ee4b757c614b0ab6320c5e0347499e, role_id=eb04edc46b3742d7a0f0ead26f68bc22)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:20.179847 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc36a98b-d2ed-4e02-af10-f879151ec9fe admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:20.190532 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1323/2655] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:10:20 2022] PUT /identity/v3/projects/7b2b9e4817204fe2b437f52078f5c607/users/a1ee4b757c614b0ab6320c5e0347499e/roles/eb04edc46b3742d7a0f0ead26f68bc22 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:10:20.201885 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e402351-aa00-4fb9-aa14-86453ddbb25b None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:20.202383 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e402351-aa00-4fb9-aa14-86453ddbb25b None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:20.202651 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e402351-aa00-4fb9-aa14-86453ddbb25b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:20.231713 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-7e402351-aa00-4fb9-aa14-86453ddbb25b None None] MFA Rules not processed for user `a1ee4b757c614b0ab6320c5e0347499e`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:10:20.232961 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-7e402351-aa00-4fb9-aa14-86453ddbb25b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:20.311456 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1333/2656] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:10:20 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:10:20.323746 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc36a98b-d2ed-4e02-af10-f879151ec9fe admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:20.325764 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-fc36a98b-d2ed-4e02-af10-f879151ec9fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:20.386578 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc36a98b-d2ed-4e02-af10-f879151ec9fe admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:20.390264 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a20b02f-2024-4484-b12b-1c0a83de1b70 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf8e725cbe0403d943b136235eac057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:20.390867 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a20b02f-2024-4484-b12b-1c0a83de1b70 service cinder] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:20.391143 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a20b02f-2024-4484-b12b-1c0a83de1b70 service cinder] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:20.391406 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a20b02f-2024-4484-b12b-1c0a83de1b70 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:20.426141 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:10:20.451389 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a20b02f-2024-4484-b12b-1c0a83de1b70 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:20.452921 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a20b02f-2024-4484-b12b-1c0a83de1b70 service cinder] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:20.463124 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1324/2657] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:10:20 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:10:21.665937 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e402351-aa00-4fb9-aa14-86453ddbb25b None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:21.667619 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-7e402351-aa00-4fb9-aa14-86453ddbb25b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:21.733941 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e402351-aa00-4fb9-aa14-86453ddbb25b None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:21.738885 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313430d7-3926-4f9f-bdd1-aa5f0a8b6ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:21.739505 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313430d7-3926-4f9f-bdd1-aa5f0a8b6ab3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:21.739787 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313430d7-3926-4f9f-bdd1-aa5f0a8b6ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:21.740050 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313430d7-3926-4f9f-bdd1-aa5f0a8b6ab3 admin admin] PATH_INFO: `/v3/users/64edfd43e3f24c1e9e1cbb898d4c1d63` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:21.741217 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313430d7-3926-4f9f-bdd1-aa5f0a8b6ab3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64edfd43e3f24c1e9e1cbb898d4c1d63)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:21.743123 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313430d7-3926-4f9f-bdd1-aa5f0a8b6ab3 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:21.790321 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:10:21.793054 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-313430d7-3926-4f9f-bdd1-aa5f0a8b6ab3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64edfd43e3f24c1e9e1cbb898d4c1d63'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:21.802334 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-313430d7-3926-4f9f-bdd1-aa5f0a8b6ab3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64edfd43e3f24c1e9e1cbb898d4c1d63'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:21.802900 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-313430d7-3926-4f9f-bdd1-aa5f0a8b6ab3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64edfd43e3f24c1e9e1cbb898d4c1d63'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:21.803469 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-313430d7-3926-4f9f-bdd1-aa5f0a8b6ab3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64edfd43e3f24c1e9e1cbb898d4c1d63'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:21.810678 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-313430d7-3926-4f9f-bdd1-aa5f0a8b6ab3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64edfd43e3f24c1e9e1cbb898d4c1d63'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:21.828711 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1334/2658] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 10 10:10:21 2022] DELETE /identity/v3/users/64edfd43e3f24c1e9e1cbb898d4c1d63 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:10:21.833241 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d6f977-b3a5-4f99-8f2b-85fe681822db None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:21.833709 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d6f977-b3a5-4f99-8f2b-85fe681822db None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:21.833974 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d6f977-b3a5-4f99-8f2b-85fe681822db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:21.853229 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-43d6f977-b3a5-4f99-8f2b-85fe681822db None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:10:21.854573 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-43d6f977-b3a5-4f99-8f2b-85fe681822db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:21.918204 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1325/2659] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:10:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:10:21.928206 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313430d7-3926-4f9f-bdd1-aa5f0a8b6ab3 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:21.929824 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-313430d7-3926-4f9f-bdd1-aa5f0a8b6ab3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:21.975194 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d6f977-b3a5-4f99-8f2b-85fe681822db None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:21.976722 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-43d6f977-b3a5-4f99-8f2b-85fe681822db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:21.989047 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313430d7-3926-4f9f-bdd1-aa5f0a8b6ab3 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:21.993264 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00863906-786a-44a2-93f3-df150ce75ddc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4294c170df354fe892831281acd4ea7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:21.993872 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00863906-786a-44a2-93f3-df150ce75ddc service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:21.994166 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00863906-786a-44a2-93f3-df150ce75ddc service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:21.994491 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00863906-786a-44a2-93f3-df150ce75ddc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:22.004686 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00863906-786a-44a2-93f3-df150ce75ddc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:22.006168 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00863906-786a-44a2-93f3-df150ce75ddc service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:22.015803 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1335/2660] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:10:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 10:10:22.034087 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d6f977-b3a5-4f99-8f2b-85fe681822db None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:22.037666 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39cbb89-9fcc-4478-969a-c4182a50b288 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf8e725cbe0403d943b136235eac057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:22.038376 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39cbb89-9fcc-4478-969a-c4182a50b288 service cinder] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:22.038655 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39cbb89-9fcc-4478-969a-c4182a50b288 service cinder] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:22.038923 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39cbb89-9fcc-4478-969a-c4182a50b288 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:22.040634 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-b39cbb89-9fcc-4478-969a-c4182a50b288 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:22.101150 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39cbb89-9fcc-4478-969a-c4182a50b288 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:22.102612 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39cbb89-9fcc-4478-969a-c4182a50b288 service cinder] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:22.111918 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1326/2661] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:10:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:10:22.297982 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00863906-786a-44a2-93f3-df150ce75ddc service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:22.299664 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-00863906-786a-44a2-93f3-df150ce75ddc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:22.319691 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00863906-786a-44a2-93f3-df150ce75ddc service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:22.325722 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5c1019-2d5f-497a-ba45-11ff971fe339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:22.326363 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5c1019-2d5f-497a-ba45-11ff971fe339 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:22.326695 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5c1019-2d5f-497a-ba45-11ff971fe339 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:22.326960 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5c1019-2d5f-497a-ba45-11ff971fe339 admin admin] PATH_INFO: `/v3/projects/b1c217d13e484000922953c86360c516` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:22.328355 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5c1019-2d5f-497a-ba45-11ff971fe339 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1c217d13e484000922953c86360c516)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:22.330183 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5c1019-2d5f-497a-ba45-11ff971fe339 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:22.376772 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-3b5c1019-2d5f-497a-ba45-11ff971fe339 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1c217d13e484000922953c86360c516', 'request_id': 'req-3b5c1019-2d5f-497a-ba45-11ff971fe339'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:22.382565 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-3b5c1019-2d5f-497a-ba45-11ff971fe339 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1c217d13e484000922953c86360c516', 'request_id': 'req-3b5c1019-2d5f-497a-ba45-11ff971fe339'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:22.390629 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-3b5c1019-2d5f-497a-ba45-11ff971fe339 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1c217d13e484000922953c86360c516', 'request_id': 'req-3b5c1019-2d5f-497a-ba45-11ff971fe339'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:22.403390 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-3b5c1019-2d5f-497a-ba45-11ff971fe339 admin admin] The token cache is being invalidate because project b1c217d13e484000922953c86360c516 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 10:10:22.403678 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-3b5c1019-2d5f-497a-ba45-11ff971fe339 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:22.404346 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-3b5c1019-2d5f-497a-ba45-11ff971fe339 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:22.405973 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1336/2662] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 10 10:10:22 2022] DELETE /identity/v3/projects/b1c217d13e484000922953c86360c516 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:10:22.409989 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39cbb89-9fcc-4478-969a-c4182a50b288 service cinder] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:22.420624 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39cbb89-9fcc-4478-969a-c4182a50b288 service cinder] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:22.451184 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:10:22.479682 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845c7547-00b5-499e-937b-24e4b8a48bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:22.480364 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845c7547-00b5-499e-937b-24e4b8a48bd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:22.480637 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845c7547-00b5-499e-937b-24e4b8a48bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:22.481030 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845c7547-00b5-499e-937b-24e4b8a48bd7 admin admin] PATH_INFO: `/v3/users/a53e5a55a8d14bb7978bfae82bb8f87f` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:22.482273 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845c7547-00b5-499e-937b-24e4b8a48bd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a53e5a55a8d14bb7978bfae82bb8f87f)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:22.484188 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845c7547-00b5-499e-937b-24e4b8a48bd7 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:22.532031 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-845c7547-00b5-499e-937b-24e4b8a48bd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a53e5a55a8d14bb7978bfae82bb8f87f'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:22.540171 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-845c7547-00b5-499e-937b-24e4b8a48bd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a53e5a55a8d14bb7978bfae82bb8f87f'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:22.548809 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-845c7547-00b5-499e-937b-24e4b8a48bd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a53e5a55a8d14bb7978bfae82bb8f87f'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:22.549411 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-845c7547-00b5-499e-937b-24e4b8a48bd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a53e5a55a8d14bb7978bfae82bb8f87f'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:22.550037 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-845c7547-00b5-499e-937b-24e4b8a48bd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a53e5a55a8d14bb7978bfae82bb8f87f'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:22.568631 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1327/2663] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 10 10:10:22 2022] DELETE /identity/v3/users/a53e5a55a8d14bb7978bfae82bb8f87f => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:10:22.693218 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5c1019-2d5f-497a-ba45-11ff971fe339 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:22.694711 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-3b5c1019-2d5f-497a-ba45-11ff971fe339 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:22.748692 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:10:22.754892 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5c1019-2d5f-497a-ba45-11ff971fe339 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:22.807400 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fac87d-c50d-4d25-8711-c9324e128595 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf8e725cbe0403d943b136235eac057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:22.807949 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fac87d-c50d-4d25-8711-c9324e128595 service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:22.808230 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fac87d-c50d-4d25-8711-c9324e128595 service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:22.808497 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fac87d-c50d-4d25-8711-c9324e128595 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:22.810433 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-37fac87d-c50d-4d25-8711-c9324e128595 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:22.849467 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845c7547-00b5-499e-937b-24e4b8a48bd7 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:22.850912 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-845c7547-00b5-499e-937b-24e4b8a48bd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:22.880609 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fac87d-c50d-4d25-8711-c9324e128595 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:22.882186 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fac87d-c50d-4d25-8711-c9324e128595 service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:22.891938 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1337/2664] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:10:22 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:10:22.920077 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845c7547-00b5-499e-937b-24e4b8a48bd7 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:22.925141 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6f0bd2-dbbb-44e9-8e32-b315a6aa33f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:22.925932 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6f0bd2-dbbb-44e9-8e32-b315a6aa33f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:22.926279 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6f0bd2-dbbb-44e9-8e32-b315a6aa33f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:22.926646 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6f0bd2-dbbb-44e9-8e32-b315a6aa33f0 admin admin] PATH_INFO: `/v3/projects/b0f0e94bdf8c459a872e2ece0fc183fb` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:22.927999 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6f0bd2-dbbb-44e9-8e32-b315a6aa33f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0f0e94bdf8c459a872e2ece0fc183fb)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:22.930564 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6f0bd2-dbbb-44e9-8e32-b315a6aa33f0 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:22.982695 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-4f6f0bd2-dbbb-44e9-8e32-b315a6aa33f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0f0e94bdf8c459a872e2ece0fc183fb', 'request_id': 'req-4f6f0bd2-dbbb-44e9-8e32-b315a6aa33f0'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:22.984949 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:10:22.990099 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-4f6f0bd2-dbbb-44e9-8e32-b315a6aa33f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0f0e94bdf8c459a872e2ece0fc183fb', 'request_id': 'req-4f6f0bd2-dbbb-44e9-8e32-b315a6aa33f0'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:22.998433 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-4f6f0bd2-dbbb-44e9-8e32-b315a6aa33f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0f0e94bdf8c459a872e2ece0fc183fb', 'request_id': 'req-4f6f0bd2-dbbb-44e9-8e32-b315a6aa33f0'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:23.009729 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-4f6f0bd2-dbbb-44e9-8e32-b315a6aa33f0 admin admin] The token cache is being invalidate because project b0f0e94bdf8c459a872e2ece0fc183fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 10:10:23.010220 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-4f6f0bd2-dbbb-44e9-8e32-b315a6aa33f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:23.010989 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-4f6f0bd2-dbbb-44e9-8e32-b315a6aa33f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:23.012524 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1328/2665] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 10 10:10:22 2022] DELETE /identity/v3/projects/b0f0e94bdf8c459a872e2ece0fc183fb => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 10:10:23.017482 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebc9ec0-19c2-4400-9106-71895740205b None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:23.017765 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebc9ec0-19c2-4400-9106-71895740205b None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:23.018031 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebc9ec0-19c2-4400-9106-71895740205b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:23.038072 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-2ebc9ec0-19c2-4400-9106-71895740205b None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:10:23.039288 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-2ebc9ec0-19c2-4400-9106-71895740205b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:23.101893 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1338/2666] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:10:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:10:23.111941 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b519256-125d-4025-b156-f34a83fc055b None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:23.112229 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b519256-125d-4025-b156-f34a83fc055b None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:23.112505 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b519256-125d-4025-b156-f34a83fc055b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:23.132225 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-6b519256-125d-4025-b156-f34a83fc055b None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:10:23.133481 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-6b519256-125d-4025-b156-f34a83fc055b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:23.142597 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1329/2667] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:10:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:10:23.148273 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebc9ec0-19c2-4400-9106-71895740205b None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:23.161607 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebc9ec0-19c2-4400-9106-71895740205b None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:23.168180 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e444b9e-d2dc-4503-a217-4eb7f2a1a631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:23.168877 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e444b9e-d2dc-4503-a217-4eb7f2a1a631 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:23.169266 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e444b9e-d2dc-4503-a217-4eb7f2a1a631 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:23.169541 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e444b9e-d2dc-4503-a217-4eb7f2a1a631 admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:23.170357 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e444b9e-d2dc-4503-a217-4eb7f2a1a631 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:10:23.170758 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e444b9e-d2dc-4503-a217-4eb7f2a1a631 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:23.173472 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e444b9e-d2dc-4503-a217-4eb7f2a1a631 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:23.185498 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1339/2668] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 10 10:10:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:10:23.190024 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b519256-125d-4025-b156-f34a83fc055b None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:23.199896 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b519256-125d-4025-b156-f34a83fc055b None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:23.205455 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112f5a7b-f4f8-4e03-a87f-d4a8b5ef792f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:23.206050 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112f5a7b-f4f8-4e03-a87f-d4a8b5ef792f admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:23.206323 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112f5a7b-f4f8-4e03-a87f-d4a8b5ef792f admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:23.206587 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112f5a7b-f4f8-4e03-a87f-d4a8b5ef792f admin admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:23.207214 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112f5a7b-f4f8-4e03-a87f-d4a8b5ef792f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:23.209187 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112f5a7b-f4f8-4e03-a87f-d4a8b5ef792f admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:23.240247 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1330/2669] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 10 10:10:23 2022] POST /identity/v3/projects => generated 387 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 10:10:23.244665 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e444b9e-d2dc-4503-a217-4eb7f2a1a631 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:23.255325 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e444b9e-d2dc-4503-a217-4eb7f2a1a631 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:23.293418 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:10:23.315576 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06228b96-eadf-4084-9c51-2e1f98c0de30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:23.316189 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06228b96-eadf-4084-9c51-2e1f98c0de30 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:23.316467 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06228b96-eadf-4084-9c51-2e1f98c0de30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:23.316739 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06228b96-eadf-4084-9c51-2e1f98c0de30 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:23.317403 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06228b96-eadf-4084-9c51-2e1f98c0de30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:23.319329 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06228b96-eadf-4084-9c51-2e1f98c0de30 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:23.342418 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1340/2670] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 10 10:10:23 2022] POST /identity/v3/users => generated 294 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:10:23.347275 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112f5a7b-f4f8-4e03-a87f-d4a8b5ef792f admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:23.360907 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112f5a7b-f4f8-4e03-a87f-d4a8b5ef792f admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:23.368752 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff7a266-8821-400b-8e64-02626365f147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:23.369674 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff7a266-8821-400b-8e64-02626365f147 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:23.369955 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff7a266-8821-400b-8e64-02626365f147 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:23.370225 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff7a266-8821-400b-8e64-02626365f147 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:23.370871 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff7a266-8821-400b-8e64-02626365f147 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:23.372493 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff7a266-8821-400b-8e64-02626365f147 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:23.382935 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1331/2671] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:10:23 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:10:23.387050 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06228b96-eadf-4084-9c51-2e1f98c0de30 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:23.399106 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06228b96-eadf-4084-9c51-2e1f98c0de30 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:23.405585 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9ea402-5a49-48d9-9b03-c295fb09d75b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:23.406268 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9ea402-5a49-48d9-9b03-c295fb09d75b admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:23.406537 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9ea402-5a49-48d9-9b03-c295fb09d75b admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:23.407039 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9ea402-5a49-48d9-9b03-c295fb09d75b admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:23.407637 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9ea402-5a49-48d9-9b03-c295fb09d75b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:23.409213 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9ea402-5a49-48d9-9b03-c295fb09d75b admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:23.420278 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1341/2672] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:10:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:10:23.425007 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff7a266-8821-400b-8e64-02626365f147 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:23.435987 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff7a266-8821-400b-8e64-02626365f147 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:23.441973 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73d44fc-bda3-4f0e-8e2e-1da7f22071b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:23.442632 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73d44fc-bda3-4f0e-8e2e-1da7f22071b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:23.442874 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73d44fc-bda3-4f0e-8e2e-1da7f22071b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:23.443167 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73d44fc-bda3-4f0e-8e2e-1da7f22071b7 admin admin] PATH_INFO: `/v3/projects/c4164265970c4b00bfcb9bb3bb6e9159/users/6c760ecb088844c896c0357ac5aef4dc/roles/8daabcb6b7394e39b06a3453e33e32db` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:23.460072 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73d44fc-bda3-4f0e-8e2e-1da7f22071b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4164265970c4b00bfcb9bb3bb6e9159, user_id=6c760ecb088844c896c0357ac5aef4dc, role_id=8daabcb6b7394e39b06a3453e33e32db)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:23.462770 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73d44fc-bda3-4f0e-8e2e-1da7f22071b7 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:23.478568 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1332/2673] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:10:23 2022] PUT /identity/v3/projects/c4164265970c4b00bfcb9bb3bb6e9159/users/6c760ecb088844c896c0357ac5aef4dc/roles/8daabcb6b7394e39b06a3453e33e32db => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:10:23.488915 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849a0231-00be-467d-94e0-d0217ab32e3f None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:23.489269 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849a0231-00be-467d-94e0-d0217ab32e3f None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:23.489542 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849a0231-00be-467d-94e0-d0217ab32e3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:23.517567 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-849a0231-00be-467d-94e0-d0217ab32e3f None None] MFA Rules not processed for user `6c760ecb088844c896c0357ac5aef4dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:10:23.518797 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-849a0231-00be-467d-94e0-d0217ab32e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:23.590486 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1342/2674] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:10:23 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:10:23.595408 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73d44fc-bda3-4f0e-8e2e-1da7f22071b7 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:23.660217 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73d44fc-bda3-4f0e-8e2e-1da7f22071b7 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:23.665711 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c24f32-a5f0-47c6-818a-b1be4b149190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:23.666317 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c24f32-a5f0-47c6-818a-b1be4b149190 admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:23.666594 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c24f32-a5f0-47c6-818a-b1be4b149190 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:23.666862 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c24f32-a5f0-47c6-818a-b1be4b149190 admin admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:23.667487 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c24f32-a5f0-47c6-818a-b1be4b149190 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:23.669436 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c24f32-a5f0-47c6-818a-b1be4b149190 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:23.700376 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1333/2675] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 10 10:10:23 2022] POST /identity/v3/projects => generated 387 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:10:23.704508 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849a0231-00be-467d-94e0-d0217ab32e3f None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:23.715166 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849a0231-00be-467d-94e0-d0217ab32e3f None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:23.772219 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5175c19-763a-491e-bff2-9bec03391325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:23.772835 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5175c19-763a-491e-bff2-9bec03391325 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:23.773147 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5175c19-763a-491e-bff2-9bec03391325 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:23.773427 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5175c19-763a-491e-bff2-9bec03391325 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:23.774088 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5175c19-763a-491e-bff2-9bec03391325 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:23.776010 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5175c19-763a-491e-bff2-9bec03391325 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:23.799257 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1343/2676] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 10 10:10:23 2022] POST /identity/v3/users => generated 300 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:10:23.804726 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c24f32-a5f0-47c6-818a-b1be4b149190 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:23.815448 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c24f32-a5f0-47c6-818a-b1be4b149190 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:23.821255 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c24f61f-0f75-49c6-b06d-376e439c645f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:23.821852 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c24f61f-0f75-49c6-b06d-376e439c645f admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:23.822131 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c24f61f-0f75-49c6-b06d-376e439c645f admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:23.822478 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c24f61f-0f75-49c6-b06d-376e439c645f admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:23.823133 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c24f61f-0f75-49c6-b06d-376e439c645f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:23.824785 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c24f61f-0f75-49c6-b06d-376e439c645f admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:23.835641 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1334/2677] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:10:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 10:10:23.839941 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5175c19-763a-491e-bff2-9bec03391325 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:23.851195 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5175c19-763a-491e-bff2-9bec03391325 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:23.856484 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138ece14-e082-4026-b2fa-c060df9aba52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:23.857180 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138ece14-e082-4026-b2fa-c060df9aba52 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:23.857463 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138ece14-e082-4026-b2fa-c060df9aba52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:23.857734 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138ece14-e082-4026-b2fa-c060df9aba52 admin admin] PATH_INFO: `/v3/projects/863d69f632554f5d8eefc870c5102d4f/users/674dc596c31947efb7b951f6bbb0c5c1/roles/eb04edc46b3742d7a0f0ead26f68bc22` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:23.872834 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138ece14-e082-4026-b2fa-c060df9aba52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=863d69f632554f5d8eefc870c5102d4f, user_id=674dc596c31947efb7b951f6bbb0c5c1, role_id=eb04edc46b3742d7a0f0ead26f68bc22)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:23.875532 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138ece14-e082-4026-b2fa-c060df9aba52 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:23.890342 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1344/2678] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:10:23 2022] PUT /identity/v3/projects/863d69f632554f5d8eefc870c5102d4f/users/674dc596c31947efb7b951f6bbb0c5c1/roles/eb04edc46b3742d7a0f0ead26f68bc22 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:10:23.894289 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c24f61f-0f75-49c6-b06d-376e439c645f admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:23.904782 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c24f61f-0f75-49c6-b06d-376e439c645f admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:23.954648 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:10:23.966426 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d419cf9d-c3c9-46c7-9705-94359241ba00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:23.967136 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d419cf9d-c3c9-46c7-9705-94359241ba00 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:23.967505 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d419cf9d-c3c9-46c7-9705-94359241ba00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:23.967932 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d419cf9d-c3c9-46c7-9705-94359241ba00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:23.968622 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d419cf9d-c3c9-46c7-9705-94359241ba00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:23.970752 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d419cf9d-c3c9-46c7-9705-94359241ba00 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:23.980782 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1335/2679] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:10:23 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:10:23.985139 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138ece14-e082-4026-b2fa-c060df9aba52 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:23.995715 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138ece14-e082-4026-b2fa-c060df9aba52 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:24.000918 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e454052-f2ab-463e-881b-605ab6320e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:24.001602 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e454052-f2ab-463e-881b-605ab6320e59 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:24.001880 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e454052-f2ab-463e-881b-605ab6320e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:24.002152 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e454052-f2ab-463e-881b-605ab6320e59 admin admin] PATH_INFO: `/v3/projects/863d69f632554f5d8eefc870c5102d4f/users/674dc596c31947efb7b951f6bbb0c5c1/roles/eb04edc46b3742d7a0f0ead26f68bc22` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:24.004339 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e454052-f2ab-463e-881b-605ab6320e59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=863d69f632554f5d8eefc870c5102d4f, user_id=674dc596c31947efb7b951f6bbb0c5c1, role_id=eb04edc46b3742d7a0f0ead26f68bc22)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:24.006855 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e454052-f2ab-463e-881b-605ab6320e59 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:24.013781 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:10:24.019062 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1345/2680] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:10:23 2022] PUT /identity/v3/projects/863d69f632554f5d8eefc870c5102d4f/users/674dc596c31947efb7b951f6bbb0c5c1/roles/eb04edc46b3742d7a0f0ead26f68bc22 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:10:24.034844 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe2d4cb-1e5f-4cd2-a42a-d4acc256fc14 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:24.035133 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe2d4cb-1e5f-4cd2-a42a-d4acc256fc14 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:24.035406 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe2d4cb-1e5f-4cd2-a42a-d4acc256fc14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:24.064444 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-cbe2d4cb-1e5f-4cd2-a42a-d4acc256fc14 None None] MFA Rules not processed for user `674dc596c31947efb7b951f6bbb0c5c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:10:24.065694 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-cbe2d4cb-1e5f-4cd2-a42a-d4acc256fc14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:24.135585 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1336/2681] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:10:24 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:10:24.147591 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e454052-f2ab-463e-881b-605ab6320e59 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:24.149663 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-8e454052-f2ab-463e-881b-605ab6320e59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:24.209806 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e454052-f2ab-463e-881b-605ab6320e59 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:24.213768 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0dff3a-2b07-49d9-b540-f080b611e2fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf8e725cbe0403d943b136235eac057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:24.214377 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0dff3a-2b07-49d9-b540-f080b611e2fd service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:24.214656 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0dff3a-2b07-49d9-b540-f080b611e2fd service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:24.214923 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0dff3a-2b07-49d9-b540-f080b611e2fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:24.224096 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0dff3a-2b07-49d9-b540-f080b611e2fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:24.225581 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0dff3a-2b07-49d9-b540-f080b611e2fd service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:24.236013 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1346/2682] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:10:24 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:10:24.348392 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe2d4cb-1e5f-4cd2-a42a-d4acc256fc14 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:24.433379 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe2d4cb-1e5f-4cd2-a42a-d4acc256fc14 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:24.438443 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bcebe2-3556-4f3d-a9d4-180c32c86740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:24.439090 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bcebe2-3556-4f3d-a9d4-180c32c86740 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:24.439370 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bcebe2-3556-4f3d-a9d4-180c32c86740 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:24.439643 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bcebe2-3556-4f3d-a9d4-180c32c86740 admin admin] PATH_INFO: `/v3/users/6c760ecb088844c896c0357ac5aef4dc` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:24.440831 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bcebe2-3556-4f3d-a9d4-180c32c86740 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c760ecb088844c896c0357ac5aef4dc)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:24.442828 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bcebe2-3556-4f3d-a9d4-180c32c86740 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:24.490869 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-f0bcebe2-3556-4f3d-a9d4-180c32c86740 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c760ecb088844c896c0357ac5aef4dc'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:24.497686 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-f0bcebe2-3556-4f3d-a9d4-180c32c86740 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c760ecb088844c896c0357ac5aef4dc'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:24.506174 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-f0bcebe2-3556-4f3d-a9d4-180c32c86740 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c760ecb088844c896c0357ac5aef4dc'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:24.506787 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-f0bcebe2-3556-4f3d-a9d4-180c32c86740 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c760ecb088844c896c0357ac5aef4dc'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:24.507584 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-f0bcebe2-3556-4f3d-a9d4-180c32c86740 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c760ecb088844c896c0357ac5aef4dc'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:24.515738 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:10:24.526719 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1337/2683] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 10 10:10:24 2022] DELETE /identity/v3/users/6c760ecb088844c896c0357ac5aef4dc => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:10:24.531341 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20602fe9-50a7-4553-839b-28b0e1337b36 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:24.531629 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20602fe9-50a7-4553-839b-28b0e1337b36 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:24.531903 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20602fe9-50a7-4553-839b-28b0e1337b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:24.551638 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-20602fe9-50a7-4553-839b-28b0e1337b36 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:10:24.552858 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-20602fe9-50a7-4553-839b-28b0e1337b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:24.613455 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1347/2684] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:10:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:10:24.623409 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bcebe2-3556-4f3d-a9d4-180c32c86740 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:24.624932 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-f0bcebe2-3556-4f3d-a9d4-180c32c86740 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:24.694042 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bcebe2-3556-4f3d-a9d4-180c32c86740 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:24.699643 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099608d7-8d1b-482d-aa6d-d478ae108ffc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4294c170df354fe892831281acd4ea7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:24.700502 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099608d7-8d1b-482d-aa6d-d478ae108ffc service neutron] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:24.700829 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099608d7-8d1b-482d-aa6d-d478ae108ffc service neutron] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:24.701212 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099608d7-8d1b-482d-aa6d-d478ae108ffc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:24.717108 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099608d7-8d1b-482d-aa6d-d478ae108ffc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:24.718633 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099608d7-8d1b-482d-aa6d-d478ae108ffc service neutron] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:24.728432 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1338/2685] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:10:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:10:25.008629 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20602fe9-50a7-4553-839b-28b0e1337b36 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:25.010194 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-20602fe9-50a7-4553-839b-28b0e1337b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:25.022287 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20602fe9-50a7-4553-839b-28b0e1337b36 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:25.027461 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105ed704-7f33-4993-948f-85673746c874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:25.028239 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105ed704-7f33-4993-948f-85673746c874 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:25.028617 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105ed704-7f33-4993-948f-85673746c874 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:25.028977 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105ed704-7f33-4993-948f-85673746c874 admin admin] PATH_INFO: `/v3/projects/c4164265970c4b00bfcb9bb3bb6e9159` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:25.030275 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105ed704-7f33-4993-948f-85673746c874 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4164265970c4b00bfcb9bb3bb6e9159)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:25.032195 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105ed704-7f33-4993-948f-85673746c874 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:25.080479 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-105ed704-7f33-4993-948f-85673746c874 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4164265970c4b00bfcb9bb3bb6e9159', 'request_id': 'req-105ed704-7f33-4993-948f-85673746c874'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:25.085868 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-105ed704-7f33-4993-948f-85673746c874 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4164265970c4b00bfcb9bb3bb6e9159', 'request_id': 'req-105ed704-7f33-4993-948f-85673746c874'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:25.094449 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-105ed704-7f33-4993-948f-85673746c874 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4164265970c4b00bfcb9bb3bb6e9159', 'request_id': 'req-105ed704-7f33-4993-948f-85673746c874'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:25.105754 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-105ed704-7f33-4993-948f-85673746c874 admin admin] The token cache is being invalidate because project c4164265970c4b00bfcb9bb3bb6e9159 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 10:10:25.106042 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-105ed704-7f33-4993-948f-85673746c874 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:25.106658 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-105ed704-7f33-4993-948f-85673746c874 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:25.108156 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1348/2686] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 10 10:10:25 2022] DELETE /identity/v3/projects/c4164265970c4b00bfcb9bb3bb6e9159 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:10:25.112343 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099608d7-8d1b-482d-aa6d-d478ae108ffc service neutron] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:25.122370 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099608d7-8d1b-482d-aa6d-d478ae108ffc service neutron] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:25.180264 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aae2270-f99f-4a91-b043-826f14b3356c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:25.180892 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aae2270-f99f-4a91-b043-826f14b3356c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:25.181220 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aae2270-f99f-4a91-b043-826f14b3356c admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:25.181484 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aae2270-f99f-4a91-b043-826f14b3356c admin admin] PATH_INFO: `/v3/users/674dc596c31947efb7b951f6bbb0c5c1` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:25.182698 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aae2270-f99f-4a91-b043-826f14b3356c admin admin] RBAC: Authorizing `identity:delete_user(user_id=674dc596c31947efb7b951f6bbb0c5c1)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:25.184648 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aae2270-f99f-4a91-b043-826f14b3356c admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:25.234179 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-4aae2270-f99f-4a91-b043-826f14b3356c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '674dc596c31947efb7b951f6bbb0c5c1'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:25.240925 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-4aae2270-f99f-4a91-b043-826f14b3356c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '674dc596c31947efb7b951f6bbb0c5c1'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:25.249456 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-4aae2270-f99f-4a91-b043-826f14b3356c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '674dc596c31947efb7b951f6bbb0c5c1'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:25.250090 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-4aae2270-f99f-4a91-b043-826f14b3356c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '674dc596c31947efb7b951f6bbb0c5c1'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:25.250697 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-4aae2270-f99f-4a91-b043-826f14b3356c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '674dc596c31947efb7b951f6bbb0c5c1'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:25.267920 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1339/2687] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 10 10:10:25 2022] DELETE /identity/v3/users/674dc596c31947efb7b951f6bbb0c5c1 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:10:25.563589 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105ed704-7f33-4993-948f-85673746c874 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:25.565657 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-105ed704-7f33-4993-948f-85673746c874 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:25.595722 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105ed704-7f33-4993-948f-85673746c874 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:25.622770 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:10:25.661443 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828e5ae5-3646-4d43-80e2-a63a2f2c0f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:25.662174 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e5ae5-3646-4d43-80e2-a63a2f2c0f97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:25.662516 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e5ae5-3646-4d43-80e2-a63a2f2c0f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:25.662849 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e5ae5-3646-4d43-80e2-a63a2f2c0f97 admin admin] PATH_INFO: `/v3/projects/863d69f632554f5d8eefc870c5102d4f` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:25.664036 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828e5ae5-3646-4d43-80e2-a63a2f2c0f97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=863d69f632554f5d8eefc870c5102d4f)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:25.666125 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828e5ae5-3646-4d43-80e2-a63a2f2c0f97 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:25.718735 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-828e5ae5-3646-4d43-80e2-a63a2f2c0f97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '863d69f632554f5d8eefc870c5102d4f', 'request_id': 'req-828e5ae5-3646-4d43-80e2-a63a2f2c0f97'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:25.724138 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-828e5ae5-3646-4d43-80e2-a63a2f2c0f97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '863d69f632554f5d8eefc870c5102d4f', 'request_id': 'req-828e5ae5-3646-4d43-80e2-a63a2f2c0f97'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:25.732367 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-828e5ae5-3646-4d43-80e2-a63a2f2c0f97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '863d69f632554f5d8eefc870c5102d4f', 'request_id': 'req-828e5ae5-3646-4d43-80e2-a63a2f2c0f97'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:25.743343 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-828e5ae5-3646-4d43-80e2-a63a2f2c0f97 admin admin] The token cache is being invalidate because project 863d69f632554f5d8eefc870c5102d4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 10:10:25.743635 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-828e5ae5-3646-4d43-80e2-a63a2f2c0f97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:25.744246 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-828e5ae5-3646-4d43-80e2-a63a2f2c0f97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:25.745832 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1349/2688] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 10 10:10:25 2022] DELETE /identity/v3/projects/863d69f632554f5d8eefc870c5102d4f => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:10:25.751147 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c527b57e-588e-4ddf-a6c9-4e99db9aee42 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:25.751332 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c527b57e-588e-4ddf-a6c9-4e99db9aee42 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:25.751861 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c527b57e-588e-4ddf-a6c9-4e99db9aee42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:25.772041 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-c527b57e-588e-4ddf-a6c9-4e99db9aee42 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:10:25.773213 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-c527b57e-588e-4ddf-a6c9-4e99db9aee42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:25.782361 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:10:25.839119 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1340/2689] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:10:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:10:25.847030 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2854f088-9998-4b95-a6ac-5af43f4db539 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:25.847343 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2854f088-9998-4b95-a6ac-5af43f4db539 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:25.847687 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2854f088-9998-4b95-a6ac-5af43f4db539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:25.869653 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-2854f088-9998-4b95-a6ac-5af43f4db539 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:10:25.870882 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-2854f088-9998-4b95-a6ac-5af43f4db539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:25.878791 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1350/2690] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:10:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:10:25.883160 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c527b57e-588e-4ddf-a6c9-4e99db9aee42 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:25.893279 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c527b57e-588e-4ddf-a6c9-4e99db9aee42 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:25.899108 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847f74e2-89f7-4337-a8a1-3a8a8a4204f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:25.899696 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847f74e2-89f7-4337-a8a1-3a8a8a4204f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:25.899959 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847f74e2-89f7-4337-a8a1-3a8a8a4204f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:25.900225 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847f74e2-89f7-4337-a8a1-3a8a8a4204f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:25.900932 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847f74e2-89f7-4337-a8a1-3a8a8a4204f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:10:25.901264 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847f74e2-89f7-4337-a8a1-3a8a8a4204f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:25.902866 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847f74e2-89f7-4337-a8a1-3a8a8a4204f5 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:25.915878 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1341/2691] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 10 10:10:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:10:25.920374 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2854f088-9998-4b95-a6ac-5af43f4db539 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:25.930076 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2854f088-9998-4b95-a6ac-5af43f4db539 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:25.936273 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7193a4-7e2a-4dbc-bb39-90352cc4b879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:25.937657 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7193a4-7e2a-4dbc-bb39-90352cc4b879 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:25.937799 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7193a4-7e2a-4dbc-bb39-90352cc4b879 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:25.938406 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7193a4-7e2a-4dbc-bb39-90352cc4b879 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:25.939046 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7193a4-7e2a-4dbc-bb39-90352cc4b879 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:25.940949 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7193a4-7e2a-4dbc-bb39-90352cc4b879 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:25.971076 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1351/2692] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 10 10:10:25 2022] POST /identity/v3/projects => generated 391 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:10:25.975473 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847f74e2-89f7-4337-a8a1-3a8a8a4204f5 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:25.986261 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847f74e2-89f7-4337-a8a1-3a8a8a4204f5 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:26.045214 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508b9ea8-1f74-4862-bc89-c2b71c1c7736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:26.045752 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508b9ea8-1f74-4862-bc89-c2b71c1c7736 admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:26.046032 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508b9ea8-1f74-4862-bc89-c2b71c1c7736 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:26.046305 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508b9ea8-1f74-4862-bc89-c2b71c1c7736 admin admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:26.046924 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508b9ea8-1f74-4862-bc89-c2b71c1c7736 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:26.049241 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508b9ea8-1f74-4862-bc89-c2b71c1c7736 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:26.072579 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1342/2693] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 10 10:10:25 2022] POST /identity/v3/users => generated 296 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:10:26.076984 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7193a4-7e2a-4dbc-bb39-90352cc4b879 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:26.087515 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7193a4-7e2a-4dbc-bb39-90352cc4b879 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:26.092444 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641fc857-e018-4b1e-9d40-5143d82b0fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:26.093041 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641fc857-e018-4b1e-9d40-5143d82b0fbb admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:26.093723 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641fc857-e018-4b1e-9d40-5143d82b0fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:26.093723 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641fc857-e018-4b1e-9d40-5143d82b0fbb admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:26.094272 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641fc857-e018-4b1e-9d40-5143d82b0fbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:26.095839 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641fc857-e018-4b1e-9d40-5143d82b0fbb admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:26.107238 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1352/2694] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:10:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:10:26.111665 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508b9ea8-1f74-4862-bc89-c2b71c1c7736 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:26.122354 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508b9ea8-1f74-4862-bc89-c2b71c1c7736 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:26.127977 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ff462d-fe9d-4cb6-9508-02bdab3f409f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:26.128601 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff462d-fe9d-4cb6-9508-02bdab3f409f admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:26.128882 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff462d-fe9d-4cb6-9508-02bdab3f409f admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:26.129183 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff462d-fe9d-4cb6-9508-02bdab3f409f admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:26.129814 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ff462d-fe9d-4cb6-9508-02bdab3f409f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:26.131442 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ff462d-fe9d-4cb6-9508-02bdab3f409f admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:26.142553 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1343/2695] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:10:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:10:26.146738 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641fc857-e018-4b1e-9d40-5143d82b0fbb admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:26.156912 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641fc857-e018-4b1e-9d40-5143d82b0fbb admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:26.163040 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af09afe-62c0-4b71-a43a-e04ad1aea40c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:26.163726 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af09afe-62c0-4b71-a43a-e04ad1aea40c admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:26.163978 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af09afe-62c0-4b71-a43a-e04ad1aea40c admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:26.164236 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af09afe-62c0-4b71-a43a-e04ad1aea40c admin admin] PATH_INFO: `/v3/projects/e63fad283ac84c179bbe16f2b841b40b/users/20999e9cda984402b3ae5587dd83b4e9/roles/8daabcb6b7394e39b06a3453e33e32db` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:26.180348 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af09afe-62c0-4b71-a43a-e04ad1aea40c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e63fad283ac84c179bbe16f2b841b40b, user_id=20999e9cda984402b3ae5587dd83b4e9, role_id=8daabcb6b7394e39b06a3453e33e32db)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:26.183144 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af09afe-62c0-4b71-a43a-e04ad1aea40c admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:26.196463 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1353/2696] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:10:26 2022] PUT /identity/v3/projects/e63fad283ac84c179bbe16f2b841b40b/users/20999e9cda984402b3ae5587dd83b4e9/roles/8daabcb6b7394e39b06a3453e33e32db => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:10:26.207016 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1fe904-6ca2-47a4-bfba-9c062d3fab76 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:26.207323 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1fe904-6ca2-47a4-bfba-9c062d3fab76 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:26.207597 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1fe904-6ca2-47a4-bfba-9c062d3fab76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:26.235997 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-ca1fe904-6ca2-47a4-bfba-9c062d3fab76 None None] MFA Rules not processed for user `20999e9cda984402b3ae5587dd83b4e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:10:26.237263 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-ca1fe904-6ca2-47a4-bfba-9c062d3fab76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:26.305428 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1344/2697] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:10:26 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:10:26.310655 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af09afe-62c0-4b71-a43a-e04ad1aea40c admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:26.373657 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:10:26.387684 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af09afe-62c0-4b71-a43a-e04ad1aea40c admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:26.395527 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358213d7-0eb6-474e-a639-d12ef3656488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:26.396410 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358213d7-0eb6-474e-a639-d12ef3656488 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:26.396709 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358213d7-0eb6-474e-a639-d12ef3656488 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:26.397054 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358213d7-0eb6-474e-a639-d12ef3656488 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:26.398056 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358213d7-0eb6-474e-a639-d12ef3656488 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:26.400606 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358213d7-0eb6-474e-a639-d12ef3656488 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:26.430551 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1354/2698] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 10 10:10:26 2022] POST /identity/v3/projects => generated 391 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:10:26.435103 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1fe904-6ca2-47a4-bfba-9c062d3fab76 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:26.446802 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1fe904-6ca2-47a4-bfba-9c062d3fab76 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:26.452086 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:10:26.506361 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d3183b-ee90-42b2-9d50-646c5fbcf356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:26.506973 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d3183b-ee90-42b2-9d50-646c5fbcf356 admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:26.507253 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d3183b-ee90-42b2-9d50-646c5fbcf356 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:26.507527 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d3183b-ee90-42b2-9d50-646c5fbcf356 admin admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:26.508116 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d3183b-ee90-42b2-9d50-646c5fbcf356 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:26.510064 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d3183b-ee90-42b2-9d50-646c5fbcf356 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:26.536231 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1345/2699] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 10 10:10:26 2022] POST /identity/v3/users => generated 302 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:10:26.538074 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358213d7-0eb6-474e-a639-d12ef3656488 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:26.548893 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358213d7-0eb6-474e-a639-d12ef3656488 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:26.553737 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31472ed-af14-4bfe-83b9-bf232bf5c804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:26.554333 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31472ed-af14-4bfe-83b9-bf232bf5c804 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:26.554611 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31472ed-af14-4bfe-83b9-bf232bf5c804 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:26.554880 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31472ed-af14-4bfe-83b9-bf232bf5c804 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:26.555594 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31472ed-af14-4bfe-83b9-bf232bf5c804 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:26.557240 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31472ed-af14-4bfe-83b9-bf232bf5c804 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:26.567739 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1355/2700] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:10:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:10:26.571933 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d3183b-ee90-42b2-9d50-646c5fbcf356 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:26.582140 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d3183b-ee90-42b2-9d50-646c5fbcf356 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:26.587439 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437b777e-c0b8-49a4-af81-e62ccce86e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:26.588084 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b777e-c0b8-49a4-af81-e62ccce86e52 admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:26.588409 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b777e-c0b8-49a4-af81-e62ccce86e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:26.588687 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b777e-c0b8-49a4-af81-e62ccce86e52 admin admin] PATH_INFO: `/v3/projects/f8c28d397b7148a5a2cbf1f6d071c7b0/users/0cf0963361e24399b49e1f29b7fce8e8/roles/eb04edc46b3742d7a0f0ead26f68bc22` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:26.604129 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437b777e-c0b8-49a4-af81-e62ccce86e52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8c28d397b7148a5a2cbf1f6d071c7b0, user_id=0cf0963361e24399b49e1f29b7fce8e8, role_id=eb04edc46b3742d7a0f0ead26f68bc22)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:26.606847 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437b777e-c0b8-49a4-af81-e62ccce86e52 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:26.621116 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1346/2701] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:10:26 2022] PUT /identity/v3/projects/f8c28d397b7148a5a2cbf1f6d071c7b0/users/0cf0963361e24399b49e1f29b7fce8e8/roles/eb04edc46b3742d7a0f0ead26f68bc22 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:10:26.625034 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31472ed-af14-4bfe-83b9-bf232bf5c804 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:26.635057 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31472ed-af14-4bfe-83b9-bf232bf5c804 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:26.713440 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6ca677-2a51-4ba1-9328-658c6766f612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:26.714070 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6ca677-2a51-4ba1-9328-658c6766f612 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:26.714345 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6ca677-2a51-4ba1-9328-658c6766f612 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:26.714647 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6ca677-2a51-4ba1-9328-658c6766f612 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:26.715705 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6ca677-2a51-4ba1-9328-658c6766f612 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:26.717325 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6ca677-2a51-4ba1-9328-658c6766f612 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:26.728866 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1356/2702] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:10:26 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 10:10:26.733093 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437b777e-c0b8-49a4-af81-e62ccce86e52 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:26.745174 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437b777e-c0b8-49a4-af81-e62ccce86e52 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:26.750194 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed6e4f2-8a74-418e-8bd0-7df71020dbe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:26.751149 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed6e4f2-8a74-418e-8bd0-7df71020dbe2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:26.751952 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed6e4f2-8a74-418e-8bd0-7df71020dbe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:26.751952 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed6e4f2-8a74-418e-8bd0-7df71020dbe2 admin admin] PATH_INFO: `/v3/projects/f8c28d397b7148a5a2cbf1f6d071c7b0/users/0cf0963361e24399b49e1f29b7fce8e8/roles/eb04edc46b3742d7a0f0ead26f68bc22` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:26.755620 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed6e4f2-8a74-418e-8bd0-7df71020dbe2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8c28d397b7148a5a2cbf1f6d071c7b0, user_id=0cf0963361e24399b49e1f29b7fce8e8, role_id=eb04edc46b3742d7a0f0ead26f68bc22)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:26.758623 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed6e4f2-8a74-418e-8bd0-7df71020dbe2 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:26.770106 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1347/2703] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:10:26 2022] PUT /identity/v3/projects/f8c28d397b7148a5a2cbf1f6d071c7b0/users/0cf0963361e24399b49e1f29b7fce8e8/roles/eb04edc46b3742d7a0f0ead26f68bc22 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:10:26.779294 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6ca677-2a51-4ba1-9328-658c6766f612 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:26.779294 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-7f6ca677-2a51-4ba1-9328-658c6766f612 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:26.781259 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89f84e1-dfb2-46ff-9449-cf9d75ef4af9 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:26.781534 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89f84e1-dfb2-46ff-9449-cf9d75ef4af9 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:26.781808 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89f84e1-dfb2-46ff-9449-cf9d75ef4af9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:26.790983 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6ca677-2a51-4ba1-9328-658c6766f612 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:26.809631 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-a89f84e1-dfb2-46ff-9449-cf9d75ef4af9 None None] MFA Rules not processed for user `0cf0963361e24399b49e1f29b7fce8e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:10:26.810773 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-a89f84e1-dfb2-46ff-9449-cf9d75ef4af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:26.848758 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978d1175-1bca-4b41-a039-bbbe9a1e6a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:26.849440 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978d1175-1bca-4b41-a039-bbbe9a1e6a2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:26.849727 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978d1175-1bca-4b41-a039-bbbe9a1e6a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:26.850002 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978d1175-1bca-4b41-a039-bbbe9a1e6a2c admin admin] PATH_INFO: `/v3/users/af618bda6918401fa18f9c08c3a5d74c` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:26.851133 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978d1175-1bca-4b41-a039-bbbe9a1e6a2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=af618bda6918401fa18f9c08c3a5d74c)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:26.853082 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978d1175-1bca-4b41-a039-bbbe9a1e6a2c admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:26.881916 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1348/2704] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:10:26 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 10:10:26.893765 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89f84e1-dfb2-46ff-9449-cf9d75ef4af9 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:26.895136 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-a89f84e1-dfb2-46ff-9449-cf9d75ef4af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:26.903272 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-978d1175-1bca-4b41-a039-bbbe9a1e6a2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af618bda6918401fa18f9c08c3a5d74c'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:26.911914 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-978d1175-1bca-4b41-a039-bbbe9a1e6a2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af618bda6918401fa18f9c08c3a5d74c'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:26.912784 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-978d1175-1bca-4b41-a039-bbbe9a1e6a2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af618bda6918401fa18f9c08c3a5d74c'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:26.913440 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-978d1175-1bca-4b41-a039-bbbe9a1e6a2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af618bda6918401fa18f9c08c3a5d74c'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:26.924434 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-978d1175-1bca-4b41-a039-bbbe9a1e6a2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af618bda6918401fa18f9c08c3a5d74c'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:26.926356 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:10:26.946192 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1357/2705] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 10 10:10:26 2022] DELETE /identity/v3/users/af618bda6918401fa18f9c08c3a5d74c => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:10:26.950802 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d252842c-c444-40f5-b494-1963a70e1c08 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:26.951090 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d252842c-c444-40f5-b494-1963a70e1c08 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:26.951389 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d252842c-c444-40f5-b494-1963a70e1c08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:26.951504 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:10:26.957141 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89f84e1-dfb2-46ff-9449-cf9d75ef4af9 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:26.971333 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-d252842c-c444-40f5-b494-1963a70e1c08 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:10:26.972578 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-d252842c-c444-40f5-b494-1963a70e1c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:27.007644 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579ebe65-e0cf-4efa-920b-c11f313d88cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf8e725cbe0403d943b136235eac057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:27.008260 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579ebe65-e0cf-4efa-920b-c11f313d88cb service cinder] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:27.008539 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579ebe65-e0cf-4efa-920b-c11f313d88cb service cinder] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:27.008929 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579ebe65-e0cf-4efa-920b-c11f313d88cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:27.010880 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-579ebe65-e0cf-4efa-920b-c11f313d88cb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:27.033199 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1358/2706] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:10:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 10:10:27.043212 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d252842c-c444-40f5-b494-1963a70e1c08 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:27.044833 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-d252842c-c444-40f5-b494-1963a70e1c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:27.075634 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579ebe65-e0cf-4efa-920b-c11f313d88cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:27.076998 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579ebe65-e0cf-4efa-920b-c11f313d88cb service cinder] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:27.086625 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1349/2707] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:10:26 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 10:10:27.103831 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d252842c-c444-40f5-b494-1963a70e1c08 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:27.107734 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b4f118-de21-47f7-9549-2f49903302e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4294c170df354fe892831281acd4ea7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:27.108337 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b4f118-de21-47f7-9549-2f49903302e2 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:27.108615 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b4f118-de21-47f7-9549-2f49903302e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:27.108884 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b4f118-de21-47f7-9549-2f49903302e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:27.118095 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b4f118-de21-47f7-9549-2f49903302e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:27.125487 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b4f118-de21-47f7-9549-2f49903302e2 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:27.129472 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1359/2708] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:10:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:10:27.138000 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579ebe65-e0cf-4efa-920b-c11f313d88cb service cinder] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:27.139428 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-579ebe65-e0cf-4efa-920b-c11f313d88cb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:27.150254 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579ebe65-e0cf-4efa-920b-c11f313d88cb service cinder] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:27.154060 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9555325f-3451-4296-8d48-f75107fe9ca7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf8e725cbe0403d943b136235eac057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:27.154677 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9555325f-3451-4296-8d48-f75107fe9ca7 service cinder] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:27.154956 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9555325f-3451-4296-8d48-f75107fe9ca7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:27.155220 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9555325f-3451-4296-8d48-f75107fe9ca7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:27.156939 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-9555325f-3451-4296-8d48-f75107fe9ca7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:27.219715 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9555325f-3451-4296-8d48-f75107fe9ca7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:27.221365 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9555325f-3451-4296-8d48-f75107fe9ca7 service cinder] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:27.231990 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1350/2709] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:10:27 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:10:27.424241 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b4f118-de21-47f7-9549-2f49903302e2 service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:27.426303 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-c5b4f118-de21-47f7-9549-2f49903302e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:27.454824 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b4f118-de21-47f7-9549-2f49903302e2 service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:27.462519 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca74018-90ab-4c86-a9bb-764138ac0bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:27.463180 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca74018-90ab-4c86-a9bb-764138ac0bdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:27.463509 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca74018-90ab-4c86-a9bb-764138ac0bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:27.463877 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca74018-90ab-4c86-a9bb-764138ac0bdc admin admin] PATH_INFO: `/v3/projects/655c2ba04cb94cc89a4aeb88e40faebf` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:27.464948 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca74018-90ab-4c86-a9bb-764138ac0bdc admin admin] RBAC: Authorizing `identity:delete_project(project_id=655c2ba04cb94cc89a4aeb88e40faebf)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:27.466906 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca74018-90ab-4c86-a9bb-764138ac0bdc admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:27.527171 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-7ca74018-90ab-4c86-a9bb-764138ac0bdc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '655c2ba04cb94cc89a4aeb88e40faebf', 'request_id': 'req-7ca74018-90ab-4c86-a9bb-764138ac0bdc'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:27.533205 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-7ca74018-90ab-4c86-a9bb-764138ac0bdc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '655c2ba04cb94cc89a4aeb88e40faebf', 'request_id': 'req-7ca74018-90ab-4c86-a9bb-764138ac0bdc'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:27.557191 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-7ca74018-90ab-4c86-a9bb-764138ac0bdc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '655c2ba04cb94cc89a4aeb88e40faebf', 'request_id': 'req-7ca74018-90ab-4c86-a9bb-764138ac0bdc'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:27.559248 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-7ca74018-90ab-4c86-a9bb-764138ac0bdc admin admin] The token cache is being invalidate because project 655c2ba04cb94cc89a4aeb88e40faebf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 10:10:27.559248 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-7ca74018-90ab-4c86-a9bb-764138ac0bdc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:27.559887 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-7ca74018-90ab-4c86-a9bb-764138ac0bdc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:27.561417 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1360/2710] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 10 10:10:27 2022] DELETE /identity/v3/projects/655c2ba04cb94cc89a4aeb88e40faebf => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:10:27.565313 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9555325f-3451-4296-8d48-f75107fe9ca7 service cinder] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:27.576635 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9555325f-3451-4296-8d48-f75107fe9ca7 service cinder] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:27.624004 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:10:27.633745 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a149c3-692a-45e2-9b8a-3d76fb30e559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:27.634365 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a149c3-692a-45e2-9b8a-3d76fb30e559 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:27.634641 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a149c3-692a-45e2-9b8a-3d76fb30e559 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:27.634910 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a149c3-692a-45e2-9b8a-3d76fb30e559 admin admin] PATH_INFO: `/v3/users/d09b080f652f42bcbfd7dbf0180e5ef1` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:27.636085 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a149c3-692a-45e2-9b8a-3d76fb30e559 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d09b080f652f42bcbfd7dbf0180e5ef1)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:27.638037 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a149c3-692a-45e2-9b8a-3d76fb30e559 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:27.687088 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-67a149c3-692a-45e2-9b8a-3d76fb30e559 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd09b080f652f42bcbfd7dbf0180e5ef1'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:27.694133 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-67a149c3-692a-45e2-9b8a-3d76fb30e559 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd09b080f652f42bcbfd7dbf0180e5ef1'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:27.702740 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-67a149c3-692a-45e2-9b8a-3d76fb30e559 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd09b080f652f42bcbfd7dbf0180e5ef1'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:27.703341 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-67a149c3-692a-45e2-9b8a-3d76fb30e559 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd09b080f652f42bcbfd7dbf0180e5ef1'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:27.703964 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-67a149c3-692a-45e2-9b8a-3d76fb30e559 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd09b080f652f42bcbfd7dbf0180e5ef1'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:27.722789 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1351/2711] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 10 10:10:27 2022] DELETE /identity/v3/users/d09b080f652f42bcbfd7dbf0180e5ef1 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 10:10:27.993832 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca74018-90ab-4c86-a9bb-764138ac0bdc admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:27.995505 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-7ca74018-90ab-4c86-a9bb-764138ac0bdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:28.009248 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca74018-90ab-4c86-a9bb-764138ac0bdc admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:28.014853 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:10:28.077030 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4240891d-20ef-45f1-a127-3ddb5e8d4851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:28.077976 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4240891d-20ef-45f1-a127-3ddb5e8d4851 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:28.078393 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4240891d-20ef-45f1-a127-3ddb5e8d4851 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:28.078755 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4240891d-20ef-45f1-a127-3ddb5e8d4851 admin admin] PATH_INFO: `/v3/projects/a15c147fe4e74f69adc95940d33b2bcb` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:28.079990 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4240891d-20ef-45f1-a127-3ddb5e8d4851 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a15c147fe4e74f69adc95940d33b2bcb)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:28.081962 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4240891d-20ef-45f1-a127-3ddb5e8d4851 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:28.135159 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-4240891d-20ef-45f1-a127-3ddb5e8d4851 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a15c147fe4e74f69adc95940d33b2bcb', 'request_id': 'req-4240891d-20ef-45f1-a127-3ddb5e8d4851'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:28.140574 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-4240891d-20ef-45f1-a127-3ddb5e8d4851 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a15c147fe4e74f69adc95940d33b2bcb', 'request_id': 'req-4240891d-20ef-45f1-a127-3ddb5e8d4851'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:28.149096 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-4240891d-20ef-45f1-a127-3ddb5e8d4851 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a15c147fe4e74f69adc95940d33b2bcb', 'request_id': 'req-4240891d-20ef-45f1-a127-3ddb5e8d4851'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:28.164200 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-4240891d-20ef-45f1-a127-3ddb5e8d4851 admin admin] The token cache is being invalidate because project a15c147fe4e74f69adc95940d33b2bcb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 10:10:28.164598 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-4240891d-20ef-45f1-a127-3ddb5e8d4851 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:28.165617 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-4240891d-20ef-45f1-a127-3ddb5e8d4851 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:28.167987 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1361/2712] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 10 10:10:27 2022] DELETE /identity/v3/projects/a15c147fe4e74f69adc95940d33b2bcb => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:10:28.174466 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a149c3-692a-45e2-9b8a-3d76fb30e559 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:28.176827 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-67a149c3-692a-45e2-9b8a-3d76fb30e559 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:28.192598 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a149c3-692a-45e2-9b8a-3d76fb30e559 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:28.251496 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318f301d-77cc-4176-a752-f2c695d5bab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:28.252124 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318f301d-77cc-4176-a752-f2c695d5bab7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:28.252395 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318f301d-77cc-4176-a752-f2c695d5bab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:28.252665 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318f301d-77cc-4176-a752-f2c695d5bab7 admin admin] PATH_INFO: `/v3/users/a1ee4b757c614b0ab6320c5e0347499e` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:28.253834 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318f301d-77cc-4176-a752-f2c695d5bab7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1ee4b757c614b0ab6320c5e0347499e)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:28.255762 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318f301d-77cc-4176-a752-f2c695d5bab7 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:28.304719 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-318f301d-77cc-4176-a752-f2c695d5bab7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1ee4b757c614b0ab6320c5e0347499e'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:28.311439 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-318f301d-77cc-4176-a752-f2c695d5bab7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1ee4b757c614b0ab6320c5e0347499e'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:28.320524 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-318f301d-77cc-4176-a752-f2c695d5bab7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1ee4b757c614b0ab6320c5e0347499e'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:28.321262 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-318f301d-77cc-4176-a752-f2c695d5bab7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1ee4b757c614b0ab6320c5e0347499e'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:28.322045 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-318f301d-77cc-4176-a752-f2c695d5bab7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1ee4b757c614b0ab6320c5e0347499e'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:28.329885 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:10:28.342214 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1352/2713] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 10 10:10:28 2022] DELETE /identity/v3/users/a1ee4b757c614b0ab6320c5e0347499e => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:10:28.622165 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4240891d-20ef-45f1-a127-3ddb5e8d4851 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:28.623668 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-4240891d-20ef-45f1-a127-3ddb5e8d4851 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:28.638693 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4240891d-20ef-45f1-a127-3ddb5e8d4851 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:28.701875 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd60fcf-0ef9-417a-bae7-afd3a3d31f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:28.702527 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd60fcf-0ef9-417a-bae7-afd3a3d31f47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:28.702811 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd60fcf-0ef9-417a-bae7-afd3a3d31f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:28.703088 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd60fcf-0ef9-417a-bae7-afd3a3d31f47 admin admin] PATH_INFO: `/v3/projects/7b2b9e4817204fe2b437f52078f5c607` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:28.704222 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd60fcf-0ef9-417a-bae7-afd3a3d31f47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b2b9e4817204fe2b437f52078f5c607)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:28.711760 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd60fcf-0ef9-417a-bae7-afd3a3d31f47 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:28.751930 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:10:28.759626 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-7cd60fcf-0ef9-417a-bae7-afd3a3d31f47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b2b9e4817204fe2b437f52078f5c607', 'request_id': 'req-7cd60fcf-0ef9-417a-bae7-afd3a3d31f47'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:28.765840 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-7cd60fcf-0ef9-417a-bae7-afd3a3d31f47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b2b9e4817204fe2b437f52078f5c607', 'request_id': 'req-7cd60fcf-0ef9-417a-bae7-afd3a3d31f47'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:28.773196 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-7cd60fcf-0ef9-417a-bae7-afd3a3d31f47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b2b9e4817204fe2b437f52078f5c607', 'request_id': 'req-7cd60fcf-0ef9-417a-bae7-afd3a3d31f47'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:28.784732 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-7cd60fcf-0ef9-417a-bae7-afd3a3d31f47 admin admin] The token cache is being invalidate because project 7b2b9e4817204fe2b437f52078f5c607 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 10:10:28.785025 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-7cd60fcf-0ef9-417a-bae7-afd3a3d31f47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:28.785716 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-7cd60fcf-0ef9-417a-bae7-afd3a3d31f47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:28.787348 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1362/2714] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 10 10:10:28 2022] DELETE /identity/v3/projects/7b2b9e4817204fe2b437f52078f5c607 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:10:28.793454 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2503f472-e6dc-418e-9b94-ddfd7f20484b None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:28.793744 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2503f472-e6dc-418e-9b94-ddfd7f20484b None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:28.794021 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2503f472-e6dc-418e-9b94-ddfd7f20484b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:28.815636 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-2503f472-e6dc-418e-9b94-ddfd7f20484b None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:10:28.816861 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-2503f472-e6dc-418e-9b94-ddfd7f20484b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:28.878722 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1353/2715] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:10:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:10:28.886952 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf63cba7-6f2b-41b9-8305-38599022f639 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:28.887288 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf63cba7-6f2b-41b9-8305-38599022f639 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:28.887612 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf63cba7-6f2b-41b9-8305-38599022f639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:28.908312 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-cf63cba7-6f2b-41b9-8305-38599022f639 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:10:28.909563 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-cf63cba7-6f2b-41b9-8305-38599022f639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:28.918638 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1363/2716] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:10:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 10:10:28.923347 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2503f472-e6dc-418e-9b94-ddfd7f20484b None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:28.935067 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2503f472-e6dc-418e-9b94-ddfd7f20484b None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:28.940772 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f32a84-91d9-4f65-97a5-2283f09213cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:28.941437 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f32a84-91d9-4f65-97a5-2283f09213cb admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:28.942018 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f32a84-91d9-4f65-97a5-2283f09213cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:28.942018 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f32a84-91d9-4f65-97a5-2283f09213cb admin admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:28.942606 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f32a84-91d9-4f65-97a5-2283f09213cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:10:28.942913 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f32a84-91d9-4f65-97a5-2283f09213cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:28.945222 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f32a84-91d9-4f65-97a5-2283f09213cb admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:28.958413 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1354/2717] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 10 10:10:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:10:28.962853 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf63cba7-6f2b-41b9-8305-38599022f639 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:28.972442 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf63cba7-6f2b-41b9-8305-38599022f639 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:28.977572 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788c3711-daa9-4764-87c3-3281bec872ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:28.978165 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788c3711-daa9-4764-87c3-3281bec872ab admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:28.978446 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788c3711-daa9-4764-87c3-3281bec872ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:28.979145 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788c3711-daa9-4764-87c3-3281bec872ab admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:28.979818 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788c3711-daa9-4764-87c3-3281bec872ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:28.981718 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788c3711-daa9-4764-87c3-3281bec872ab admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:29.010838 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1364/2718] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 10 10:10:28 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:10:29.015189 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f32a84-91d9-4f65-97a5-2283f09213cb admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:29.025642 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f32a84-91d9-4f65-97a5-2283f09213cb admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:29.085775 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78279013-2775-4cac-abc8-01f33559f20b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:29.086389 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78279013-2775-4cac-abc8-01f33559f20b admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:29.086668 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78279013-2775-4cac-abc8-01f33559f20b admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:29.086939 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78279013-2775-4cac-abc8-01f33559f20b admin admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:29.087576 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78279013-2775-4cac-abc8-01f33559f20b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:29.089570 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78279013-2775-4cac-abc8-01f33559f20b admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:29.111874 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1355/2719] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 10 10:10:29 2022] POST /identity/v3/users => generated 286 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:10:29.115804 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788c3711-daa9-4764-87c3-3281bec872ab admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:29.127516 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788c3711-daa9-4764-87c3-3281bec872ab admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:29.132980 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71f967c-2a8d-4c8b-91ad-e64a445cd28d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:29.133689 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71f967c-2a8d-4c8b-91ad-e64a445cd28d admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:29.134055 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71f967c-2a8d-4c8b-91ad-e64a445cd28d admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:29.134406 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71f967c-2a8d-4c8b-91ad-e64a445cd28d admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:29.135138 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71f967c-2a8d-4c8b-91ad-e64a445cd28d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:29.136768 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71f967c-2a8d-4c8b-91ad-e64a445cd28d admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:29.150210 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1365/2720] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:10:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:10:29.151445 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78279013-2775-4cac-abc8-01f33559f20b admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:29.164822 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78279013-2775-4cac-abc8-01f33559f20b admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:29.170588 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21226cca-2fe5-4f06-bd41-322c2058cc27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:29.171458 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21226cca-2fe5-4f06-bd41-322c2058cc27 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:29.171458 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21226cca-2fe5-4f06-bd41-322c2058cc27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:29.171734 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21226cca-2fe5-4f06-bd41-322c2058cc27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:29.172388 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21226cca-2fe5-4f06-bd41-322c2058cc27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:29.174465 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21226cca-2fe5-4f06-bd41-322c2058cc27 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:29.185521 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1356/2721] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:10:29 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:10:29.189781 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71f967c-2a8d-4c8b-91ad-e64a445cd28d admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:29.199861 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71f967c-2a8d-4c8b-91ad-e64a445cd28d admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:29.204510 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55af3f75-ad82-4280-94f3-8879d9e65ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:29.205193 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55af3f75-ad82-4280-94f3-8879d9e65ce7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:29.205469 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55af3f75-ad82-4280-94f3-8879d9e65ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:29.205750 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55af3f75-ad82-4280-94f3-8879d9e65ce7 admin admin] PATH_INFO: `/v3/projects/caadb70081364c8e94f7635ede021b69/users/a2d57b0654c14f4496549e8f1b873c06/roles/8daabcb6b7394e39b06a3453e33e32db` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:29.220791 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55af3f75-ad82-4280-94f3-8879d9e65ce7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=caadb70081364c8e94f7635ede021b69, user_id=a2d57b0654c14f4496549e8f1b873c06, role_id=8daabcb6b7394e39b06a3453e33e32db)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:29.223477 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55af3f75-ad82-4280-94f3-8879d9e65ce7 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:29.238668 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1366/2722] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:10:29 2022] PUT /identity/v3/projects/caadb70081364c8e94f7635ede021b69/users/a2d57b0654c14f4496549e8f1b873c06/roles/8daabcb6b7394e39b06a3453e33e32db => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:10:29.250308 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5620031a-a71e-452d-897c-bbd849bb40ff None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:29.250597 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5620031a-a71e-452d-897c-bbd849bb40ff None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:29.250906 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5620031a-a71e-452d-897c-bbd849bb40ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:29.278294 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-5620031a-a71e-452d-897c-bbd849bb40ff None None] MFA Rules not processed for user `a2d57b0654c14f4496549e8f1b873c06`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:10:29.279799 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-5620031a-a71e-452d-897c-bbd849bb40ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:29.325486 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:10:29.349647 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1357/2723] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:10:29 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:10:29.363633 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55af3f75-ad82-4280-94f3-8879d9e65ce7 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:29.365419 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-55af3f75-ad82-4280-94f3-8879d9e65ce7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:29.434461 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55af3f75-ad82-4280-94f3-8879d9e65ce7 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:29.438830 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7e340e-0a82-4a60-9ee4-69ed7aa09c2a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9e7f1ec6ad64b978f8817a5d2a73757', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:29.439456 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7e340e-0a82-4a60-9ee4-69ed7aa09c2a service glance] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:29.439737 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7e340e-0a82-4a60-9ee4-69ed7aa09c2a service glance] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:29.440070 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7e340e-0a82-4a60-9ee4-69ed7aa09c2a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:29.449204 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7e340e-0a82-4a60-9ee4-69ed7aa09c2a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:29.450670 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7e340e-0a82-4a60-9ee4-69ed7aa09c2a service glance] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:29.459396 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1367/2724] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:10:29 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:10:30.612549 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5620031a-a71e-452d-897c-bbd849bb40ff None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:30.614242 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-5620031a-a71e-452d-897c-bbd849bb40ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:30.689086 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5620031a-a71e-452d-897c-bbd849bb40ff None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:30.694216 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f346ad87-98de-451f-a0fc-501afa433a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:30.694853 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f346ad87-98de-451f-a0fc-501afa433a70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:30.695135 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f346ad87-98de-451f-a0fc-501afa433a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:30.695411 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f346ad87-98de-451f-a0fc-501afa433a70 admin admin] PATH_INFO: `/v3/users/20999e9cda984402b3ae5587dd83b4e9` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:30.696590 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f346ad87-98de-451f-a0fc-501afa433a70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20999e9cda984402b3ae5587dd83b4e9)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:30.698581 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f346ad87-98de-451f-a0fc-501afa433a70 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:30.749802 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-f346ad87-98de-451f-a0fc-501afa433a70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20999e9cda984402b3ae5587dd83b4e9'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:30.757628 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-f346ad87-98de-451f-a0fc-501afa433a70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20999e9cda984402b3ae5587dd83b4e9'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:30.766676 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-f346ad87-98de-451f-a0fc-501afa433a70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20999e9cda984402b3ae5587dd83b4e9'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:30.767284 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-f346ad87-98de-451f-a0fc-501afa433a70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20999e9cda984402b3ae5587dd83b4e9'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:30.767918 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-f346ad87-98de-451f-a0fc-501afa433a70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20999e9cda984402b3ae5587dd83b4e9'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:30.784556 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1358/2725] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 10 10:10:30 2022] DELETE /identity/v3/users/20999e9cda984402b3ae5587dd83b4e9 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:10:30.789058 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da15cea5-248f-46c6-9ab6-4c07d8faed55 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:30.789604 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da15cea5-248f-46c6-9ab6-4c07d8faed55 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:30.789703 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da15cea5-248f-46c6-9ab6-4c07d8faed55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:30.811038 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-da15cea5-248f-46c6-9ab6-4c07d8faed55 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:10:30.812261 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-da15cea5-248f-46c6-9ab6-4c07d8faed55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:30.875355 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1368/2726] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:10:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:10:30.886060 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f346ad87-98de-451f-a0fc-501afa433a70 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:30.887520 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-f346ad87-98de-451f-a0fc-501afa433a70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:30.951692 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f346ad87-98de-451f-a0fc-501afa433a70 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:30.956686 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92d7212-9401-40d6-8f13-ef0cdce86200 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4294c170df354fe892831281acd4ea7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:30.957248 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92d7212-9401-40d6-8f13-ef0cdce86200 service neutron] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:30.957534 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92d7212-9401-40d6-8f13-ef0cdce86200 service neutron] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:30.957804 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92d7212-9401-40d6-8f13-ef0cdce86200 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:30.968415 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92d7212-9401-40d6-8f13-ef0cdce86200 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:30.970010 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92d7212-9401-40d6-8f13-ef0cdce86200 service neutron] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:30.979851 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1359/2727] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:10:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:10:31.274361 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da15cea5-248f-46c6-9ab6-4c07d8faed55 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:31.276532 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-da15cea5-248f-46c6-9ab6-4c07d8faed55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:31.289676 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da15cea5-248f-46c6-9ab6-4c07d8faed55 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:31.295419 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf559934-5ee0-49f1-8168-5355deb5e110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:31.296426 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf559934-5ee0-49f1-8168-5355deb5e110 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:31.296737 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf559934-5ee0-49f1-8168-5355deb5e110 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:31.297007 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf559934-5ee0-49f1-8168-5355deb5e110 admin admin] PATH_INFO: `/v3/projects/e63fad283ac84c179bbe16f2b841b40b` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:31.298834 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf559934-5ee0-49f1-8168-5355deb5e110 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e63fad283ac84c179bbe16f2b841b40b)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:31.300677 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf559934-5ee0-49f1-8168-5355deb5e110 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:31.303117 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:10:31.352919 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-bf559934-5ee0-49f1-8168-5355deb5e110 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e63fad283ac84c179bbe16f2b841b40b', 'request_id': 'req-bf559934-5ee0-49f1-8168-5355deb5e110'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:31.358690 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-bf559934-5ee0-49f1-8168-5355deb5e110 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e63fad283ac84c179bbe16f2b841b40b', 'request_id': 'req-bf559934-5ee0-49f1-8168-5355deb5e110'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:31.366953 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-bf559934-5ee0-49f1-8168-5355deb5e110 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e63fad283ac84c179bbe16f2b841b40b', 'request_id': 'req-bf559934-5ee0-49f1-8168-5355deb5e110'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:31.378863 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-bf559934-5ee0-49f1-8168-5355deb5e110 admin admin] The token cache is being invalidate because project e63fad283ac84c179bbe16f2b841b40b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 10:10:31.379171 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-bf559934-5ee0-49f1-8168-5355deb5e110 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:31.379882 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-bf559934-5ee0-49f1-8168-5355deb5e110 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:31.381519 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1369/2728] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 10 10:10:31 2022] DELETE /identity/v3/projects/e63fad283ac84c179bbe16f2b841b40b => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:10:31.385818 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92d7212-9401-40d6-8f13-ef0cdce86200 service neutron] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:31.395900 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92d7212-9401-40d6-8f13-ef0cdce86200 service neutron] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:31.399644 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:10:31.460405 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c5aa37-e06e-4d4b-9953-8acf0fc05c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:31.461231 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c5aa37-e06e-4d4b-9953-8acf0fc05c1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:31.461601 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c5aa37-e06e-4d4b-9953-8acf0fc05c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:31.461909 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c5aa37-e06e-4d4b-9953-8acf0fc05c1c admin admin] PATH_INFO: `/v3/users/0cf0963361e24399b49e1f29b7fce8e8` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:31.463642 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c5aa37-e06e-4d4b-9953-8acf0fc05c1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cf0963361e24399b49e1f29b7fce8e8)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:31.466463 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c5aa37-e06e-4d4b-9953-8acf0fc05c1c admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:31.516693 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-b9c5aa37-e06e-4d4b-9953-8acf0fc05c1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cf0963361e24399b49e1f29b7fce8e8'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:31.523559 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-b9c5aa37-e06e-4d4b-9953-8acf0fc05c1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cf0963361e24399b49e1f29b7fce8e8'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:31.532466 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-b9c5aa37-e06e-4d4b-9953-8acf0fc05c1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cf0963361e24399b49e1f29b7fce8e8'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:31.533205 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-b9c5aa37-e06e-4d4b-9953-8acf0fc05c1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cf0963361e24399b49e1f29b7fce8e8'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:31.533945 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-b9c5aa37-e06e-4d4b-9953-8acf0fc05c1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cf0963361e24399b49e1f29b7fce8e8'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:31.551452 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1360/2729] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 10 10:10:31 2022] DELETE /identity/v3/users/0cf0963361e24399b49e1f29b7fce8e8 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:10:31.839363 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf559934-5ee0-49f1-8168-5355deb5e110 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:31.840973 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-bf559934-5ee0-49f1-8168-5355deb5e110 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:31.855166 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf559934-5ee0-49f1-8168-5355deb5e110 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:31.919526 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8e30b3-9446-4af8-9f6d-f376febeeec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:31.920141 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8e30b3-9446-4af8-9f6d-f376febeeec2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:31.920421 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8e30b3-9446-4af8-9f6d-f376febeeec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:31.920696 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8e30b3-9446-4af8-9f6d-f376febeeec2 admin admin] PATH_INFO: `/v3/projects/f8c28d397b7148a5a2cbf1f6d071c7b0` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:31.921947 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8e30b3-9446-4af8-9f6d-f376febeeec2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8c28d397b7148a5a2cbf1f6d071c7b0)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:31.924277 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8e30b3-9446-4af8-9f6d-f376febeeec2 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:31.973258 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-0a8e30b3-9446-4af8-9f6d-f376febeeec2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8c28d397b7148a5a2cbf1f6d071c7b0', 'request_id': 'req-0a8e30b3-9446-4af8-9f6d-f376febeeec2'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:31.978634 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-0a8e30b3-9446-4af8-9f6d-f376febeeec2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8c28d397b7148a5a2cbf1f6d071c7b0', 'request_id': 'req-0a8e30b3-9446-4af8-9f6d-f376febeeec2'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:31.987631 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-0a8e30b3-9446-4af8-9f6d-f376febeeec2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8c28d397b7148a5a2cbf1f6d071c7b0', 'request_id': 'req-0a8e30b3-9446-4af8-9f6d-f376febeeec2'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:31.999152 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-0a8e30b3-9446-4af8-9f6d-f376febeeec2 admin admin] The token cache is being invalidate because project f8c28d397b7148a5a2cbf1f6d071c7b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 10:10:31.999549 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-0a8e30b3-9446-4af8-9f6d-f376febeeec2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:32.000279 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-0a8e30b3-9446-4af8-9f6d-f376febeeec2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:32.001875 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1370/2730] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 10 10:10:31 2022] DELETE /identity/v3/projects/f8c28d397b7148a5a2cbf1f6d071c7b0 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:10:32.006971 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc8a49b-117e-41e8-89eb-ef91d477bfbe None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:32.007438 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc8a49b-117e-41e8-89eb-ef91d477bfbe None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:32.007560 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc8a49b-117e-41e8-89eb-ef91d477bfbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:32.034557 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-4dc8a49b-117e-41e8-89eb-ef91d477bfbe None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:10:32.035801 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-4dc8a49b-117e-41e8-89eb-ef91d477bfbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:32.102457 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1361/2731] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:10:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:10:32.110941 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b666dc-a947-46c0-85eb-09647a5a4666 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:32.111307 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b666dc-a947-46c0-85eb-09647a5a4666 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:32.111584 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b666dc-a947-46c0-85eb-09647a5a4666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:32.131883 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-b2b666dc-a947-46c0-85eb-09647a5a4666 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:10:32.133113 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-b2b666dc-a947-46c0-85eb-09647a5a4666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:32.141621 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1371/2732] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:10:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 10:10:32.146012 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc8a49b-117e-41e8-89eb-ef91d477bfbe None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:32.156008 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc8a49b-117e-41e8-89eb-ef91d477bfbe None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:32.161296 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8417fe-1d6e-41ff-a3d0-f86f00ab871f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:32.161889 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8417fe-1d6e-41ff-a3d0-f86f00ab871f admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:32.162164 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8417fe-1d6e-41ff-a3d0-f86f00ab871f admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:32.162430 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8417fe-1d6e-41ff-a3d0-f86f00ab871f admin admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:32.163074 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8417fe-1d6e-41ff-a3d0-f86f00ab871f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:10:32.163403 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8417fe-1d6e-41ff-a3d0-f86f00ab871f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:32.165010 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8417fe-1d6e-41ff-a3d0-f86f00ab871f admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:32.178581 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1362/2733] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 10 10:10:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:10:32.183212 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b666dc-a947-46c0-85eb-09647a5a4666 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:32.193015 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b666dc-a947-46c0-85eb-09647a5a4666 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:32.197878 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1516c2-6824-4d17-a44a-f4c702edde48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:32.198480 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1516c2-6824-4d17-a44a-f4c702edde48 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:32.198776 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1516c2-6824-4d17-a44a-f4c702edde48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:32.199037 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1516c2-6824-4d17-a44a-f4c702edde48 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:32.199666 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1516c2-6824-4d17-a44a-f4c702edde48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:32.201580 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1516c2-6824-4d17-a44a-f4c702edde48 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:32.216092 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:10:32.231489 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1372/2734] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 10 10:10:32 2022] POST /identity/v3/projects => generated 377 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 10:10:32.237493 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8417fe-1d6e-41ff-a3d0-f86f00ab871f admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:32.247339 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8417fe-1d6e-41ff-a3d0-f86f00ab871f admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:32.256484 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:10:32.310167 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa01cd58-04ca-4be2-8e7d-775e56cf9461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:32.310773 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa01cd58-04ca-4be2-8e7d-775e56cf9461 admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:32.311052 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa01cd58-04ca-4be2-8e7d-775e56cf9461 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:32.311319 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa01cd58-04ca-4be2-8e7d-775e56cf9461 admin admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:32.311945 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa01cd58-04ca-4be2-8e7d-775e56cf9461 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:32.313996 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa01cd58-04ca-4be2-8e7d-775e56cf9461 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:32.337690 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1363/2735] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 10 10:10:32 2022] POST /identity/v3/users => generated 289 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 10:10:32.342269 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1516c2-6824-4d17-a44a-f4c702edde48 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:32.353801 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1516c2-6824-4d17-a44a-f4c702edde48 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:32.359821 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa886a7d-1164-4dcb-8a61-21699864c82e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:32.360443 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa886a7d-1164-4dcb-8a61-21699864c82e admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:32.360715 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa886a7d-1164-4dcb-8a61-21699864c82e admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:32.360977 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa886a7d-1164-4dcb-8a61-21699864c82e admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:32.361660 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa886a7d-1164-4dcb-8a61-21699864c82e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:32.363645 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa886a7d-1164-4dcb-8a61-21699864c82e admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:32.374108 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1373/2736] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:10:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:10:32.378409 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa01cd58-04ca-4be2-8e7d-775e56cf9461 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:32.388614 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa01cd58-04ca-4be2-8e7d-775e56cf9461 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:32.393614 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283b7ea1-be47-48e0-ac76-0fe08ab35f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:32.394202 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283b7ea1-be47-48e0-ac76-0fe08ab35f03 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:32.394480 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283b7ea1-be47-48e0-ac76-0fe08ab35f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:32.394747 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283b7ea1-be47-48e0-ac76-0fe08ab35f03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:32.395413 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283b7ea1-be47-48e0-ac76-0fe08ab35f03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:32.397016 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283b7ea1-be47-48e0-ac76-0fe08ab35f03 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:32.410700 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1364/2737] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:10:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:10:32.415098 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa886a7d-1164-4dcb-8a61-21699864c82e admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:32.427482 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa886a7d-1164-4dcb-8a61-21699864c82e admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:32.436241 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a640e12-8ed0-45a5-b04e-8968bd0e6b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:32.437276 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a640e12-8ed0-45a5-b04e-8968bd0e6b2e admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:32.437593 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a640e12-8ed0-45a5-b04e-8968bd0e6b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:32.437894 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a640e12-8ed0-45a5-b04e-8968bd0e6b2e admin admin] PATH_INFO: `/v3/projects/cc5dcd60e64443398495e8ea4957c3a8/users/d6d8851606c54383a6b0693cf2b32539/roles/8daabcb6b7394e39b06a3453e33e32db` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:32.454693 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a640e12-8ed0-45a5-b04e-8968bd0e6b2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc5dcd60e64443398495e8ea4957c3a8, user_id=d6d8851606c54383a6b0693cf2b32539, role_id=8daabcb6b7394e39b06a3453e33e32db)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:32.457427 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a640e12-8ed0-45a5-b04e-8968bd0e6b2e admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:32.472896 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1374/2738] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:10:32 2022] PUT /identity/v3/projects/cc5dcd60e64443398495e8ea4957c3a8/users/d6d8851606c54383a6b0693cf2b32539/roles/8daabcb6b7394e39b06a3453e33e32db => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:10:32.483508 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd52ab-f7b9-42c7-ab35-3102dd54d312 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:32.483687 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd52ab-f7b9-42c7-ab35-3102dd54d312 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:32.483987 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd52ab-f7b9-42c7-ab35-3102dd54d312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:32.513999 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-65cd52ab-f7b9-42c7-ab35-3102dd54d312 None None] MFA Rules not processed for user `d6d8851606c54383a6b0693cf2b32539`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:10:32.515247 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-65cd52ab-f7b9-42c7-ab35-3102dd54d312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:32.591016 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1365/2739] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:10:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:10:32.597113 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a640e12-8ed0-45a5-b04e-8968bd0e6b2e admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:32.660904 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a640e12-8ed0-45a5-b04e-8968bd0e6b2e admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:32.665777 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aece079b-bdb2-457a-b321-fef2dc87f56e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:32.666382 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aece079b-bdb2-457a-b321-fef2dc87f56e admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:32.666658 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aece079b-bdb2-457a-b321-fef2dc87f56e admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:32.666926 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aece079b-bdb2-457a-b321-fef2dc87f56e admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:32.667587 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aece079b-bdb2-457a-b321-fef2dc87f56e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:32.669992 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aece079b-bdb2-457a-b321-fef2dc87f56e admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:32.699073 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1375/2740] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 10 10:10:32 2022] POST /identity/v3/projects => generated 379 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:10:32.703518 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cd52ab-f7b9-42c7-ab35-3102dd54d312 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:32.714349 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cd52ab-f7b9-42c7-ab35-3102dd54d312 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:32.772908 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1c4410-525e-41e0-a6e8-b441a79083f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:32.773459 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1c4410-525e-41e0-a6e8-b441a79083f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:32.773739 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1c4410-525e-41e0-a6e8-b441a79083f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:32.774005 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1c4410-525e-41e0-a6e8-b441a79083f4 admin admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:32.774639 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1c4410-525e-41e0-a6e8-b441a79083f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:32.776586 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1c4410-525e-41e0-a6e8-b441a79083f4 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:32.801769 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1366/2741] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 10 10:10:32 2022] POST /identity/v3/users => generated 290 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 10:10:32.806155 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aece079b-bdb2-457a-b321-fef2dc87f56e admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:32.817052 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aece079b-bdb2-457a-b321-fef2dc87f56e admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:32.822284 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456f9d98-f1bb-46f8-b15b-92e2d375f781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:32.822884 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f9d98-f1bb-46f8-b15b-92e2d375f781 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:32.823162 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f9d98-f1bb-46f8-b15b-92e2d375f781 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:32.823433 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f9d98-f1bb-46f8-b15b-92e2d375f781 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:32.824084 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456f9d98-f1bb-46f8-b15b-92e2d375f781 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:32.825749 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456f9d98-f1bb-46f8-b15b-92e2d375f781 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:32.838366 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1376/2742] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:10:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:10:32.843809 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1c4410-525e-41e0-a6e8-b441a79083f4 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:32.858468 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1c4410-525e-41e0-a6e8-b441a79083f4 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:32.865026 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e0a981-60c4-420a-881a-05d5d0d4dccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:32.865656 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e0a981-60c4-420a-881a-05d5d0d4dccf admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:32.865947 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e0a981-60c4-420a-881a-05d5d0d4dccf admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:32.866212 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e0a981-60c4-420a-881a-05d5d0d4dccf admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:32.866861 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e0a981-60c4-420a-881a-05d5d0d4dccf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:32.868487 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e0a981-60c4-420a-881a-05d5d0d4dccf admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:32.874948 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:10:32.880497 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1367/2743] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:10:32 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:10:32.884982 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456f9d98-f1bb-46f8-b15b-92e2d375f781 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:32.895310 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456f9d98-f1bb-46f8-b15b-92e2d375f781 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:32.900120 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78900123-ff60-419d-8888-8fbebc07da5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:32.900767 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78900123-ff60-419d-8888-8fbebc07da5c admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:32.901146 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78900123-ff60-419d-8888-8fbebc07da5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:32.901342 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78900123-ff60-419d-8888-8fbebc07da5c admin admin] PATH_INFO: `/v3/projects/a7fe8e6fbf6640fbb04f17aba7987c4b/users/da39e7713bfb4d5f8c65617d477a4d1f/roles/8daabcb6b7394e39b06a3453e33e32db` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:32.916325 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78900123-ff60-419d-8888-8fbebc07da5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7fe8e6fbf6640fbb04f17aba7987c4b, user_id=da39e7713bfb4d5f8c65617d477a4d1f, role_id=8daabcb6b7394e39b06a3453e33e32db)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:32.919216 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78900123-ff60-419d-8888-8fbebc07da5c admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:32.935821 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1377/2744] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:10:32 2022] PUT /identity/v3/projects/a7fe8e6fbf6640fbb04f17aba7987c4b/users/da39e7713bfb4d5f8c65617d477a4d1f/roles/8daabcb6b7394e39b06a3453e33e32db => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:10:32.947174 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dabacc-5fbc-43ee-bf30-a35bfd25c32a None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:32.947470 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dabacc-5fbc-43ee-bf30-a35bfd25c32a None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:32.947745 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dabacc-5fbc-43ee-bf30-a35bfd25c32a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:32.977971 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-17dabacc-5fbc-43ee-bf30-a35bfd25c32a None None] MFA Rules not processed for user `da39e7713bfb4d5f8c65617d477a4d1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:10:32.979183 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-17dabacc-5fbc-43ee-bf30-a35bfd25c32a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:33.046543 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1368/2745] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:10:32 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:10:33.051494 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78900123-ff60-419d-8888-8fbebc07da5c admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:33.121196 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78900123-ff60-419d-8888-8fbebc07da5c admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:33.126121 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e70da92-491a-4a6e-ae1c-6d4731fb96cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:33.126721 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e70da92-491a-4a6e-ae1c-6d4731fb96cf admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:33.126996 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e70da92-491a-4a6e-ae1c-6d4731fb96cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:33.127259 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e70da92-491a-4a6e-ae1c-6d4731fb96cf admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:33.127895 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e70da92-491a-4a6e-ae1c-6d4731fb96cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:33.129809 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e70da92-491a-4a6e-ae1c-6d4731fb96cf admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:33.144070 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:10:33.159209 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1378/2746] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 10 10:10:33 2022] POST /identity/v3/projects => generated 379 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:10:33.163486 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dabacc-5fbc-43ee-bf30-a35bfd25c32a None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:33.175141 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dabacc-5fbc-43ee-bf30-a35bfd25c32a None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:33.238870 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93e1d96-9d07-4b1e-80ef-f440008b62b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:33.239500 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e1d96-9d07-4b1e-80ef-f440008b62b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:33.239788 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e1d96-9d07-4b1e-80ef-f440008b62b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:33.240057 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e1d96-9d07-4b1e-80ef-f440008b62b2 admin admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:33.240697 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93e1d96-9d07-4b1e-80ef-f440008b62b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:33.242714 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93e1d96-9d07-4b1e-80ef-f440008b62b2 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:33.265204 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1369/2747] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 10 10:10:33 2022] POST /identity/v3/users => generated 296 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 10:10:33.269510 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e70da92-491a-4a6e-ae1c-6d4731fb96cf admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:33.280581 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e70da92-491a-4a6e-ae1c-6d4731fb96cf admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:33.285596 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c296c04a-b28e-4da7-99fb-e59a19fe91ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:33.286193 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c296c04a-b28e-4da7-99fb-e59a19fe91ca admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:33.286474 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c296c04a-b28e-4da7-99fb-e59a19fe91ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:33.286748 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c296c04a-b28e-4da7-99fb-e59a19fe91ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:33.287420 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c296c04a-b28e-4da7-99fb-e59a19fe91ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:33.289020 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c296c04a-b28e-4da7-99fb-e59a19fe91ca admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:33.300235 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1379/2748] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:10:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:10:33.304496 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93e1d96-9d07-4b1e-80ef-f440008b62b2 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:33.319270 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93e1d96-9d07-4b1e-80ef-f440008b62b2 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:33.326890 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562df7a3-b698-4a81-9914-00842195e360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:33.327795 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562df7a3-b698-4a81-9914-00842195e360 admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:33.328117 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562df7a3-b698-4a81-9914-00842195e360 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:33.328393 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562df7a3-b698-4a81-9914-00842195e360 admin admin] PATH_INFO: `/v3/projects/442418f4fa8a4333b7aa6b0f22aa9bad/users/720394dda3c5499fb0c000ccdae87a7c/roles/eb04edc46b3742d7a0f0ead26f68bc22` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:33.342871 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562df7a3-b698-4a81-9914-00842195e360 admin admin] RBAC: Authorizing `identity:create_grant(project_id=442418f4fa8a4333b7aa6b0f22aa9bad, user_id=720394dda3c5499fb0c000ccdae87a7c, role_id=eb04edc46b3742d7a0f0ead26f68bc22)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:33.345604 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562df7a3-b698-4a81-9914-00842195e360 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:33.360731 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1370/2749] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:10:33 2022] PUT /identity/v3/projects/442418f4fa8a4333b7aa6b0f22aa9bad/users/720394dda3c5499fb0c000ccdae87a7c/roles/eb04edc46b3742d7a0f0ead26f68bc22 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:10:33.365274 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c296c04a-b28e-4da7-99fb-e59a19fe91ca admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:33.376457 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c296c04a-b28e-4da7-99fb-e59a19fe91ca admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:33.432861 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af0a189-f2c2-49cb-b5c1-ab95fe50cb1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:33.433499 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af0a189-f2c2-49cb-b5c1-ab95fe50cb1d admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:33.433802 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af0a189-f2c2-49cb-b5c1-ab95fe50cb1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:33.434048 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af0a189-f2c2-49cb-b5c1-ab95fe50cb1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:33.434717 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af0a189-f2c2-49cb-b5c1-ab95fe50cb1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:33.436321 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af0a189-f2c2-49cb-b5c1-ab95fe50cb1d admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:33.446381 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1380/2750] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:10:33 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:10:33.451056 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562df7a3-b698-4a81-9914-00842195e360 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:33.463201 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562df7a3-b698-4a81-9914-00842195e360 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:33.468636 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee5aec6-c632-4ac4-a50c-26d68f37508d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:33.469337 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee5aec6-c632-4ac4-a50c-26d68f37508d admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:33.469614 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee5aec6-c632-4ac4-a50c-26d68f37508d admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:33.469884 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee5aec6-c632-4ac4-a50c-26d68f37508d admin admin] PATH_INFO: `/v3/projects/442418f4fa8a4333b7aa6b0f22aa9bad/users/720394dda3c5499fb0c000ccdae87a7c/roles/eb04edc46b3742d7a0f0ead26f68bc22` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:33.472072 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee5aec6-c632-4ac4-a50c-26d68f37508d admin admin] RBAC: Authorizing `identity:create_grant(project_id=442418f4fa8a4333b7aa6b0f22aa9bad, user_id=720394dda3c5499fb0c000ccdae87a7c, role_id=eb04edc46b3742d7a0f0ead26f68bc22)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:33.474774 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee5aec6-c632-4ac4-a50c-26d68f37508d admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:33.486072 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1371/2751] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:10:33 2022] PUT /identity/v3/projects/442418f4fa8a4333b7aa6b0f22aa9bad/users/720394dda3c5499fb0c000ccdae87a7c/roles/eb04edc46b3742d7a0f0ead26f68bc22 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:10:33.496449 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1ec912-d43c-46bb-9463-1c566fbeacc9 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:33.496847 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1ec912-d43c-46bb-9463-1c566fbeacc9 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:33.497389 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1ec912-d43c-46bb-9463-1c566fbeacc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:33.528658 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-ec1ec912-d43c-46bb-9463-1c566fbeacc9 None None] MFA Rules not processed for user `720394dda3c5499fb0c000ccdae87a7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:10:33.530055 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-ec1ec912-d43c-46bb-9463-1c566fbeacc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:33.599437 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1381/2752] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:10:33 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:10:33.612953 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee5aec6-c632-4ac4-a50c-26d68f37508d admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:33.614991 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-1ee5aec6-c632-4ac4-a50c-26d68f37508d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:33.663181 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:10:33.677620 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee5aec6-c632-4ac4-a50c-26d68f37508d admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:33.682093 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4163e63c-54fd-4272-b76f-ac98c1050ca4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf8e725cbe0403d943b136235eac057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:33.682210 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4163e63c-54fd-4272-b76f-ac98c1050ca4 service cinder] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:33.682511 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4163e63c-54fd-4272-b76f-ac98c1050ca4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:33.682785 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4163e63c-54fd-4272-b76f-ac98c1050ca4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:33.692345 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4163e63c-54fd-4272-b76f-ac98c1050ca4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:33.693895 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4163e63c-54fd-4272-b76f-ac98c1050ca4 service cinder] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:33.704779 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1372/2753] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:10:33 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:10:33.748638 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1ec912-d43c-46bb-9463-1c566fbeacc9 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:33.750158 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-ec1ec912-d43c-46bb-9463-1c566fbeacc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:33.762314 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1ec912-d43c-46bb-9463-1c566fbeacc9 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:33.766310 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe0b122-ce41-4c19-970a-13e966c1bac5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf8e725cbe0403d943b136235eac057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:33.766891 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe0b122-ce41-4c19-970a-13e966c1bac5 service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:33.767151 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe0b122-ce41-4c19-970a-13e966c1bac5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:33.767403 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe0b122-ce41-4c19-970a-13e966c1bac5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:33.826556 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe0b122-ce41-4c19-970a-13e966c1bac5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:33.828014 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe0b122-ce41-4c19-970a-13e966c1bac5 service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:33.837522 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1382/2754] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:10:33 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:10:36.772824 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4163e63c-54fd-4272-b76f-ac98c1050ca4 service cinder] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:36.839235 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4163e63c-54fd-4272-b76f-ac98c1050ca4 service cinder] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:36.844602 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efc0810-2b24-402d-9dd5-5df82ae13386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:36.845279 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efc0810-2b24-402d-9dd5-5df82ae13386 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:36.845842 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efc0810-2b24-402d-9dd5-5df82ae13386 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:36.846111 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efc0810-2b24-402d-9dd5-5df82ae13386 admin admin] PATH_INFO: `/v3/users/d6d8851606c54383a6b0693cf2b32539` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:36.847523 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efc0810-2b24-402d-9dd5-5df82ae13386 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6d8851606c54383a6b0693cf2b32539)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:36.849489 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efc0810-2b24-402d-9dd5-5df82ae13386 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:36.902505 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-9efc0810-2b24-402d-9dd5-5df82ae13386 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6d8851606c54383a6b0693cf2b32539'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:36.910436 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-9efc0810-2b24-402d-9dd5-5df82ae13386 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6d8851606c54383a6b0693cf2b32539'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:36.919838 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-9efc0810-2b24-402d-9dd5-5df82ae13386 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6d8851606c54383a6b0693cf2b32539'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:36.920502 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-9efc0810-2b24-402d-9dd5-5df82ae13386 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6d8851606c54383a6b0693cf2b32539'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:36.921228 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-9efc0810-2b24-402d-9dd5-5df82ae13386 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6d8851606c54383a6b0693cf2b32539'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:36.939096 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1373/2755] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 10 10:10:36 2022] DELETE /identity/v3/users/d6d8851606c54383a6b0693cf2b32539 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:10:36.943753 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532bc864-4837-4df3-9d34-ebacfe9bc436 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:36.944260 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532bc864-4837-4df3-9d34-ebacfe9bc436 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:36.944260 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532bc864-4837-4df3-9d34-ebacfe9bc436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:36.952294 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:10:36.965973 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-532bc864-4837-4df3-9d34-ebacfe9bc436 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:10:36.967227 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-532bc864-4837-4df3-9d34-ebacfe9bc436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:37.028992 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1383/2756] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:10:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:10:37.039061 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efc0810-2b24-402d-9dd5-5df82ae13386 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:37.040635 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-9efc0810-2b24-402d-9dd5-5df82ae13386 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:37.102750 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efc0810-2b24-402d-9dd5-5df82ae13386 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:37.106879 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5432726e-488b-4ecb-996f-f92986ac315b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4294c170df354fe892831281acd4ea7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:37.107481 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5432726e-488b-4ecb-996f-f92986ac315b service neutron] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:37.107761 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5432726e-488b-4ecb-996f-f92986ac315b service neutron] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:37.108031 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5432726e-488b-4ecb-996f-f92986ac315b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:37.117492 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5432726e-488b-4ecb-996f-f92986ac315b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:37.118932 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5432726e-488b-4ecb-996f-f92986ac315b service neutron] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:37.128870 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1374/2757] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:10:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:10:37.423456 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532bc864-4837-4df3-9d34-ebacfe9bc436 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:37.424947 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-532bc864-4837-4df3-9d34-ebacfe9bc436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:37.439855 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532bc864-4837-4df3-9d34-ebacfe9bc436 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:37.446258 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b3a16b-e586-4e4c-b330-518bc1437aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:37.446914 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b3a16b-e586-4e4c-b330-518bc1437aad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:37.447201 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b3a16b-e586-4e4c-b330-518bc1437aad admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:37.447718 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b3a16b-e586-4e4c-b330-518bc1437aad admin admin] PATH_INFO: `/v3/projects/cc5dcd60e64443398495e8ea4957c3a8` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:37.448990 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b3a16b-e586-4e4c-b330-518bc1437aad admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc5dcd60e64443398495e8ea4957c3a8)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:37.451160 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b3a16b-e586-4e4c-b330-518bc1437aad admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:37.502409 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-01b3a16b-e586-4e4c-b330-518bc1437aad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc5dcd60e64443398495e8ea4957c3a8', 'request_id': 'req-01b3a16b-e586-4e4c-b330-518bc1437aad'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:37.509267 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-01b3a16b-e586-4e4c-b330-518bc1437aad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc5dcd60e64443398495e8ea4957c3a8', 'request_id': 'req-01b3a16b-e586-4e4c-b330-518bc1437aad'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:37.519467 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-01b3a16b-e586-4e4c-b330-518bc1437aad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc5dcd60e64443398495e8ea4957c3a8', 'request_id': 'req-01b3a16b-e586-4e4c-b330-518bc1437aad'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:37.531614 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-01b3a16b-e586-4e4c-b330-518bc1437aad admin admin] The token cache is being invalidate because project cc5dcd60e64443398495e8ea4957c3a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 10:10:37.531908 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-01b3a16b-e586-4e4c-b330-518bc1437aad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:37.532880 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-01b3a16b-e586-4e4c-b330-518bc1437aad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:37.534459 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1384/2758] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 10 10:10:37 2022] DELETE /identity/v3/projects/cc5dcd60e64443398495e8ea4957c3a8 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 10:10:37.538532 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5432726e-488b-4ecb-996f-f92986ac315b service neutron] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:37.548836 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5432726e-488b-4ecb-996f-f92986ac315b service neutron] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:37.552593 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:10:37.610509 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3dd4a9-e7f1-4387-8396-c1055b737df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:37.611138 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3dd4a9-e7f1-4387-8396-c1055b737df2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:37.611417 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3dd4a9-e7f1-4387-8396-c1055b737df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:37.611695 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3dd4a9-e7f1-4387-8396-c1055b737df2 admin admin] PATH_INFO: `/v3/users/da39e7713bfb4d5f8c65617d477a4d1f` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:37.612832 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3dd4a9-e7f1-4387-8396-c1055b737df2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da39e7713bfb4d5f8c65617d477a4d1f)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:37.614803 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3dd4a9-e7f1-4387-8396-c1055b737df2 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:37.671917 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-bb3dd4a9-e7f1-4387-8396-c1055b737df2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da39e7713bfb4d5f8c65617d477a4d1f'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:37.681481 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-bb3dd4a9-e7f1-4387-8396-c1055b737df2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da39e7713bfb4d5f8c65617d477a4d1f'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:37.690901 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-bb3dd4a9-e7f1-4387-8396-c1055b737df2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da39e7713bfb4d5f8c65617d477a4d1f'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:37.691509 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-bb3dd4a9-e7f1-4387-8396-c1055b737df2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da39e7713bfb4d5f8c65617d477a4d1f'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:37.692134 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-bb3dd4a9-e7f1-4387-8396-c1055b737df2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da39e7713bfb4d5f8c65617d477a4d1f'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:37.709337 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1375/2759] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 10 10:10:37 2022] DELETE /identity/v3/users/da39e7713bfb4d5f8c65617d477a4d1f => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:10:37.995766 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b3a16b-e586-4e4c-b330-518bc1437aad admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:37.997379 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-01b3a16b-e586-4e4c-b330-518bc1437aad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:38.011863 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b3a16b-e586-4e4c-b330-518bc1437aad admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:38.074890 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8f2f7f-5bba-4964-886c-2e0c768773bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:38.075423 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8f2f7f-5bba-4964-886c-2e0c768773bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:38.075697 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8f2f7f-5bba-4964-886c-2e0c768773bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:38.075964 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8f2f7f-5bba-4964-886c-2e0c768773bf admin admin] PATH_INFO: `/v3/projects/a7fe8e6fbf6640fbb04f17aba7987c4b` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:38.077094 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8f2f7f-5bba-4964-886c-2e0c768773bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7fe8e6fbf6640fbb04f17aba7987c4b)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:38.079004 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8f2f7f-5bba-4964-886c-2e0c768773bf admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:38.116291 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:10:38.134111 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-7b8f2f7f-5bba-4964-886c-2e0c768773bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7fe8e6fbf6640fbb04f17aba7987c4b', 'request_id': 'req-7b8f2f7f-5bba-4964-886c-2e0c768773bf'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:38.140017 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-7b8f2f7f-5bba-4964-886c-2e0c768773bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7fe8e6fbf6640fbb04f17aba7987c4b', 'request_id': 'req-7b8f2f7f-5bba-4964-886c-2e0c768773bf'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:38.148382 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-7b8f2f7f-5bba-4964-886c-2e0c768773bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7fe8e6fbf6640fbb04f17aba7987c4b', 'request_id': 'req-7b8f2f7f-5bba-4964-886c-2e0c768773bf'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:38.162498 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-7b8f2f7f-5bba-4964-886c-2e0c768773bf admin admin] The token cache is being invalidate because project a7fe8e6fbf6640fbb04f17aba7987c4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 10:10:38.162851 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-7b8f2f7f-5bba-4964-886c-2e0c768773bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:38.163537 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-7b8f2f7f-5bba-4964-886c-2e0c768773bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:38.165243 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1385/2760] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 10 10:10:37 2022] DELETE /identity/v3/projects/a7fe8e6fbf6640fbb04f17aba7987c4b => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:10:38.169651 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3dd4a9-e7f1-4387-8396-c1055b737df2 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:38.171310 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-bb3dd4a9-e7f1-4387-8396-c1055b737df2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:38.185199 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3dd4a9-e7f1-4387-8396-c1055b737df2 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:38.246554 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84acfddd-0b58-4f70-9cee-2b1760953f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:38.247191 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84acfddd-0b58-4f70-9cee-2b1760953f1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:38.247505 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84acfddd-0b58-4f70-9cee-2b1760953f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:38.247777 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84acfddd-0b58-4f70-9cee-2b1760953f1c admin admin] PATH_INFO: `/v3/users/720394dda3c5499fb0c000ccdae87a7c` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:38.248979 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84acfddd-0b58-4f70-9cee-2b1760953f1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=720394dda3c5499fb0c000ccdae87a7c)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:38.251236 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84acfddd-0b58-4f70-9cee-2b1760953f1c admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:38.291606 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:10:38.310748 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-84acfddd-0b58-4f70-9cee-2b1760953f1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '720394dda3c5499fb0c000ccdae87a7c'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:38.317906 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-84acfddd-0b58-4f70-9cee-2b1760953f1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '720394dda3c5499fb0c000ccdae87a7c'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:38.329777 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-84acfddd-0b58-4f70-9cee-2b1760953f1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '720394dda3c5499fb0c000ccdae87a7c'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:38.330550 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-84acfddd-0b58-4f70-9cee-2b1760953f1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '720394dda3c5499fb0c000ccdae87a7c'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:38.331203 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-84acfddd-0b58-4f70-9cee-2b1760953f1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '720394dda3c5499fb0c000ccdae87a7c'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:38.351268 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1376/2761] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 10 10:10:38 2022] DELETE /identity/v3/users/720394dda3c5499fb0c000ccdae87a7c => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:10:38.637800 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8f2f7f-5bba-4964-886c-2e0c768773bf admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:38.639471 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-7b8f2f7f-5bba-4964-886c-2e0c768773bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:38.655341 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8f2f7f-5bba-4964-886c-2e0c768773bf admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:38.715665 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbfd176-3c0f-45c4-999f-4ebd050e8bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:38.716301 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbfd176-3c0f-45c4-999f-4ebd050e8bf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:38.716580 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbfd176-3c0f-45c4-999f-4ebd050e8bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:38.716848 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbfd176-3c0f-45c4-999f-4ebd050e8bf8 admin admin] PATH_INFO: `/v3/projects/442418f4fa8a4333b7aa6b0f22aa9bad` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:38.718031 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbfd176-3c0f-45c4-999f-4ebd050e8bf8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=442418f4fa8a4333b7aa6b0f22aa9bad)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:38.719967 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbfd176-3c0f-45c4-999f-4ebd050e8bf8 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:38.776732 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-4dbfd176-3c0f-45c4-999f-4ebd050e8bf8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '442418f4fa8a4333b7aa6b0f22aa9bad', 'request_id': 'req-4dbfd176-3c0f-45c4-999f-4ebd050e8bf8'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:38.782311 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-4dbfd176-3c0f-45c4-999f-4ebd050e8bf8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '442418f4fa8a4333b7aa6b0f22aa9bad', 'request_id': 'req-4dbfd176-3c0f-45c4-999f-4ebd050e8bf8'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:38.791724 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-4dbfd176-3c0f-45c4-999f-4ebd050e8bf8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '442418f4fa8a4333b7aa6b0f22aa9bad', 'request_id': 'req-4dbfd176-3c0f-45c4-999f-4ebd050e8bf8'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:38.804152 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-4dbfd176-3c0f-45c4-999f-4ebd050e8bf8 admin admin] The token cache is being invalidate because project 442418f4fa8a4333b7aa6b0f22aa9bad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 10:10:38.804446 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-4dbfd176-3c0f-45c4-999f-4ebd050e8bf8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:38.805181 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-4dbfd176-3c0f-45c4-999f-4ebd050e8bf8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:38.806797 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1386/2762] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 10 10:10:38 2022] DELETE /identity/v3/projects/442418f4fa8a4333b7aa6b0f22aa9bad => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:10:38.813227 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd306e-7f0c-483d-9750-6b9b0be19eb4 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:38.813529 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd306e-7f0c-483d-9750-6b9b0be19eb4 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:38.813781 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd306e-7f0c-483d-9750-6b9b0be19eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:38.836940 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-16bd306e-7f0c-483d-9750-6b9b0be19eb4 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:10:38.838519 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-16bd306e-7f0c-483d-9750-6b9b0be19eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:38.904068 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1377/2763] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:10:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:10:38.913888 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba1c051-755f-4ddc-ae3e-e94394fe1a0e None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:38.914207 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba1c051-755f-4ddc-ae3e-e94394fe1a0e None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:38.914451 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba1c051-755f-4ddc-ae3e-e94394fe1a0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:38.934610 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-eba1c051-755f-4ddc-ae3e-e94394fe1a0e None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:10:38.935806 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-eba1c051-755f-4ddc-ae3e-e94394fe1a0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:38.945033 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1387/2764] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:10:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:10:38.949632 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bd306e-7f0c-483d-9750-6b9b0be19eb4 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:38.960134 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bd306e-7f0c-483d-9750-6b9b0be19eb4 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:38.965365 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2052a4d1-2842-4bbb-8c54-d991589b97d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:38.965960 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2052a4d1-2842-4bbb-8c54-d991589b97d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:38.966242 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2052a4d1-2842-4bbb-8c54-d991589b97d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:38.966515 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2052a4d1-2842-4bbb-8c54-d991589b97d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:38.967182 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2052a4d1-2842-4bbb-8c54-d991589b97d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:10:38.967482 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2052a4d1-2842-4bbb-8c54-d991589b97d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:38.969109 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2052a4d1-2842-4bbb-8c54-d991589b97d3 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:38.980798 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1378/2765] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 10 10:10:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:10:38.985571 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba1c051-755f-4ddc-ae3e-e94394fe1a0e None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:38.994928 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba1c051-755f-4ddc-ae3e-e94394fe1a0e None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:39.000056 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1657dab6-1d12-4cff-8029-9d31dbc0b6dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:39.000709 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1657dab6-1d12-4cff-8029-9d31dbc0b6dd admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:39.000978 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1657dab6-1d12-4cff-8029-9d31dbc0b6dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:39.001280 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1657dab6-1d12-4cff-8029-9d31dbc0b6dd admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:39.001915 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1657dab6-1d12-4cff-8029-9d31dbc0b6dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:39.003966 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1657dab6-1d12-4cff-8029-9d31dbc0b6dd admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:39.035894 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1388/2766] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 10 10:10:38 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:10:39.040454 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2052a4d1-2842-4bbb-8c54-d991589b97d3 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:39.051201 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2052a4d1-2842-4bbb-8c54-d991589b97d3 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:39.110317 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86867f4-80fa-4de0-a2a7-3e02dac638b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:39.110822 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86867f4-80fa-4de0-a2a7-3e02dac638b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:39.111099 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86867f4-80fa-4de0-a2a7-3e02dac638b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:39.111374 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86867f4-80fa-4de0-a2a7-3e02dac638b2 admin admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:39.111994 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86867f4-80fa-4de0-a2a7-3e02dac638b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:39.113998 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86867f4-80fa-4de0-a2a7-3e02dac638b2 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:39.138306 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1379/2767] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 10 10:10:39 2022] POST /identity/v3/users => generated 287 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:10:39.142350 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1657dab6-1d12-4cff-8029-9d31dbc0b6dd admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:39.153259 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1657dab6-1d12-4cff-8029-9d31dbc0b6dd admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:39.158293 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e497bc-9499-48c5-82e1-07dbd20f416b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:39.158891 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e497bc-9499-48c5-82e1-07dbd20f416b admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:39.159172 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e497bc-9499-48c5-82e1-07dbd20f416b admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:39.159449 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e497bc-9499-48c5-82e1-07dbd20f416b admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:39.160122 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e497bc-9499-48c5-82e1-07dbd20f416b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:39.161961 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e497bc-9499-48c5-82e1-07dbd20f416b admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:39.171848 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1389/2768] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:10:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 10:10:39.176487 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86867f4-80fa-4de0-a2a7-3e02dac638b2 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:39.186948 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86867f4-80fa-4de0-a2a7-3e02dac638b2 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:39.191913 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd980d86-9f2b-4666-bd46-8105bf2c99fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:39.192504 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd980d86-9f2b-4666-bd46-8105bf2c99fa admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:39.192777 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd980d86-9f2b-4666-bd46-8105bf2c99fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:39.193046 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd980d86-9f2b-4666-bd46-8105bf2c99fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:39.193732 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd980d86-9f2b-4666-bd46-8105bf2c99fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:39.195323 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd980d86-9f2b-4666-bd46-8105bf2c99fa admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:39.206618 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1380/2769] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:10:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:10:39.210820 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e497bc-9499-48c5-82e1-07dbd20f416b admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:39.221566 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e497bc-9499-48c5-82e1-07dbd20f416b admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:39.227238 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfaf08f-e3dc-48ce-af7f-260abd36a1ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:39.227902 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfaf08f-e3dc-48ce-af7f-260abd36a1ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:39.228176 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfaf08f-e3dc-48ce-af7f-260abd36a1ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:39.228446 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfaf08f-e3dc-48ce-af7f-260abd36a1ec admin admin] PATH_INFO: `/v3/projects/5ec624deec784aa7bd45c1e75d3a3efd/users/1dd99aee506045289beef77545d2e047/roles/8daabcb6b7394e39b06a3453e33e32db` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:39.230861 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:10:39.247031 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfaf08f-e3dc-48ce-af7f-260abd36a1ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ec624deec784aa7bd45c1e75d3a3efd, user_id=1dd99aee506045289beef77545d2e047, role_id=8daabcb6b7394e39b06a3453e33e32db)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:39.250028 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfaf08f-e3dc-48ce-af7f-260abd36a1ec admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:39.264744 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1390/2770] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:10:39 2022] PUT /identity/v3/projects/5ec624deec784aa7bd45c1e75d3a3efd/users/1dd99aee506045289beef77545d2e047/roles/8daabcb6b7394e39b06a3453e33e32db => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:10:39.270113 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e906cc4-5810-4d56-b911-c09576208440 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:39.270403 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e906cc4-5810-4d56-b911-c09576208440 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:39.270708 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e906cc4-5810-4d56-b911-c09576208440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:39.290982 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-3e906cc4-5810-4d56-b911-c09576208440 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:10:39.292231 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-3e906cc4-5810-4d56-b911-c09576208440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:39.298254 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:10:39.353271 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1381/2771] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:10:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:10:39.423441 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfaf08f-e3dc-48ce-af7f-260abd36a1ec admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:39.425424 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-bbfaf08f-e3dc-48ce-af7f-260abd36a1ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:39.488941 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfaf08f-e3dc-48ce-af7f-260abd36a1ec admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:39.492562 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c11207b-dff8-49cf-a817-cbd826fdde46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4294c170df354fe892831281acd4ea7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:39.493196 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11207b-dff8-49cf-a817-cbd826fdde46 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:39.493477 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11207b-dff8-49cf-a817-cbd826fdde46 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:39.493750 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11207b-dff8-49cf-a817-cbd826fdde46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:39.502498 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c11207b-dff8-49cf-a817-cbd826fdde46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:39.503960 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c11207b-dff8-49cf-a817-cbd826fdde46 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:39.513225 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1391/2772] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:10:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:10:40.176976 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801fb8d6-cb0b-4c27-99a7-357f75758c64 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:40.177556 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801fb8d6-cb0b-4c27-99a7-357f75758c64 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:40.177556 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801fb8d6-cb0b-4c27-99a7-357f75758c64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:40.207975 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-801fb8d6-cb0b-4c27-99a7-357f75758c64 None None] MFA Rules not processed for user `1dd99aee506045289beef77545d2e047`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:10:40.209128 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-801fb8d6-cb0b-4c27-99a7-357f75758c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:40.287655 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1382/2773] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:10:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:10:40.292245 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c11207b-dff8-49cf-a817-cbd826fdde46 service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:40.302884 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c11207b-dff8-49cf-a817-cbd826fdde46 service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:40.307837 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb22e72-39b9-4104-8cdf-1478248ee3c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:40.308439 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb22e72-39b9-4104-8cdf-1478248ee3c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:40.308711 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb22e72-39b9-4104-8cdf-1478248ee3c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:40.308975 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb22e72-39b9-4104-8cdf-1478248ee3c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:40.309665 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb22e72-39b9-4104-8cdf-1478248ee3c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:40.311540 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb22e72-39b9-4104-8cdf-1478248ee3c0 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:40.341930 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1392/2774] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 10 10:10:40 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 10:10:40.343608 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801fb8d6-cb0b-4c27-99a7-357f75758c64 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:40.354561 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801fb8d6-cb0b-4c27-99a7-357f75758c64 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:40.413826 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8a522b-b775-487e-bd75-616d4f5aa511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:40.414444 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a522b-b775-487e-bd75-616d4f5aa511 admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:40.414731 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a522b-b775-487e-bd75-616d4f5aa511 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:40.414975 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a522b-b775-487e-bd75-616d4f5aa511 admin admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:40.415609 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8a522b-b775-487e-bd75-616d4f5aa511 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:40.417565 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8a522b-b775-487e-bd75-616d4f5aa511 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:40.440973 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1383/2775] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 10 10:10:40 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:10:40.444899 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb22e72-39b9-4104-8cdf-1478248ee3c0 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:40.455573 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb22e72-39b9-4104-8cdf-1478248ee3c0 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:40.461322 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0c3c6a-5770-4e40-b74b-9ea786cf6f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:40.462083 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0c3c6a-5770-4e40-b74b-9ea786cf6f71 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:40.462479 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0c3c6a-5770-4e40-b74b-9ea786cf6f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:40.462941 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0c3c6a-5770-4e40-b74b-9ea786cf6f71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:40.463783 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0c3c6a-5770-4e40-b74b-9ea786cf6f71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:40.465592 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0c3c6a-5770-4e40-b74b-9ea786cf6f71 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:40.479081 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1393/2776] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:10:40 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:10:40.482101 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8a522b-b775-487e-bd75-616d4f5aa511 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:40.493634 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8a522b-b775-487e-bd75-616d4f5aa511 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:40.502946 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1891edc-e4fe-4894-aead-a7be59f6bc53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:40.503622 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1891edc-e4fe-4894-aead-a7be59f6bc53 admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:40.504011 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1891edc-e4fe-4894-aead-a7be59f6bc53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:40.504289 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1891edc-e4fe-4894-aead-a7be59f6bc53 admin admin] PATH_INFO: `/v3/projects/b49a45a96e4c44f1aee70f6788ce0e28/users/5cdaec78837242d5abd2787240d7dc98/roles/eb04edc46b3742d7a0f0ead26f68bc22` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:40.520008 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1891edc-e4fe-4894-aead-a7be59f6bc53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b49a45a96e4c44f1aee70f6788ce0e28, user_id=5cdaec78837242d5abd2787240d7dc98, role_id=eb04edc46b3742d7a0f0ead26f68bc22)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:40.522746 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1891edc-e4fe-4894-aead-a7be59f6bc53 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:40.536372 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1384/2777] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:10:40 2022] PUT /identity/v3/projects/b49a45a96e4c44f1aee70f6788ce0e28/users/5cdaec78837242d5abd2787240d7dc98/roles/eb04edc46b3742d7a0f0ead26f68bc22 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:10:40.540604 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0c3c6a-5770-4e40-b74b-9ea786cf6f71 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:40.551268 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0c3c6a-5770-4e40-b74b-9ea786cf6f71 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:40.613726 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b3bcfe-de4b-4cf1-a828-4419b6722be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:40.614355 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b3bcfe-de4b-4cf1-a828-4419b6722be8 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:40.614637 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b3bcfe-de4b-4cf1-a828-4419b6722be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:40.614912 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b3bcfe-de4b-4cf1-a828-4419b6722be8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:40.615572 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b3bcfe-de4b-4cf1-a828-4419b6722be8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:40.617199 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b3bcfe-de4b-4cf1-a828-4419b6722be8 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:40.629283 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1394/2778] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:10:40 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:10:40.633882 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1891edc-e4fe-4894-aead-a7be59f6bc53 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:40.644941 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1891edc-e4fe-4894-aead-a7be59f6bc53 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:40.650006 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2494e6-aa3d-4342-8c4e-2a4afbdda4c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:40.650656 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2494e6-aa3d-4342-8c4e-2a4afbdda4c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:40.650941 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2494e6-aa3d-4342-8c4e-2a4afbdda4c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:40.651213 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2494e6-aa3d-4342-8c4e-2a4afbdda4c1 admin admin] PATH_INFO: `/v3/projects/b49a45a96e4c44f1aee70f6788ce0e28/users/5cdaec78837242d5abd2787240d7dc98/roles/eb04edc46b3742d7a0f0ead26f68bc22` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:40.653198 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2494e6-aa3d-4342-8c4e-2a4afbdda4c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b49a45a96e4c44f1aee70f6788ce0e28, user_id=5cdaec78837242d5abd2787240d7dc98, role_id=eb04edc46b3742d7a0f0ead26f68bc22)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:40.656091 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2494e6-aa3d-4342-8c4e-2a4afbdda4c1 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:40.658742 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:10:40.668220 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1385/2779] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:10:40 2022] PUT /identity/v3/projects/b49a45a96e4c44f1aee70f6788ce0e28/users/5cdaec78837242d5abd2787240d7dc98/roles/eb04edc46b3742d7a0f0ead26f68bc22 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:10:41.303367 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da355546-ae18-48e8-86fa-eded17002685 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:41.303902 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da355546-ae18-48e8-86fa-eded17002685 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:41.303902 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da355546-ae18-48e8-86fa-eded17002685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:41.332263 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-da355546-ae18-48e8-86fa-eded17002685 None None] MFA Rules not processed for user `5cdaec78837242d5abd2787240d7dc98`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:10:41.333498 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-da355546-ae18-48e8-86fa-eded17002685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:41.370888 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:10:41.406651 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1395/2780] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:10:41 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:10:41.418946 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a907f9-43d6-411a-9e67-a3d0dbf87229 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:41.419494 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a907f9-43d6-411a-9e67-a3d0dbf87229 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:41.419494 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a907f9-43d6-411a-9e67-a3d0dbf87229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:41.438767 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-83a907f9-43d6-411a-9e67-a3d0dbf87229 None None] MFA Rules not processed for user `1dd99aee506045289beef77545d2e047`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:10:41.439977 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-83a907f9-43d6-411a-9e67-a3d0dbf87229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:41.499484 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1386/2781] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:10:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:10:41.516869 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da355546-ae18-48e8-86fa-eded17002685 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:41.518485 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-da355546-ae18-48e8-86fa-eded17002685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:41.600684 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da355546-ae18-48e8-86fa-eded17002685 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:41.606257 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb1002f-baa7-4564-a47f-e662b09fc33c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd8580888cba41a88566da4540b1130c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:41.606867 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb1002f-baa7-4564-a47f-e662b09fc33c service nova] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:41.607145 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb1002f-baa7-4564-a47f-e662b09fc33c service nova] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:41.607416 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb1002f-baa7-4564-a47f-e662b09fc33c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:41.615552 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb1002f-baa7-4564-a47f-e662b09fc33c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:41.617164 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb1002f-baa7-4564-a47f-e662b09fc33c service nova] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:41.626089 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1396/2782] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:10:41 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:10:51.492743 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:INSERT=1,keystone:SELECT=27 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:10:51.622009 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=46 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:10:52.202845 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a907f9-43d6-411a-9e67-a3d0dbf87229 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:52.204646 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-83a907f9-43d6-411a-9e67-a3d0dbf87229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:52.275405 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a907f9-43d6-411a-9e67-a3d0dbf87229 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:52.280437 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aa1e1c-4f1a-4745-b3fd-911a652cc067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:52.281086 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aa1e1c-4f1a-4745-b3fd-911a652cc067 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:52.281379 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aa1e1c-4f1a-4745-b3fd-911a652cc067 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:52.281646 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aa1e1c-4f1a-4745-b3fd-911a652cc067 admin admin] PATH_INFO: `/v3/users/a2d57b0654c14f4496549e8f1b873c06` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:52.282779 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aa1e1c-4f1a-4745-b3fd-911a652cc067 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2d57b0654c14f4496549e8f1b873c06)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:52.284742 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aa1e1c-4f1a-4745-b3fd-911a652cc067 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:52.336026 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-54aa1e1c-4f1a-4745-b3fd-911a652cc067 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2d57b0654c14f4496549e8f1b873c06'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:52.343235 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-54aa1e1c-4f1a-4745-b3fd-911a652cc067 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2d57b0654c14f4496549e8f1b873c06'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:52.351454 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-54aa1e1c-4f1a-4745-b3fd-911a652cc067 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2d57b0654c14f4496549e8f1b873c06'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:52.352090 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-54aa1e1c-4f1a-4745-b3fd-911a652cc067 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2d57b0654c14f4496549e8f1b873c06'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:52.352840 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-54aa1e1c-4f1a-4745-b3fd-911a652cc067 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2d57b0654c14f4496549e8f1b873c06'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:52.370894 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1387/2783] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 10 10:10:52 2022] DELETE /identity/v3/users/a2d57b0654c14f4496549e8f1b873c06 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:10:52.375527 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf4be0-b89d-4df3-be8c-2f39bee4f639 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:52.375828 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf4be0-b89d-4df3-be8c-2f39bee4f639 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:52.376090 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf4be0-b89d-4df3-be8c-2f39bee4f639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:52.396837 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-09bf4be0-b89d-4df3-be8c-2f39bee4f639 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:10:52.398126 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-09bf4be0-b89d-4df3-be8c-2f39bee4f639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:52.459783 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1397/2784] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:10:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:10:52.469932 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aa1e1c-4f1a-4745-b3fd-911a652cc067 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:52.471555 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-54aa1e1c-4f1a-4745-b3fd-911a652cc067 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:52.531290 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aa1e1c-4f1a-4745-b3fd-911a652cc067 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:52.535841 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef975fa-5d39-4a10-88e0-455bfbbac29f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4294c170df354fe892831281acd4ea7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:52.536453 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef975fa-5d39-4a10-88e0-455bfbbac29f service neutron] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:52.536731 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef975fa-5d39-4a10-88e0-455bfbbac29f service neutron] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:52.537001 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef975fa-5d39-4a10-88e0-455bfbbac29f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:52.546752 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef975fa-5d39-4a10-88e0-455bfbbac29f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:52.548558 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef975fa-5d39-4a10-88e0-455bfbbac29f service neutron] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:52.558352 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1388/2785] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:10:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:10:52.889545 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bf4be0-b89d-4df3-be8c-2f39bee4f639 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:52.891013 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-09bf4be0-b89d-4df3-be8c-2f39bee4f639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:52.904153 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bf4be0-b89d-4df3-be8c-2f39bee4f639 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:52.911712 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2ae335-78c4-4feb-a21e-01928968c53b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:52.912720 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2ae335-78c4-4feb-a21e-01928968c53b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:52.913007 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2ae335-78c4-4feb-a21e-01928968c53b admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:52.913314 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2ae335-78c4-4feb-a21e-01928968c53b admin admin] PATH_INFO: `/v3/projects/caadb70081364c8e94f7635ede021b69` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:52.914586 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2ae335-78c4-4feb-a21e-01928968c53b admin admin] RBAC: Authorizing `identity:delete_project(project_id=caadb70081364c8e94f7635ede021b69)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:52.916878 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2ae335-78c4-4feb-a21e-01928968c53b admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:52.972831 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-5d2ae335-78c4-4feb-a21e-01928968c53b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'caadb70081364c8e94f7635ede021b69', 'request_id': 'req-5d2ae335-78c4-4feb-a21e-01928968c53b'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:52.978599 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-5d2ae335-78c4-4feb-a21e-01928968c53b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'caadb70081364c8e94f7635ede021b69', 'request_id': 'req-5d2ae335-78c4-4feb-a21e-01928968c53b'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:52.987991 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-5d2ae335-78c4-4feb-a21e-01928968c53b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'caadb70081364c8e94f7635ede021b69', 'request_id': 'req-5d2ae335-78c4-4feb-a21e-01928968c53b'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:52.999488 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-5d2ae335-78c4-4feb-a21e-01928968c53b admin admin] The token cache is being invalidate because project caadb70081364c8e94f7635ede021b69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 10:10:52.999774 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-5d2ae335-78c4-4feb-a21e-01928968c53b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:53.000484 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-5d2ae335-78c4-4feb-a21e-01928968c53b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:53.002104 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1398/2786] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 10 10:10:52 2022] DELETE /identity/v3/projects/caadb70081364c8e94f7635ede021b69 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:10:53.007089 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a67ed5-b263-4c90-9572-1e4461ac3b6e None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:53.007382 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a67ed5-b263-4c90-9572-1e4461ac3b6e None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:53.007657 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a67ed5-b263-4c90-9572-1e4461ac3b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:53.028185 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-f4a67ed5-b263-4c90-9572-1e4461ac3b6e None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:10:53.029521 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-f4a67ed5-b263-4c90-9572-1e4461ac3b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:53.047981 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:10:53.093362 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1389/2787] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:10:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:10:53.101878 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae72265-7756-4e33-a747-95f88bb3b05e None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:53.102379 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae72265-7756-4e33-a747-95f88bb3b05e None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:53.102831 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae72265-7756-4e33-a747-95f88bb3b05e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:53.124651 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-8ae72265-7756-4e33-a747-95f88bb3b05e None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:10:53.125941 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-8ae72265-7756-4e33-a747-95f88bb3b05e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:53.134873 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1399/2788] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:10:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:10:53.139284 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a67ed5-b263-4c90-9572-1e4461ac3b6e None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:53.149901 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a67ed5-b263-4c90-9572-1e4461ac3b6e None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:53.154983 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46ace5a-ed94-4e2d-bf04-8174e4094f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:53.155631 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46ace5a-ed94-4e2d-bf04-8174e4094f79 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:53.155974 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46ace5a-ed94-4e2d-bf04-8174e4094f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:53.156306 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46ace5a-ed94-4e2d-bf04-8174e4094f79 admin admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:53.157083 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46ace5a-ed94-4e2d-bf04-8174e4094f79 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:10:53.157439 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46ace5a-ed94-4e2d-bf04-8174e4094f79 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:53.159132 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46ace5a-ed94-4e2d-bf04-8174e4094f79 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:53.171447 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1390/2789] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 10 10:10:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 10:10:53.176201 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae72265-7756-4e33-a747-95f88bb3b05e None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:53.185935 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae72265-7756-4e33-a747-95f88bb3b05e None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:53.201249 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87161482-0b16-4c7b-a2da-bb332ba30052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:53.201249 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87161482-0b16-4c7b-a2da-bb332ba30052 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:53.201249 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87161482-0b16-4c7b-a2da-bb332ba30052 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:53.201249 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87161482-0b16-4c7b-a2da-bb332ba30052 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:53.201643 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87161482-0b16-4c7b-a2da-bb332ba30052 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:53.201643 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87161482-0b16-4c7b-a2da-bb332ba30052 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:53.233522 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1400/2790] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 10 10:10:53 2022] POST /identity/v3/projects => generated 373 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:10:53.237526 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46ace5a-ed94-4e2d-bf04-8174e4094f79 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:53.249278 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46ace5a-ed94-4e2d-bf04-8174e4094f79 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:53.308132 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2284b648-3be7-43dc-85d2-95f4d3ca15fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:53.308782 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2284b648-3be7-43dc-85d2-95f4d3ca15fe admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:53.309083 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2284b648-3be7-43dc-85d2-95f4d3ca15fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:53.309357 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2284b648-3be7-43dc-85d2-95f4d3ca15fe admin admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:53.309986 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2284b648-3be7-43dc-85d2-95f4d3ca15fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:53.311915 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2284b648-3be7-43dc-85d2-95f4d3ca15fe admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:53.332480 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1391/2791] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 10 10:10:53 2022] POST /identity/v3/users => generated 287 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 10:10:53.336705 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87161482-0b16-4c7b-a2da-bb332ba30052 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:53.347150 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87161482-0b16-4c7b-a2da-bb332ba30052 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:53.352786 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff12dfe2-da0a-4443-aee3-ad09a1b654d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:53.353511 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff12dfe2-da0a-4443-aee3-ad09a1b654d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:53.353790 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff12dfe2-da0a-4443-aee3-ad09a1b654d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:53.354071 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff12dfe2-da0a-4443-aee3-ad09a1b654d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:53.354694 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff12dfe2-da0a-4443-aee3-ad09a1b654d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:53.356284 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff12dfe2-da0a-4443-aee3-ad09a1b654d8 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:53.366282 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1401/2792] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:10:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:10:53.370594 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2284b648-3be7-43dc-85d2-95f4d3ca15fe admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:53.380624 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2284b648-3be7-43dc-85d2-95f4d3ca15fe admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:53.386024 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e0998c-e2da-4a75-9a20-a993b1e5b519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:53.386606 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e0998c-e2da-4a75-9a20-a993b1e5b519 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:53.386884 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e0998c-e2da-4a75-9a20-a993b1e5b519 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:53.387148 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e0998c-e2da-4a75-9a20-a993b1e5b519 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:53.387785 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e0998c-e2da-4a75-9a20-a993b1e5b519 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:53.389475 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e0998c-e2da-4a75-9a20-a993b1e5b519 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:53.400089 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1392/2793] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:10:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 10:10:53.404306 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff12dfe2-da0a-4443-aee3-ad09a1b654d8 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:53.414294 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff12dfe2-da0a-4443-aee3-ad09a1b654d8 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:53.418919 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc6909a-0525-42b0-baa3-dd7f20445ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:53.419570 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc6909a-0525-42b0-baa3-dd7f20445ea6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:53.419849 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc6909a-0525-42b0-baa3-dd7f20445ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:53.420127 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc6909a-0525-42b0-baa3-dd7f20445ea6 admin admin] PATH_INFO: `/v3/projects/5bed5b5edfc74eac9c736c96a8bcbc04/users/78aaa1f14b2d40a9825c3347357406de/roles/8daabcb6b7394e39b06a3453e33e32db` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:53.436502 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc6909a-0525-42b0-baa3-dd7f20445ea6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bed5b5edfc74eac9c736c96a8bcbc04, user_id=78aaa1f14b2d40a9825c3347357406de, role_id=8daabcb6b7394e39b06a3453e33e32db)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:53.439181 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc6909a-0525-42b0-baa3-dd7f20445ea6 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:53.453019 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1402/2794] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:10:53 2022] PUT /identity/v3/projects/5bed5b5edfc74eac9c736c96a8bcbc04/users/78aaa1f14b2d40a9825c3347357406de/roles/8daabcb6b7394e39b06a3453e33e32db => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:10:53.463488 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807b98b2-242f-4636-a748-ed4b84f47335 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:53.463774 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807b98b2-242f-4636-a748-ed4b84f47335 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:53.464043 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807b98b2-242f-4636-a748-ed4b84f47335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:53.491473 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-807b98b2-242f-4636-a748-ed4b84f47335 None None] MFA Rules not processed for user `78aaa1f14b2d40a9825c3347357406de`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:10:53.492610 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-807b98b2-242f-4636-a748-ed4b84f47335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:53.558079 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1393/2795] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:10:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:10:53.570026 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc6909a-0525-42b0-baa3-dd7f20445ea6 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:53.571978 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-8cc6909a-0525-42b0-baa3-dd7f20445ea6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:53.593891 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:10:53.631903 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc6909a-0525-42b0-baa3-dd7f20445ea6 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:53.636224 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a3ad11-a22c-47f4-b320-5cb85157699d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf8e725cbe0403d943b136235eac057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:53.636855 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a3ad11-a22c-47f4-b320-5cb85157699d service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:53.637101 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a3ad11-a22c-47f4-b320-5cb85157699d service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:53.637401 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a3ad11-a22c-47f4-b320-5cb85157699d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:53.646309 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a3ad11-a22c-47f4-b320-5cb85157699d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:53.647759 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a3ad11-a22c-47f4-b320-5cb85157699d service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:53.656721 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1403/2796] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:10:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:10:53.682741 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807b98b2-242f-4636-a748-ed4b84f47335 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:53.702706 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:10:53.747165 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807b98b2-242f-4636-a748-ed4b84f47335 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:53.751928 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72180c51-d83f-4156-a5a5-d1bbef693663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:53.752550 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72180c51-d83f-4156-a5a5-d1bbef693663 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:53.752831 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72180c51-d83f-4156-a5a5-d1bbef693663 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:53.753098 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72180c51-d83f-4156-a5a5-d1bbef693663 admin admin] PATH_INFO: `/v3/users/78aaa1f14b2d40a9825c3347357406de` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:53.754300 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72180c51-d83f-4156-a5a5-d1bbef693663 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78aaa1f14b2d40a9825c3347357406de)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:53.756222 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72180c51-d83f-4156-a5a5-d1bbef693663 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:53.805248 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-72180c51-d83f-4156-a5a5-d1bbef693663 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78aaa1f14b2d40a9825c3347357406de'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:53.812049 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-72180c51-d83f-4156-a5a5-d1bbef693663 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78aaa1f14b2d40a9825c3347357406de'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:53.820766 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-72180c51-d83f-4156-a5a5-d1bbef693663 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78aaa1f14b2d40a9825c3347357406de'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:53.821580 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-72180c51-d83f-4156-a5a5-d1bbef693663 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78aaa1f14b2d40a9825c3347357406de'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:53.822348 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-72180c51-d83f-4156-a5a5-d1bbef693663 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78aaa1f14b2d40a9825c3347357406de'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:53.841011 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1394/2797] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 10 10:10:53 2022] DELETE /identity/v3/users/78aaa1f14b2d40a9825c3347357406de => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:10:53.846888 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf705c8a-2d7e-4758-9d86-7b566fade468 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:53.847169 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf705c8a-2d7e-4758-9d86-7b566fade468 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:53.847464 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf705c8a-2d7e-4758-9d86-7b566fade468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:53.867375 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-bf705c8a-2d7e-4758-9d86-7b566fade468 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:10:53.868612 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-bf705c8a-2d7e-4758-9d86-7b566fade468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:53.935745 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1404/2798] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:10:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:10:53.945628 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72180c51-d83f-4156-a5a5-d1bbef693663 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:53.947137 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-72180c51-d83f-4156-a5a5-d1bbef693663 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:54.005872 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72180c51-d83f-4156-a5a5-d1bbef693663 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:54.009989 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70548d8-7e0d-47d6-b4b8-368e27dae8c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4294c170df354fe892831281acd4ea7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:54.010583 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70548d8-7e0d-47d6-b4b8-368e27dae8c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:54.010857 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70548d8-7e0d-47d6-b4b8-368e27dae8c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:54.011133 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70548d8-7e0d-47d6-b4b8-368e27dae8c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:54.020542 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70548d8-7e0d-47d6-b4b8-368e27dae8c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:54.022010 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70548d8-7e0d-47d6-b4b8-368e27dae8c6 service neutron] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:54.031455 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1395/2799] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:10:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:10:54.318686 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf705c8a-2d7e-4758-9d86-7b566fade468 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:54.320120 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-bf705c8a-2d7e-4758-9d86-7b566fade468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:54.332739 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf705c8a-2d7e-4758-9d86-7b566fade468 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:54.338244 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1f847d-188b-4360-9771-3be69316cde6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:54.338888 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1f847d-188b-4360-9771-3be69316cde6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:54.339169 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1f847d-188b-4360-9771-3be69316cde6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:54.339437 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1f847d-188b-4360-9771-3be69316cde6 admin admin] PATH_INFO: `/v3/projects/5bed5b5edfc74eac9c736c96a8bcbc04` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:54.340602 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1f847d-188b-4360-9771-3be69316cde6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bed5b5edfc74eac9c736c96a8bcbc04)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:54.342541 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1f847d-188b-4360-9771-3be69316cde6 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:54.389944 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-9e1f847d-188b-4360-9771-3be69316cde6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bed5b5edfc74eac9c736c96a8bcbc04', 'request_id': 'req-9e1f847d-188b-4360-9771-3be69316cde6'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:54.395597 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-9e1f847d-188b-4360-9771-3be69316cde6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bed5b5edfc74eac9c736c96a8bcbc04', 'request_id': 'req-9e1f847d-188b-4360-9771-3be69316cde6'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:54.404976 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-9e1f847d-188b-4360-9771-3be69316cde6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bed5b5edfc74eac9c736c96a8bcbc04', 'request_id': 'req-9e1f847d-188b-4360-9771-3be69316cde6'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:54.416520 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-9e1f847d-188b-4360-9771-3be69316cde6 admin admin] The token cache is being invalidate because project 5bed5b5edfc74eac9c736c96a8bcbc04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 10:10:54.416812 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-9e1f847d-188b-4360-9771-3be69316cde6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:54.417525 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-9e1f847d-188b-4360-9771-3be69316cde6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:10:54.419031 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1405/2800] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 10 10:10:54 2022] DELETE /identity/v3/projects/5bed5b5edfc74eac9c736c96a8bcbc04 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:10:54.424319 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df25091-2093-4572-bb53-e65cdabb27e8 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:54.424597 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df25091-2093-4572-bb53-e65cdabb27e8 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:54.424869 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df25091-2093-4572-bb53-e65cdabb27e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:54.444545 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-6df25091-2093-4572-bb53-e65cdabb27e8 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:10:54.445885 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-6df25091-2093-4572-bb53-e65cdabb27e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:54.479401 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:10:54.509036 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1396/2801] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:10:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:10:54.517751 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7269a09d-bcce-4772-9be4-a39185e51dea None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:54.518033 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7269a09d-bcce-4772-9be4-a39185e51dea None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:54.518233 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7269a09d-bcce-4772-9be4-a39185e51dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:54.537926 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-7269a09d-bcce-4772-9be4-a39185e51dea None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:10:54.539127 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-7269a09d-bcce-4772-9be4-a39185e51dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:54.547673 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1406/2802] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:10:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:10:54.552419 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df25091-2093-4572-bb53-e65cdabb27e8 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:54.562932 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df25091-2093-4572-bb53-e65cdabb27e8 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:54.568308 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee78a26-70f9-460e-9ce5-bde78872963d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:54.568908 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee78a26-70f9-460e-9ce5-bde78872963d admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:54.569217 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee78a26-70f9-460e-9ce5-bde78872963d admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:54.569489 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee78a26-70f9-460e-9ce5-bde78872963d admin admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:54.570170 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee78a26-70f9-460e-9ce5-bde78872963d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:10:54.570474 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee78a26-70f9-460e-9ce5-bde78872963d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:54.572155 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee78a26-70f9-460e-9ce5-bde78872963d admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:54.587705 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1397/2803] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 10 10:10:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 10:10:54.588871 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7269a09d-bcce-4772-9be4-a39185e51dea None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:54.601543 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7269a09d-bcce-4772-9be4-a39185e51dea None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:54.603311 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e49aab-faad-4a45-9c00-ccfeee9ff035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:54.603922 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e49aab-faad-4a45-9c00-ccfeee9ff035 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:54.604194 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e49aab-faad-4a45-9c00-ccfeee9ff035 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:54.604463 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e49aab-faad-4a45-9c00-ccfeee9ff035 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:54.605112 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e49aab-faad-4a45-9c00-ccfeee9ff035 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:54.607042 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e49aab-faad-4a45-9c00-ccfeee9ff035 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:54.616352 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee78a26-70f9-460e-9ce5-bde78872963d admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:54.618190 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-2ee78a26-70f9-460e-9ce5-bde78872963d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:54.635668 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1407/2804] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 10 10:10:54 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:10:54.639746 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e49aab-faad-4a45-9c00-ccfeee9ff035 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:54.658820 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:10:54.682710 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee78a26-70f9-460e-9ce5-bde78872963d admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:54.706502 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e49aab-faad-4a45-9c00-ccfeee9ff035 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:54.711959 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570a5178-e872-4d3d-a768-3fd8a2364fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:54.712608 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570a5178-e872-4d3d-a768-3fd8a2364fa7 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:54.713120 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570a5178-e872-4d3d-a768-3fd8a2364fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:54.713243 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570a5178-e872-4d3d-a768-3fd8a2364fa7 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:54.713852 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570a5178-e872-4d3d-a768-3fd8a2364fa7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:54.715811 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570a5178-e872-4d3d-a768-3fd8a2364fa7 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:54.732073 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97894243-3c97-4e99-a92b-78980f53e47f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf8e725cbe0403d943b136235eac057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:54.732680 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97894243-3c97-4e99-a92b-78980f53e47f service cinder] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:54.732959 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97894243-3c97-4e99-a92b-78980f53e47f service cinder] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:54.733264 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97894243-3c97-4e99-a92b-78980f53e47f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:54.735089 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-97894243-3c97-4e99-a92b-78980f53e47f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:54.737955 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1408/2805] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 10 10:10:54 2022] POST /identity/v3/users => generated 287 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 10:10:54.742042 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570a5178-e872-4d3d-a768-3fd8a2364fa7 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:54.751759 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570a5178-e872-4d3d-a768-3fd8a2364fa7 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:54.757283 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc48c74b-500f-4e99-8d30-4db3facf2205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:54.757863 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc48c74b-500f-4e99-8d30-4db3facf2205 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:54.758145 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc48c74b-500f-4e99-8d30-4db3facf2205 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:54.758413 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc48c74b-500f-4e99-8d30-4db3facf2205 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:54.759126 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc48c74b-500f-4e99-8d30-4db3facf2205 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:54.760725 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc48c74b-500f-4e99-8d30-4db3facf2205 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:54.771215 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1409/2806] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:10:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:10:54.775094 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc48c74b-500f-4e99-8d30-4db3facf2205 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:54.784603 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc48c74b-500f-4e99-8d30-4db3facf2205 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:54.790183 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee72fca4-d0c7-4a10-91c2-6c5d5d20d883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:54.790814 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee72fca4-d0c7-4a10-91c2-6c5d5d20d883 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:54.791098 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee72fca4-d0c7-4a10-91c2-6c5d5d20d883 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:54.791371 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee72fca4-d0c7-4a10-91c2-6c5d5d20d883 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:54.792011 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee72fca4-d0c7-4a10-91c2-6c5d5d20d883 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:54.793615 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee72fca4-d0c7-4a10-91c2-6c5d5d20d883 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:54.797950 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97894243-3c97-4e99-a92b-78980f53e47f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:54.799390 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97894243-3c97-4e99-a92b-78980f53e47f service cinder] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:54.804470 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1410/2807] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:10:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 10:10:54.808727 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee72fca4-d0c7-4a10-91c2-6c5d5d20d883 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:54.809561 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1398/2808] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:10:54 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 10:10:54.818485 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee72fca4-d0c7-4a10-91c2-6c5d5d20d883 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:54.823356 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808a97ba-5723-44c5-9bce-9fb1fc665da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:54.824031 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808a97ba-5723-44c5-9bce-9fb1fc665da1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:54.824306 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808a97ba-5723-44c5-9bce-9fb1fc665da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:54.824581 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808a97ba-5723-44c5-9bce-9fb1fc665da1 admin admin] PATH_INFO: `/v3/projects/70ddd14678044184bbb7950ee959bafd/users/8e5b3df1d897427e800cb8dfe7bbe935/roles/8daabcb6b7394e39b06a3453e33e32db` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:54.839644 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808a97ba-5723-44c5-9bce-9fb1fc665da1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70ddd14678044184bbb7950ee959bafd, user_id=8e5b3df1d897427e800cb8dfe7bbe935, role_id=8daabcb6b7394e39b06a3453e33e32db)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:54.842326 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808a97ba-5723-44c5-9bce-9fb1fc665da1 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:54.856310 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1411/2809] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:10:54 2022] PUT /identity/v3/projects/70ddd14678044184bbb7950ee959bafd/users/8e5b3df1d897427e800cb8dfe7bbe935/roles/8daabcb6b7394e39b06a3453e33e32db => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 10:10:54.867018 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e261d333-26fe-4da7-9588-2b3a53f3b632 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:54.867316 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e261d333-26fe-4da7-9588-2b3a53f3b632 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:54.867578 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e261d333-26fe-4da7-9588-2b3a53f3b632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:54.900656 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-e261d333-26fe-4da7-9588-2b3a53f3b632 None None] MFA Rules not processed for user `8e5b3df1d897427e800cb8dfe7bbe935`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:10:54.901918 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-e261d333-26fe-4da7-9588-2b3a53f3b632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:54.923000 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:10:54.967625 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1399/2810] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:10:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 10:10:54.978614 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808a97ba-5723-44c5-9bce-9fb1fc665da1 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:10:54.980487 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-808a97ba-5723-44c5-9bce-9fb1fc665da1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:55.038626 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808a97ba-5723-44c5-9bce-9fb1fc665da1 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:10:55.042726 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff084d2-4577-47f5-8d37-ceda925690fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf8e725cbe0403d943b136235eac057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:10:55.043322 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff084d2-4577-47f5-8d37-ceda925690fb service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:55.043660 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff084d2-4577-47f5-8d37-ceda925690fb service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:55.043927 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff084d2-4577-47f5-8d37-ceda925690fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:55.052468 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff084d2-4577-47f5-8d37-ceda925690fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:10:55.053984 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff084d2-4577-47f5-8d37-ceda925690fb service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:10:55.062897 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1412/2811] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:10:54 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:10:56.445038 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13fc375-b11c-4acc-a2e1-a98131d99e92 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:10:56.445622 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13fc375-b11c-4acc-a2e1-a98131d99e92 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:10:56.445622 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13fc375-b11c-4acc-a2e1-a98131d99e92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:10:56.464924 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-e13fc375-b11c-4acc-a2e1-a98131d99e92 None None] MFA Rules not processed for user `8e5b3df1d897427e800cb8dfe7bbe935`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:10:56.466158 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-e13fc375-b11c-4acc-a2e1-a98131d99e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:10:56.473500 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1400/2812] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:10:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:11:05.058849 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=67,keystone:INSERT=4 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:11:06.460248 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=20 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:11:10.527316 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77570621-5999-4f19-a87b-28cc0f3acd80 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:11:10.527870 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77570621-5999-4f19-a87b-28cc0f3acd80 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:11:10.527870 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77570621-5999-4f19-a87b-28cc0f3acd80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:11:10.547761 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-77570621-5999-4f19-a87b-28cc0f3acd80 None None] MFA Rules not processed for user `179709fe7d8343689f096ac0d9a333b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:11:10.548976 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-77570621-5999-4f19-a87b-28cc0f3acd80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:11:10.617979 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1413/2813] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Aug 10 10:11:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:11:10.666909 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13fc375-b11c-4acc-a2e1-a98131d99e92 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:11:10.668479 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-e13fc375-b11c-4acc-a2e1-a98131d99e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:11:10.744641 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13fc375-b11c-4acc-a2e1-a98131d99e92 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:11:10.751720 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08428ab4-36cf-496b-8361-0937e0fd8d78 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b801551d29ff4687ab8c1ce8cfa51614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:11:10.752332 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08428ab4-36cf-496b-8361-0937e0fd8d78 service swift] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:11:10.752610 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08428ab4-36cf-496b-8361-0937e0fd8d78 service swift] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:11:10.752879 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08428ab4-36cf-496b-8361-0937e0fd8d78 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:11:10.761823 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08428ab4-36cf-496b-8361-0937e0fd8d78 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:11:10.763423 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08428ab4-36cf-496b-8361-0937e0fd8d78 service swift] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:11:10.771959 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1401/2814] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Aug 10 10:11:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 10:11:11.306333 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dee3f3-d4e1-4363-9696-dfd726e073f2 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:11:11.306745 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dee3f3-d4e1-4363-9696-dfd726e073f2 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:11:11.307090 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dee3f3-d4e1-4363-9696-dfd726e073f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:11:11.340871 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-e2dee3f3-d4e1-4363-9696-dfd726e073f2 None None] MFA Rules not processed for user `179709fe7d8343689f096ac0d9a333b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:11:11.342139 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-e2dee3f3-d4e1-4363-9696-dfd726e073f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:11:11.377917 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1414/2815] 10.222.0.27 () {58 vars in 967 bytes} [Wed Aug 10 10:11:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:11:11.391376 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08428ab4-36cf-496b-8361-0937e0fd8d78 service swift] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:11:11.437016 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08428ab4-36cf-496b-8361-0937e0fd8d78 service swift] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:11:11.443134 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a131e5a4-617f-4cf2-a27a-0f1800aecedf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b801551d29ff4687ab8c1ce8cfa51614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:11:11.443844 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a131e5a4-617f-4cf2-a27a-0f1800aecedf service swift] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:11:11.444213 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a131e5a4-617f-4cf2-a27a-0f1800aecedf service swift] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:11:11.444516 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a131e5a4-617f-4cf2-a27a-0f1800aecedf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:11:11.453755 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a131e5a4-617f-4cf2-a27a-0f1800aecedf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:11:11.455348 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a131e5a4-617f-4cf2-a27a-0f1800aecedf service swift] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:11:11.463525 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1402/2816] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Aug 10 10:11:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 10:11:11.684553 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7664f20-4519-483d-a950-9cf4b7082d0e None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:11:11.684960 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7664f20-4519-483d-a950-9cf4b7082d0e None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:11:11.685164 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7664f20-4519-483d-a950-9cf4b7082d0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:11:11.704791 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-c7664f20-4519-483d-a950-9cf4b7082d0e None None] MFA Rules not processed for user `179709fe7d8343689f096ac0d9a333b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:11:11.706029 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-c7664f20-4519-483d-a950-9cf4b7082d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:11:11.714003 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1415/2817] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Aug 10 10:11:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:11:11.726956 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a131e5a4-617f-4cf2-a27a-0f1800aecedf service swift] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:11:11.738875 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a131e5a4-617f-4cf2-a27a-0f1800aecedf service swift] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:11:11.744823 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eb0175-5358-4d00-8461-ff3c03765e20 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b801551d29ff4687ab8c1ce8cfa51614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:11:11.745474 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eb0175-5358-4d00-8461-ff3c03765e20 service swift] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:11:11.745779 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eb0175-5358-4d00-8461-ff3c03765e20 service swift] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:11:11.746080 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eb0175-5358-4d00-8461-ff3c03765e20 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:11:11.755429 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eb0175-5358-4d00-8461-ff3c03765e20 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:11:11.757044 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eb0175-5358-4d00-8461-ff3c03765e20 service swift] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:11:11.765621 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1403/2818] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Aug 10 10:11:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 10:11:12.110674 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5631b8e-ddd7-4f42-b16d-dbba23a1c7e5 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:11:12.110954 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5631b8e-ddd7-4f42-b16d-dbba23a1c7e5 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:11:12.111220 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5631b8e-ddd7-4f42-b16d-dbba23a1c7e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:11:12.130280 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-c5631b8e-ddd7-4f42-b16d-dbba23a1c7e5 None None] MFA Rules not processed for user `179709fe7d8343689f096ac0d9a333b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:11:12.131458 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-c5631b8e-ddd7-4f42-b16d-dbba23a1c7e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:11:12.138979 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1416/2819] 10.222.0.27 () {58 vars in 967 bytes} [Wed Aug 10 10:11:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:11:12.151293 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eb0175-5358-4d00-8461-ff3c03765e20 service swift] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:11:12.162925 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eb0175-5358-4d00-8461-ff3c03765e20 service swift] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:11:12.169114 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3695bcb8-0bd2-406a-95e3-e9dfa3ae44ff service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b801551d29ff4687ab8c1ce8cfa51614', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:11:12.169729 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3695bcb8-0bd2-406a-95e3-e9dfa3ae44ff service swift] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:11:12.170011 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3695bcb8-0bd2-406a-95e3-e9dfa3ae44ff service swift] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:11:12.170282 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3695bcb8-0bd2-406a-95e3-e9dfa3ae44ff service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:11:12.179485 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3695bcb8-0bd2-406a-95e3-e9dfa3ae44ff service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:11:12.181098 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3695bcb8-0bd2-406a-95e3-e9dfa3ae44ff service swift] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:11:12.189511 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1404/2820] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Aug 10 10:11:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 10:11:14.311227 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5631b8e-ddd7-4f42-b16d-dbba23a1c7e5 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:11:14.398396 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5631b8e-ddd7-4f42-b16d-dbba23a1c7e5 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:11:14.403517 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58fb8cd-41de-4bd7-aee9-a81c0e1d033d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:11:14.404161 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58fb8cd-41de-4bd7-aee9-a81c0e1d033d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:11:14.404440 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58fb8cd-41de-4bd7-aee9-a81c0e1d033d admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:11:14.404699 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58fb8cd-41de-4bd7-aee9-a81c0e1d033d admin admin] PATH_INFO: `/v3/users/8e5b3df1d897427e800cb8dfe7bbe935` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:11:14.405948 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58fb8cd-41de-4bd7-aee9-a81c0e1d033d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e5b3df1d897427e800cb8dfe7bbe935)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:11:14.407785 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58fb8cd-41de-4bd7-aee9-a81c0e1d033d admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:11:14.449586 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:11:14.460466 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-b58fb8cd-41de-4bd7-aee9-a81c0e1d033d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e5b3df1d897427e800cb8dfe7bbe935'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:11:14.469366 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-b58fb8cd-41de-4bd7-aee9-a81c0e1d033d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e5b3df1d897427e800cb8dfe7bbe935'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:11:14.470028 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-b58fb8cd-41de-4bd7-aee9-a81c0e1d033d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e5b3df1d897427e800cb8dfe7bbe935'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:11:14.470570 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-b58fb8cd-41de-4bd7-aee9-a81c0e1d033d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e5b3df1d897427e800cb8dfe7bbe935'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:11:14.477615 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-b58fb8cd-41de-4bd7-aee9-a81c0e1d033d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e5b3df1d897427e800cb8dfe7bbe935'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:11:14.495278 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1417/2821] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 10 10:11:14 2022] DELETE /identity/v3/users/8e5b3df1d897427e800cb8dfe7bbe935 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:11:14.499988 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8175b35-322d-4b05-96b7-104eb2e716a1 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:11:14.500539 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8175b35-322d-4b05-96b7-104eb2e716a1 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:11:14.500539 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8175b35-322d-4b05-96b7-104eb2e716a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:11:14.542733 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-b8175b35-322d-4b05-96b7-104eb2e716a1 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:11:14.543976 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-b8175b35-322d-4b05-96b7-104eb2e716a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:11:14.604932 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1405/2822] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:11:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:11:14.614835 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58fb8cd-41de-4bd7-aee9-a81c0e1d033d admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:11:14.616271 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-b58fb8cd-41de-4bd7-aee9-a81c0e1d033d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:11:14.683955 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58fb8cd-41de-4bd7-aee9-a81c0e1d033d admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:11:14.688341 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70adb19a-ef49-477c-8bc3-c3ac3cb47ab5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4294c170df354fe892831281acd4ea7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:11:14.688960 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70adb19a-ef49-477c-8bc3-c3ac3cb47ab5 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:11:14.689264 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70adb19a-ef49-477c-8bc3-c3ac3cb47ab5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:11:14.689537 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70adb19a-ef49-477c-8bc3-c3ac3cb47ab5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:11:14.699818 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70adb19a-ef49-477c-8bc3-c3ac3cb47ab5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:11:14.701384 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70adb19a-ef49-477c-8bc3-c3ac3cb47ab5 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:11:14.711349 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1418/2823] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:11:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:11:14.751682 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8175b35-322d-4b05-96b7-104eb2e716a1 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:11:14.753426 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-b8175b35-322d-4b05-96b7-104eb2e716a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:11:14.761314 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=100 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:11:14.768219 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8175b35-322d-4b05-96b7-104eb2e716a1 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:11:14.772819 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883e4251-4d77-4563-a130-1f089f35372a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:11:14.773486 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883e4251-4d77-4563-a130-1f089f35372a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:11:14.773762 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883e4251-4d77-4563-a130-1f089f35372a admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:11:14.774033 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883e4251-4d77-4563-a130-1f089f35372a admin admin] PATH_INFO: `/v3/users/1dd99aee506045289beef77545d2e047` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:11:14.775165 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883e4251-4d77-4563-a130-1f089f35372a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1dd99aee506045289beef77545d2e047)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:11:14.777107 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883e4251-4d77-4563-a130-1f089f35372a admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:11:14.826094 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-883e4251-4d77-4563-a130-1f089f35372a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1dd99aee506045289beef77545d2e047'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:11:14.833238 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-883e4251-4d77-4563-a130-1f089f35372a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1dd99aee506045289beef77545d2e047'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:11:14.841188 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-883e4251-4d77-4563-a130-1f089f35372a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1dd99aee506045289beef77545d2e047'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:11:14.842042 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-883e4251-4d77-4563-a130-1f089f35372a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1dd99aee506045289beef77545d2e047'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:11:14.842467 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-883e4251-4d77-4563-a130-1f089f35372a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1dd99aee506045289beef77545d2e047'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:11:14.860151 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1406/2824] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 10 10:11:14 2022] DELETE /identity/v3/users/1dd99aee506045289beef77545d2e047 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 10:11:14.895064 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70adb19a-ef49-477c-8bc3-c3ac3cb47ab5 service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:11:14.896813 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-70adb19a-ef49-477c-8bc3-c3ac3cb47ab5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:11:14.910660 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70adb19a-ef49-477c-8bc3-c3ac3cb47ab5 service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:11:14.976505 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5151e59e-42f2-4a0e-b338-bbb0f6558772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:11:14.977236 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5151e59e-42f2-4a0e-b338-bbb0f6558772 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:11:14.977518 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5151e59e-42f2-4a0e-b338-bbb0f6558772 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:11:14.977792 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5151e59e-42f2-4a0e-b338-bbb0f6558772 admin admin] PATH_INFO: `/v3/projects/70ddd14678044184bbb7950ee959bafd` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:11:14.978952 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5151e59e-42f2-4a0e-b338-bbb0f6558772 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70ddd14678044184bbb7950ee959bafd)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:11:14.980907 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5151e59e-42f2-4a0e-b338-bbb0f6558772 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:11:15.031876 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-5151e59e-42f2-4a0e-b338-bbb0f6558772 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70ddd14678044184bbb7950ee959bafd', 'request_id': 'req-5151e59e-42f2-4a0e-b338-bbb0f6558772'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:11:15.036520 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:11:15.038097 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-5151e59e-42f2-4a0e-b338-bbb0f6558772 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70ddd14678044184bbb7950ee959bafd', 'request_id': 'req-5151e59e-42f2-4a0e-b338-bbb0f6558772'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:11:15.047933 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-5151e59e-42f2-4a0e-b338-bbb0f6558772 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70ddd14678044184bbb7950ee959bafd', 'request_id': 'req-5151e59e-42f2-4a0e-b338-bbb0f6558772'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:11:15.050252 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883e4251-4d77-4563-a130-1f089f35372a admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:11:15.051803 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-883e4251-4d77-4563-a130-1f089f35372a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:11:15.061418 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-5151e59e-42f2-4a0e-b338-bbb0f6558772 admin admin] The token cache is being invalidate because project 70ddd14678044184bbb7950ee959bafd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 10:11:15.061932 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-5151e59e-42f2-4a0e-b338-bbb0f6558772 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:11:15.062375 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-5151e59e-42f2-4a0e-b338-bbb0f6558772 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:11:15.068198 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1419/2825] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 10 10:11:14 2022] DELETE /identity/v3/projects/70ddd14678044184bbb7950ee959bafd => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:11:15.068847 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883e4251-4d77-4563-a130-1f089f35372a admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:11:15.069496 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f7d8f9-12c1-4f46-b9f0-e257882ec76d None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:11:15.070407 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f7d8f9-12c1-4f46-b9f0-e257882ec76d None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:11:15.070407 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f7d8f9-12c1-4f46-b9f0-e257882ec76d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:11:15.118361 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-81f7d8f9-12c1-4f46-b9f0-e257882ec76d None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:11:15.119475 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-81f7d8f9-12c1-4f46-b9f0-e257882ec76d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:11:15.132640 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7755cd-4c03-4197-9bf8-6ea8d958be87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:11:15.133324 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7755cd-4c03-4197-9bf8-6ea8d958be87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:11:15.133598 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7755cd-4c03-4197-9bf8-6ea8d958be87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:11:15.133897 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7755cd-4c03-4197-9bf8-6ea8d958be87 admin admin] PATH_INFO: `/v3/projects/5ec624deec784aa7bd45c1e75d3a3efd` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:11:15.135124 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7755cd-4c03-4197-9bf8-6ea8d958be87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ec624deec784aa7bd45c1e75d3a3efd)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:11:15.137122 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7755cd-4c03-4197-9bf8-6ea8d958be87 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:11:15.180918 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1420/2826] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:11:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 10:11:15.185270 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-9b7755cd-4c03-4197-9bf8-6ea8d958be87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ec624deec784aa7bd45c1e75d3a3efd', 'request_id': 'req-9b7755cd-4c03-4197-9bf8-6ea8d958be87'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:11:15.188829 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d7f760-f238-4e72-92d1-b52b74f42461 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:11:15.189145 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d7f760-f238-4e72-92d1-b52b74f42461 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:11:15.189496 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d7f760-f238-4e72-92d1-b52b74f42461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:11:15.191236 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-9b7755cd-4c03-4197-9bf8-6ea8d958be87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ec624deec784aa7bd45c1e75d3a3efd', 'request_id': 'req-9b7755cd-4c03-4197-9bf8-6ea8d958be87'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:11:15.199263 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-9b7755cd-4c03-4197-9bf8-6ea8d958be87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ec624deec784aa7bd45c1e75d3a3efd', 'request_id': 'req-9b7755cd-4c03-4197-9bf8-6ea8d958be87'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:11:15.209226 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-12d7f760-f238-4e72-92d1-b52b74f42461 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:11:15.210558 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-12d7f760-f238-4e72-92d1-b52b74f42461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:11:15.210721 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-9b7755cd-4c03-4197-9bf8-6ea8d958be87 admin admin] The token cache is being invalidate because project 5ec624deec784aa7bd45c1e75d3a3efd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80232) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 10:11:15.210925 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-9b7755cd-4c03-4197-9bf8-6ea8d958be87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:11:15.211550 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-9b7755cd-4c03-4197-9bf8-6ea8d958be87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:11:15.213041 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1407/2827] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 10 10:11:15 2022] DELETE /identity/v3/projects/5ec624deec784aa7bd45c1e75d3a3efd => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 10:11:15.216991 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7755cd-4c03-4197-9bf8-6ea8d958be87 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:11:15.218302 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-9b7755cd-4c03-4197-9bf8-6ea8d958be87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:11:15.224893 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:11:15.271895 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1421/2828] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:11:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:11:15.276153 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d7f760-f238-4e72-92d1-b52b74f42461 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:11:15.284677 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d7f760-f238-4e72-92d1-b52b74f42461 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:11:15.284954 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7755cd-4c03-4197-9bf8-6ea8d958be87 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:11:15.289327 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009a4354-a7a3-4fb4-b902-58058ede0550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:11:15.289862 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f03abcf-7e8b-494a-8ff1-0131430454c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:11:15.289989 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009a4354-a7a3-4fb4-b902-58058ede0550 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:11:15.290175 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009a4354-a7a3-4fb4-b902-58058ede0550 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:11:15.290426 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009a4354-a7a3-4fb4-b902-58058ede0550 admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:11:15.290540 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f03abcf-7e8b-494a-8ff1-0131430454c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:11:15.290755 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f03abcf-7e8b-494a-8ff1-0131430454c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:11:15.291027 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f03abcf-7e8b-494a-8ff1-0131430454c1 admin admin] PATH_INFO: `/v3/users/5cdaec78837242d5abd2787240d7dc98` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:11:15.291129 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009a4354-a7a3-4fb4-b902-58058ede0550 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:11:15.291347 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009a4354-a7a3-4fb4-b902-58058ede0550 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:11:15.292158 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f03abcf-7e8b-494a-8ff1-0131430454c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5cdaec78837242d5abd2787240d7dc98)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:11:15.292924 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009a4354-a7a3-4fb4-b902-58058ede0550 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:11:15.294113 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f03abcf-7e8b-494a-8ff1-0131430454c1 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:11:15.306160 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1422/2829] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 10 10:11:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 10:11:15.310257 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009a4354-a7a3-4fb4-b902-58058ede0550 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:11:15.320758 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009a4354-a7a3-4fb4-b902-58058ede0550 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:11:15.325814 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2d2266-2259-4b14-85f7-7eb467005d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:11:15.326396 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2d2266-2259-4b14-85f7-7eb467005d34 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:11:15.326672 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2d2266-2259-4b14-85f7-7eb467005d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:11:15.326939 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2d2266-2259-4b14-85f7-7eb467005d34 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:11:15.327549 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2d2266-2259-4b14-85f7-7eb467005d34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:11:15.329564 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2d2266-2259-4b14-85f7-7eb467005d34 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:11:15.344481 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-0f03abcf-7e8b-494a-8ff1-0131430454c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cdaec78837242d5abd2787240d7dc98'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:11:15.352570 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-0f03abcf-7e8b-494a-8ff1-0131430454c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cdaec78837242d5abd2787240d7dc98'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:11:15.357738 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1423/2830] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 10 10:11:15 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 10:11:15.359906 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-0f03abcf-7e8b-494a-8ff1-0131430454c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cdaec78837242d5abd2787240d7dc98'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:11:15.360529 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-0f03abcf-7e8b-494a-8ff1-0131430454c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cdaec78837242d5abd2787240d7dc98'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:11:15.361184 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-0f03abcf-7e8b-494a-8ff1-0131430454c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cdaec78837242d5abd2787240d7dc98'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:11:15.362377 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2d2266-2259-4b14-85f7-7eb467005d34 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:11:15.364124 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-7c2d2266-2259-4b14-85f7-7eb467005d34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:11:15.379375 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1408/2831] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 10 10:11:15 2022] DELETE /identity/v3/users/5cdaec78837242d5abd2787240d7dc98 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 10:11:15.401174 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:11:15.438031 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2d2266-2259-4b14-85f7-7eb467005d34 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:11:15.499135 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642c9c31-98ca-4dd3-bcf1-c94f68ab6d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:11:15.499800 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642c9c31-98ca-4dd3-bcf1-c94f68ab6d18 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:11:15.500083 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642c9c31-98ca-4dd3-bcf1-c94f68ab6d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:11:15.500350 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642c9c31-98ca-4dd3-bcf1-c94f68ab6d18 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:11:15.500975 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642c9c31-98ca-4dd3-bcf1-c94f68ab6d18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:11:15.502919 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642c9c31-98ca-4dd3-bcf1-c94f68ab6d18 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:11:15.524399 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1424/2832] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 10 10:11:15 2022] POST /identity/v3/users => generated 292 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 10:11:15.528759 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f03abcf-7e8b-494a-8ff1-0131430454c1 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:11:15.539248 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f03abcf-7e8b-494a-8ff1-0131430454c1 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:11:15.544864 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b48f90-5f60-411d-98a7-3b11b0c415bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:11:15.545528 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b48f90-5f60-411d-98a7-3b11b0c415bf admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:11:15.545815 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b48f90-5f60-411d-98a7-3b11b0c415bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:11:15.546102 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b48f90-5f60-411d-98a7-3b11b0c415bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:11:15.547119 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b48f90-5f60-411d-98a7-3b11b0c415bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:11:15.548828 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b48f90-5f60-411d-98a7-3b11b0c415bf admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:11:15.562506 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1409/2833] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:11:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:11:15.562857 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642c9c31-98ca-4dd3-bcf1-c94f68ab6d18 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:11:15.563868 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b48f90-5f60-411d-98a7-3b11b0c415bf admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:11:15.564512 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-642c9c31-98ca-4dd3-bcf1-c94f68ab6d18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:11:15.574678 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b48f90-5f60-411d-98a7-3b11b0c415bf admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:11:15.579636 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc01be1-ce73-4e69-aaf2-10267766f5c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:11:15.580253 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc01be1-ce73-4e69-aaf2-10267766f5c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:11:15.580536 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc01be1-ce73-4e69-aaf2-10267766f5c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:11:15.580814 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc01be1-ce73-4e69-aaf2-10267766f5c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:11:15.581512 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc01be1-ce73-4e69-aaf2-10267766f5c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:11:15.583139 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc01be1-ce73-4e69-aaf2-10267766f5c3 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:11:15.585256 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642c9c31-98ca-4dd3-bcf1-c94f68ab6d18 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:11:15.590595 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e960cbe-d0b9-4746-b211-e8dc88696a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:11:15.591150 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e960cbe-d0b9-4746-b211-e8dc88696a00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:11:15.591493 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e960cbe-d0b9-4746-b211-e8dc88696a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:11:15.591682 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e960cbe-d0b9-4746-b211-e8dc88696a00 admin admin] PATH_INFO: `/v3/projects/b49a45a96e4c44f1aee70f6788ce0e28` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:11:15.592831 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e960cbe-d0b9-4746-b211-e8dc88696a00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b49a45a96e4c44f1aee70f6788ce0e28)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:11:15.598115 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e960cbe-d0b9-4746-b211-e8dc88696a00 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:11:15.598304 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1410/2834] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:11:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:11:15.598671 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc01be1-ce73-4e69-aaf2-10267766f5c3 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:11:15.608498 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc01be1-ce73-4e69-aaf2-10267766f5c3 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:11:15.613127 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01249224-9883-4016-8fd1-c588d74a1a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:11:15.613949 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01249224-9883-4016-8fd1-c588d74a1a33 admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:11:15.614225 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01249224-9883-4016-8fd1-c588d74a1a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:11:15.614495 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01249224-9883-4016-8fd1-c588d74a1a33 admin admin] PATH_INFO: `/v3/projects/2307d489afdd43e1b7f369414daa821b/users/1448e6ea4df54e2ca99a318b1dc7e9f5/roles/8daabcb6b7394e39b06a3453e33e32db` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:11:15.630417 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01249224-9883-4016-8fd1-c588d74a1a33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2307d489afdd43e1b7f369414daa821b, user_id=1448e6ea4df54e2ca99a318b1dc7e9f5, role_id=8daabcb6b7394e39b06a3453e33e32db)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:11:15.632998 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01249224-9883-4016-8fd1-c588d74a1a33 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:11:15.645421 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-2e960cbe-d0b9-4746-b211-e8dc88696a00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b49a45a96e4c44f1aee70f6788ce0e28', 'request_id': 'req-2e960cbe-d0b9-4746-b211-e8dc88696a00'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:11:15.645808 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1411/2835] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:11:15 2022] PUT /identity/v3/projects/2307d489afdd43e1b7f369414daa821b/users/1448e6ea4df54e2ca99a318b1dc7e9f5/roles/8daabcb6b7394e39b06a3453e33e32db => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 10:11:15.650832 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d4de8-e415-487e-af42-e0b50418ba3f None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:11:15.651120 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d4de8-e415-487e-af42-e0b50418ba3f None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:11:15.651393 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d4de8-e415-487e-af42-e0b50418ba3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:11:15.654715 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-2e960cbe-d0b9-4746-b211-e8dc88696a00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b49a45a96e4c44f1aee70f6788ce0e28', 'request_id': 'req-2e960cbe-d0b9-4746-b211-e8dc88696a00'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:11:15.663016 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-2e960cbe-d0b9-4746-b211-e8dc88696a00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b49a45a96e4c44f1aee70f6788ce0e28', 'request_id': 'req-2e960cbe-d0b9-4746-b211-e8dc88696a00'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:11:15.674249 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-149d4de8-e415-487e-af42-e0b50418ba3f None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:11:15.674249 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-149d4de8-e415-487e-af42-e0b50418ba3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:11:15.675928 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-2e960cbe-d0b9-4746-b211-e8dc88696a00 admin admin] The token cache is being invalidate because project b49a45a96e4c44f1aee70f6788ce0e28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 10:11:15.676220 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-2e960cbe-d0b9-4746-b211-e8dc88696a00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:11:15.676876 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-2e960cbe-d0b9-4746-b211-e8dc88696a00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:11:15.678481 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1425/2836] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 10 10:11:15 2022] DELETE /identity/v3/projects/b49a45a96e4c44f1aee70f6788ce0e28 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:11:15.683790 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeafdea1-4e6f-4dad-a2d8-a1b7be58d1d6 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:11:15.683893 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeafdea1-4e6f-4dad-a2d8-a1b7be58d1d6 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:11:15.684096 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeafdea1-4e6f-4dad-a2d8-a1b7be58d1d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:11:15.703373 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-aeafdea1-4e6f-4dad-a2d8-a1b7be58d1d6 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:11:15.704583 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-aeafdea1-4e6f-4dad-a2d8-a1b7be58d1d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:11:15.708707 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:11:15.738164 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1412/2837] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:11:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 10:11:15.749153 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149d4de8-e415-487e-af42-e0b50418ba3f None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:11:15.750846 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-149d4de8-e415-487e-af42-e0b50418ba3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:11:15.751776 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:11:15.771031 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1426/2838] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:11:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:11:15.778704 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc018be6-fee6-4f2b-bb07-2108ca5364ce None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:11:15.778996 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc018be6-fee6-4f2b-bb07-2108ca5364ce None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:11:15.779262 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc018be6-fee6-4f2b-bb07-2108ca5364ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:11:15.798605 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-dc018be6-fee6-4f2b-bb07-2108ca5364ce None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:11:15.799811 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-dc018be6-fee6-4f2b-bb07-2108ca5364ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:11:15.807716 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1427/2839] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:11:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 10:11:15.809077 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149d4de8-e415-487e-af42-e0b50418ba3f None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:11:15.811997 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc018be6-fee6-4f2b-bb07-2108ca5364ce None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:11:15.813230 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdf3f66-9d3f-4efd-af44-72512d6d0109 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4294c170df354fe892831281acd4ea7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:11:15.813833 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdf3f66-9d3f-4efd-af44-72512d6d0109 service neutron] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:11:15.814109 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdf3f66-9d3f-4efd-af44-72512d6d0109 service neutron] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:11:15.814378 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdf3f66-9d3f-4efd-af44-72512d6d0109 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:11:15.820684 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc018be6-fee6-4f2b-bb07-2108ca5364ce None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:11:15.823663 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdf3f66-9d3f-4efd-af44-72512d6d0109 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:11:15.825117 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdf3f66-9d3f-4efd-af44-72512d6d0109 service neutron] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:11:15.825415 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75bc89d-b282-4ab7-b332-9bbdc8305df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:11:15.825993 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75bc89d-b282-4ab7-b332-9bbdc8305df8 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:11:15.826266 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75bc89d-b282-4ab7-b332-9bbdc8305df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:11:15.826532 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75bc89d-b282-4ab7-b332-9bbdc8305df8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:11:15.827168 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75bc89d-b282-4ab7-b332-9bbdc8305df8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:11:15.827466 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75bc89d-b282-4ab7-b332-9bbdc8305df8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:11:15.829033 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75bc89d-b282-4ab7-b332-9bbdc8305df8 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:11:15.836016 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1413/2840] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:11:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 10:11:15.840415 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1428/2841] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 10 10:11:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 10:11:15.844806 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdf3f66-9d3f-4efd-af44-72512d6d0109 service neutron] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:11:15.854337 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdf3f66-9d3f-4efd-af44-72512d6d0109 service neutron] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:11:15.859429 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff05e7e-38a4-4d32-8236-974abbd69d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:11:15.860017 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff05e7e-38a4-4d32-8236-974abbd69d00 admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:11:15.860294 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff05e7e-38a4-4d32-8236-974abbd69d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:11:15.860566 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff05e7e-38a4-4d32-8236-974abbd69d00 admin admin] PATH_INFO: `/v3/projects` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:11:15.861229 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff05e7e-38a4-4d32-8236-974abbd69d00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:11:15.863179 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff05e7e-38a4-4d32-8236-974abbd69d00 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:11:15.895389 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1414/2842] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 10 10:11:15 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 10:11:15.896599 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75bc89d-b282-4ab7-b332-9bbdc8305df8 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:11:15.906787 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75bc89d-b282-4ab7-b332-9bbdc8305df8 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:11:15.967016 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779bb45e-75d7-4665-bb2f-a97ca2c272b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:11:15.967649 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779bb45e-75d7-4665-bb2f-a97ca2c272b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:11:15.967931 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779bb45e-75d7-4665-bb2f-a97ca2c272b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:11:15.968209 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779bb45e-75d7-4665-bb2f-a97ca2c272b0 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:11:15.968845 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779bb45e-75d7-4665-bb2f-a97ca2c272b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:11:15.970836 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779bb45e-75d7-4665-bb2f-a97ca2c272b0 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:11:15.992660 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1429/2843] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 10 10:11:15 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 10:11:15.997240 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff05e7e-38a4-4d32-8236-974abbd69d00 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:11:16.009353 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff05e7e-38a4-4d32-8236-974abbd69d00 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:11:16.015745 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c677ba-ba7d-48c3-be60-8ea3ea9100b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:11:16.016474 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c677ba-ba7d-48c3-be60-8ea3ea9100b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:11:16.016815 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c677ba-ba7d-48c3-be60-8ea3ea9100b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:11:16.017193 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c677ba-ba7d-48c3-be60-8ea3ea9100b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:11:16.017849 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c677ba-ba7d-48c3-be60-8ea3ea9100b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:11:16.019479 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c677ba-ba7d-48c3-be60-8ea3ea9100b9 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:11:16.030435 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1415/2844] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:11:15 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:11:16.034708 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779bb45e-75d7-4665-bb2f-a97ca2c272b0 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:11:16.045349 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779bb45e-75d7-4665-bb2f-a97ca2c272b0 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:11:16.051034 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d96808-6c76-457b-b2bf-c70f84afdd2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:11:16.051646 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d96808-6c76-457b-b2bf-c70f84afdd2c admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:11:16.051962 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d96808-6c76-457b-b2bf-c70f84afdd2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:11:16.052203 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d96808-6c76-457b-b2bf-c70f84afdd2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:11:16.052871 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d96808-6c76-457b-b2bf-c70f84afdd2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:11:16.054550 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d96808-6c76-457b-b2bf-c70f84afdd2c admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:11:16.066538 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1430/2845] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:11:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:11:16.070953 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c677ba-ba7d-48c3-be60-8ea3ea9100b9 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:11:16.081548 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c677ba-ba7d-48c3-be60-8ea3ea9100b9 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:11:16.087001 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f5492d-321f-49cc-84de-42f16245c515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:11:16.087758 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f5492d-321f-49cc-84de-42f16245c515 admin admin] REQUEST_METHOD: `PUT` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:11:16.088035 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f5492d-321f-49cc-84de-42f16245c515 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:11:16.088456 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f5492d-321f-49cc-84de-42f16245c515 admin admin] PATH_INFO: `/v3/projects/afb2a38b6d1b4f25a73b34b19d436d1d/users/6b2118079fbe4c0d8c647a5a1fa9f088/roles/8daabcb6b7394e39b06a3453e33e32db` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:11:16.104839 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f5492d-321f-49cc-84de-42f16245c515 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afb2a38b6d1b4f25a73b34b19d436d1d, user_id=6b2118079fbe4c0d8c647a5a1fa9f088, role_id=8daabcb6b7394e39b06a3453e33e32db)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:11:16.107631 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f5492d-321f-49cc-84de-42f16245c515 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:11:16.124380 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1416/2846] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:11:16 2022] PUT /identity/v3/projects/afb2a38b6d1b4f25a73b34b19d436d1d/users/6b2118079fbe4c0d8c647a5a1fa9f088/roles/8daabcb6b7394e39b06a3453e33e32db => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:11:16.139574 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beef3e75-0d49-4b60-8b2b-77f6210aaab3 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:11:16.139870 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beef3e75-0d49-4b60-8b2b-77f6210aaab3 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:11:16.140172 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beef3e75-0d49-4b60-8b2b-77f6210aaab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:11:16.172991 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-beef3e75-0d49-4b60-8b2b-77f6210aaab3 None None] MFA Rules not processed for user `6b2118079fbe4c0d8c647a5a1fa9f088`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:11:16.174211 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-beef3e75-0d49-4b60-8b2b-77f6210aaab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:11:16.244563 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1431/2847] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:11:16 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:11:16.257118 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f5492d-321f-49cc-84de-42f16245c515 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:11:16.259048 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-99f5492d-321f-49cc-84de-42f16245c515 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:11:16.318645 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f5492d-321f-49cc-84de-42f16245c515 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:11:16.322518 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fbd40c-6778-4d8f-ba0e-074f4c31a3b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf8e725cbe0403d943b136235eac057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:11:16.323184 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fbd40c-6778-4d8f-ba0e-074f4c31a3b5 service cinder] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:11:16.323504 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fbd40c-6778-4d8f-ba0e-074f4c31a3b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:11:16.323771 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fbd40c-6778-4d8f-ba0e-074f4c31a3b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:11:16.332493 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fbd40c-6778-4d8f-ba0e-074f4c31a3b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:11:16.333934 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fbd40c-6778-4d8f-ba0e-074f4c31a3b5 service cinder] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:11:16.343096 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1417/2848] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:11:16 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:11:16.490929 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dad390c-f655-4d38-8fc1-1069b0181c9a None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:11:16.491532 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dad390c-f655-4d38-8fc1-1069b0181c9a None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:11:16.491532 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dad390c-f655-4d38-8fc1-1069b0181c9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:11:16.521292 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-9dad390c-f655-4d38-8fc1-1069b0181c9a None None] MFA Rules not processed for user `1448e6ea4df54e2ca99a318b1dc7e9f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:11:16.523201 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-9dad390c-f655-4d38-8fc1-1069b0181c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:11:16.552710 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:11:16.600131 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1432/2849] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:11:16 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:11:16.611550 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fbd40c-6778-4d8f-ba0e-074f4c31a3b5 service cinder] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:11:16.614921 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-43fbd40c-6778-4d8f-ba0e-074f4c31a3b5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:11:16.642487 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fbd40c-6778-4d8f-ba0e-074f4c31a3b5 service cinder] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:11:16.647235 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0fae14-6ff9-444a-932d-898f5780a2eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf8e725cbe0403d943b136235eac057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:11:16.648764 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0fae14-6ff9-444a-932d-898f5780a2eb service cinder] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:11:16.649329 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0fae14-6ff9-444a-932d-898f5780a2eb service cinder] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:11:16.649704 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0fae14-6ff9-444a-932d-898f5780a2eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:11:16.662775 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0fae14-6ff9-444a-932d-898f5780a2eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:11:16.664358 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0fae14-6ff9-444a-932d-898f5780a2eb service cinder] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:11:16.681220 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1418/2850] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:11:16 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:11:18.092738 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7240bc2-a51b-4953-a2e0-6cd5c527a0a0 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:11:18.093461 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7240bc2-a51b-4953-a2e0-6cd5c527a0a0 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:11:18.093461 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7240bc2-a51b-4953-a2e0-6cd5c527a0a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:11:18.112914 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-e7240bc2-a51b-4953-a2e0-6cd5c527a0a0 None None] MFA Rules not processed for user `1448e6ea4df54e2ca99a318b1dc7e9f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:11:18.114185 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-e7240bc2-a51b-4953-a2e0-6cd5c527a0a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:11:18.121948 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1433/2851] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:11:18 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:11:18.962409 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0fae14-6ff9-444a-932d-898f5780a2eb service cinder] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:11:18.982862 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:11:19.033006 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0fae14-6ff9-444a-932d-898f5780a2eb service cinder] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:11:19.037906 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dac812f-4c07-4013-a287-286c2899090d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:11:19.038671 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac812f-4c07-4013-a287-286c2899090d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:11:19.038957 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac812f-4c07-4013-a287-286c2899090d admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:11:19.039260 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac812f-4c07-4013-a287-286c2899090d admin admin] PATH_INFO: `/v3/users/6b2118079fbe4c0d8c647a5a1fa9f088` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:11:19.040409 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dac812f-4c07-4013-a287-286c2899090d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b2118079fbe4c0d8c647a5a1fa9f088)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:11:19.042425 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dac812f-4c07-4013-a287-286c2899090d admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:11:19.095663 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-2dac812f-4c07-4013-a287-286c2899090d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b2118079fbe4c0d8c647a5a1fa9f088'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:11:19.104511 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-2dac812f-4c07-4013-a287-286c2899090d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b2118079fbe4c0d8c647a5a1fa9f088'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:11:19.113207 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-2dac812f-4c07-4013-a287-286c2899090d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b2118079fbe4c0d8c647a5a1fa9f088'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:11:19.113935 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-2dac812f-4c07-4013-a287-286c2899090d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b2118079fbe4c0d8c647a5a1fa9f088'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:11:19.114553 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-2dac812f-4c07-4013-a287-286c2899090d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b2118079fbe4c0d8c647a5a1fa9f088'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:11:19.132450 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1419/2852] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 10 10:11:18 2022] DELETE /identity/v3/users/6b2118079fbe4c0d8c647a5a1fa9f088 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:11:19.137148 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b11dc6-844b-4228-9943-38c14cffc7e0 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:11:19.137656 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b11dc6-844b-4228-9943-38c14cffc7e0 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:11:19.137837 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b11dc6-844b-4228-9943-38c14cffc7e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:11:19.157035 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-05b11dc6-844b-4228-9943-38c14cffc7e0 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:11:19.158398 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-05b11dc6-844b-4228-9943-38c14cffc7e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:11:19.218781 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1434/2853] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:11:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 10:11:19.229092 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dac812f-4c07-4013-a287-286c2899090d admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:11:19.230611 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-2dac812f-4c07-4013-a287-286c2899090d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:11:19.290990 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dac812f-4c07-4013-a287-286c2899090d admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:11:19.294864 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8a2eee-bfde-43f3-905d-ccf93395a98f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4294c170df354fe892831281acd4ea7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:11:19.295469 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8a2eee-bfde-43f3-905d-ccf93395a98f service neutron] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:11:19.295748 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8a2eee-bfde-43f3-905d-ccf93395a98f service neutron] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:11:19.296017 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8a2eee-bfde-43f3-905d-ccf93395a98f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:11:19.305505 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8a2eee-bfde-43f3-905d-ccf93395a98f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:11:19.307057 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8a2eee-bfde-43f3-905d-ccf93395a98f service neutron] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:11:19.316877 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1420/2854] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:11:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:11:19.602559 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b11dc6-844b-4228-9943-38c14cffc7e0 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:11:19.604147 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-05b11dc6-844b-4228-9943-38c14cffc7e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:11:19.618454 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b11dc6-844b-4228-9943-38c14cffc7e0 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:11:19.624233 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4715fa8-62bb-4746-8fd1-1344d492aca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:11:19.624872 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4715fa8-62bb-4746-8fd1-1344d492aca5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:11:19.625168 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4715fa8-62bb-4746-8fd1-1344d492aca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:11:19.625441 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4715fa8-62bb-4746-8fd1-1344d492aca5 admin admin] PATH_INFO: `/v3/projects/afb2a38b6d1b4f25a73b34b19d436d1d` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:11:19.626701 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4715fa8-62bb-4746-8fd1-1344d492aca5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=afb2a38b6d1b4f25a73b34b19d436d1d)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:11:19.628626 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4715fa8-62bb-4746-8fd1-1344d492aca5 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:11:19.677019 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-a4715fa8-62bb-4746-8fd1-1344d492aca5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afb2a38b6d1b4f25a73b34b19d436d1d', 'request_id': 'req-a4715fa8-62bb-4746-8fd1-1344d492aca5'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:11:19.682997 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-a4715fa8-62bb-4746-8fd1-1344d492aca5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afb2a38b6d1b4f25a73b34b19d436d1d', 'request_id': 'req-a4715fa8-62bb-4746-8fd1-1344d492aca5'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:11:19.692322 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-a4715fa8-62bb-4746-8fd1-1344d492aca5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afb2a38b6d1b4f25a73b34b19d436d1d', 'request_id': 'req-a4715fa8-62bb-4746-8fd1-1344d492aca5'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:11:19.703799 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-a4715fa8-62bb-4746-8fd1-1344d492aca5 admin admin] The token cache is being invalidate because project afb2a38b6d1b4f25a73b34b19d436d1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 10:11:19.704091 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-a4715fa8-62bb-4746-8fd1-1344d492aca5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:11:19.704719 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-a4715fa8-62bb-4746-8fd1-1344d492aca5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:11:19.706267 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1435/2855] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 10 10:11:19 2022] DELETE /identity/v3/projects/afb2a38b6d1b4f25a73b34b19d436d1d => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:11:19.711318 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746ea719-5a16-4e5c-b1df-931c22c1141e None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:11:19.711602 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746ea719-5a16-4e5c-b1df-931c22c1141e None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:11:19.711872 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746ea719-5a16-4e5c-b1df-931c22c1141e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:11:19.731856 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-746ea719-5a16-4e5c-b1df-931c22c1141e None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:11:19.733087 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-746ea719-5a16-4e5c-b1df-931c22c1141e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:11:19.764100 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:11:19.793539 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1421/2856] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:11:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:11:19.801825 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e551d45-7517-4ee1-931c-1e584c447cfb None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:11:19.802185 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e551d45-7517-4ee1-931c-1e584c447cfb None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:11:19.802529 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e551d45-7517-4ee1-931c-1e584c447cfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:11:19.822990 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-4e551d45-7517-4ee1-931c-1e584c447cfb None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:11:19.824208 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-4e551d45-7517-4ee1-931c-1e584c447cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:11:19.835684 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1436/2857] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:11:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:11:19.840857 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746ea719-5a16-4e5c-b1df-931c22c1141e None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:11:19.853547 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746ea719-5a16-4e5c-b1df-931c22c1141e None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:11:19.859690 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bba4b90-9d14-43e9-aa83-9947dd79b066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:11:19.860304 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bba4b90-9d14-43e9-aa83-9947dd79b066 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:11:19.860585 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bba4b90-9d14-43e9-aa83-9947dd79b066 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:11:19.860885 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bba4b90-9d14-43e9-aa83-9947dd79b066 admin admin] PATH_INFO: `/v3/domains` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:11:19.861583 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bba4b90-9d14-43e9-aa83-9947dd79b066 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80232) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 10:11:19.861888 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bba4b90-9d14-43e9-aa83-9947dd79b066 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:11:19.863703 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bba4b90-9d14-43e9-aa83-9947dd79b066 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:11:19.876913 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1422/2858] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Aug 10 10:11:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 10:11:19.881768 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e551d45-7517-4ee1-931c-1e584c447cfb None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:11:19.893506 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e551d45-7517-4ee1-931c-1e584c447cfb None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:11:19.899337 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae46173e-4fea-4b0b-bc5a-2d5253894bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:11:19.899956 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae46173e-4fea-4b0b-bc5a-2d5253894bcf admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:11:19.900235 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae46173e-4fea-4b0b-bc5a-2d5253894bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:11:19.900508 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae46173e-4fea-4b0b-bc5a-2d5253894bcf admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:11:19.901169 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae46173e-4fea-4b0b-bc5a-2d5253894bcf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:11:19.903088 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae46173e-4fea-4b0b-bc5a-2d5253894bcf admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:11:19.934209 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1437/2859] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Aug 10 10:11:19 2022] POST /identity/v3/projects => generated 363 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:11:19.938540 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bba4b90-9d14-43e9-aa83-9947dd79b066 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:11:19.949115 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bba4b90-9d14-43e9-aa83-9947dd79b066 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:11:20.026716 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdfb64d-ce36-4e57-93bf-6e7ef8c71451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:11:20.028222 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdfb64d-ce36-4e57-93bf-6e7ef8c71451 admin admin] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:11:20.028611 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdfb64d-ce36-4e57-93bf-6e7ef8c71451 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:11:20.028946 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdfb64d-ce36-4e57-93bf-6e7ef8c71451 admin admin] PATH_INFO: `/v3/users` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:11:20.030034 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdfb64d-ce36-4e57-93bf-6e7ef8c71451 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:11:20.032392 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdfb64d-ce36-4e57-93bf-6e7ef8c71451 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:11:20.058713 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1423/2860] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Aug 10 10:11:19 2022] POST /identity/v3/users => generated 282 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 10:11:20.062680 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae46173e-4fea-4b0b-bc5a-2d5253894bcf admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:11:20.077223 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae46173e-4fea-4b0b-bc5a-2d5253894bcf admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:11:20.081216 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e14927f-650b-4889-840a-0c98621223ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:11:20.082045 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e14927f-650b-4889-840a-0c98621223ff admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:11:20.082319 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e14927f-650b-4889-840a-0c98621223ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:11:20.082593 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e14927f-650b-4889-840a-0c98621223ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:11:20.083246 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e14927f-650b-4889-840a-0c98621223ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:11:20.084879 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e14927f-650b-4889-840a-0c98621223ff admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:11:20.097128 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1438/2861] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:11:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:11:20.100637 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdfb64d-ce36-4e57-93bf-6e7ef8c71451 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:11:20.111331 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdfb64d-ce36-4e57-93bf-6e7ef8c71451 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:11:20.116013 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72228e9-6aed-434d-a4ee-fce55be5d371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:11:20.116646 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72228e9-6aed-434d-a4ee-fce55be5d371 admin admin] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:11:20.116920 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72228e9-6aed-434d-a4ee-fce55be5d371 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:11:20.117241 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72228e9-6aed-434d-a4ee-fce55be5d371 admin admin] PATH_INFO: `/v3/roles` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:11:20.117886 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72228e9-6aed-434d-a4ee-fce55be5d371 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:11:20.119498 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72228e9-6aed-434d-a4ee-fce55be5d371 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:11:20.130713 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1424/2862] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Aug 10 10:11:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 10:11:20.134928 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e14927f-650b-4889-840a-0c98621223ff admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:11:20.141846 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:11:20.147883 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e14927f-650b-4889-840a-0c98621223ff admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:11:20.156952 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c376cc3f-212d-4fd3-9fe5-ab17fd8835aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:11:20.158068 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c376cc3f-212d-4fd3-9fe5-ab17fd8835aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:11:20.158715 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c376cc3f-212d-4fd3-9fe5-ab17fd8835aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:11:20.159248 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c376cc3f-212d-4fd3-9fe5-ab17fd8835aa admin admin] PATH_INFO: `/v3/projects/4b1fd969c3454cb9b47b153817e01afe/users/932f9f67743540bf81f25a0c660826e3/roles/8daabcb6b7394e39b06a3453e33e32db` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:11:20.176248 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c376cc3f-212d-4fd3-9fe5-ab17fd8835aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b1fd969c3454cb9b47b153817e01afe, user_id=932f9f67743540bf81f25a0c660826e3, role_id=8daabcb6b7394e39b06a3453e33e32db)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:11:20.179680 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c376cc3f-212d-4fd3-9fe5-ab17fd8835aa admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:11:20.196585 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1439/2863] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Aug 10 10:11:20 2022] PUT /identity/v3/projects/4b1fd969c3454cb9b47b153817e01afe/users/932f9f67743540bf81f25a0c660826e3/roles/8daabcb6b7394e39b06a3453e33e32db => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 10:11:20.207071 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6949b11c-1e63-44bd-8ae3-2de37d9b6b61 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:11:20.207388 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6949b11c-1e63-44bd-8ae3-2de37d9b6b61 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:11:20.208213 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6949b11c-1e63-44bd-8ae3-2de37d9b6b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:11:20.238151 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-6949b11c-1e63-44bd-8ae3-2de37d9b6b61 None None] MFA Rules not processed for user `932f9f67743540bf81f25a0c660826e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:11:20.239580 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-6949b11c-1e63-44bd-8ae3-2de37d9b6b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:11:20.305842 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1425/2864] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:11:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:11:20.317596 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c376cc3f-212d-4fd3-9fe5-ab17fd8835aa admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:11:20.319380 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-c376cc3f-212d-4fd3-9fe5-ab17fd8835aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:11:20.385626 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c376cc3f-212d-4fd3-9fe5-ab17fd8835aa admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:11:20.389738 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bc8d61-6daf-42a0-be36-aceed50a01b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf8e725cbe0403d943b136235eac057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:11:20.390366 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bc8d61-6daf-42a0-be36-aceed50a01b7 service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:11:20.390648 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bc8d61-6daf-42a0-be36-aceed50a01b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:11:20.390926 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bc8d61-6daf-42a0-be36-aceed50a01b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:11:20.401949 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bc8d61-6daf-42a0-be36-aceed50a01b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:11:20.403744 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bc8d61-6daf-42a0-be36-aceed50a01b7 service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:11:20.417553 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1440/2865] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:11:20 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:11:30.302684 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=83,keystone:INSERT=3 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:11:30.410472 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=35,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:11:51.209661 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3853724-664c-4c58-880e-0933cc953c57 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:11:51.210625 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3853724-664c-4c58-880e-0933cc953c57 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:11:51.210625 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3853724-664c-4c58-880e-0933cc953c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:11:51.236569 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-c3853724-664c-4c58-880e-0933cc953c57 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:11:51.238102 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-c3853724-664c-4c58-880e-0933cc953c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:11:51.303773 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1426/2866] 10.222.0.40 () {58 vars in 1016 bytes} [Wed Aug 10 10:11:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:11:51.361592 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bc8d61-6daf-42a0-be36-aceed50a01b7 service cinder] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:11:51.363942 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-e8bc8d61-6daf-42a0-be36-aceed50a01b7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:11:51.471160 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bc8d61-6daf-42a0-be36-aceed50a01b7 service cinder] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:11:51.477866 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1da7d9-b341-483a-8017-31d7e56b797f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd8580888cba41a88566da4540b1130c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:11:51.478470 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1da7d9-b341-483a-8017-31d7e56b797f service nova] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:11:51.478752 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1da7d9-b341-483a-8017-31d7e56b797f service nova] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:11:51.479047 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1da7d9-b341-483a-8017-31d7e56b797f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:11:51.487604 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1da7d9-b341-483a-8017-31d7e56b797f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:11:51.489212 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1da7d9-b341-483a-8017-31d7e56b797f service nova] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:11:51.498685 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1441/2867] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:11:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:11:55.188198 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79c7900-4e15-4e1f-b0dd-f9c8054ce11e None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:11:55.188821 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79c7900-4e15-4e1f-b0dd-f9c8054ce11e None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:11:55.188821 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79c7900-4e15-4e1f-b0dd-f9c8054ce11e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:11:55.208933 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-d79c7900-4e15-4e1f-b0dd-f9c8054ce11e None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:11:55.210238 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-d79c7900-4e15-4e1f-b0dd-f9c8054ce11e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:11:55.219348 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1427/2868] 10.222.0.40 () {58 vars in 1016 bytes} [Wed Aug 10 10:11:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:11:55.241594 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1da7d9-b341-483a-8017-31d7e56b797f service nova] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:11:55.243198 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-fb1da7d9-b341-483a-8017-31d7e56b797f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:11:55.258762 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1da7d9-b341-483a-8017-31d7e56b797f service nova] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:11:55.265724 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a8e8a8-b2de-4aa6-bf33-f0e496df1947 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd8580888cba41a88566da4540b1130c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:11:55.266325 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a8e8a8-b2de-4aa6-bf33-f0e496df1947 service nova] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:11:55.266600 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a8e8a8-b2de-4aa6-bf33-f0e496df1947 service nova] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:11:55.266871 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a8e8a8-b2de-4aa6-bf33-f0e496df1947 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:11:55.275757 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a8e8a8-b2de-4aa6-bf33-f0e496df1947 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:11:55.277362 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a8e8a8-b2de-4aa6-bf33-f0e496df1947 service nova] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:11:55.286953 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1442/2869] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:11:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:11:56.866229 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79c7900-4e15-4e1f-b0dd-f9c8054ce11e None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:11:56.877508 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79c7900-4e15-4e1f-b0dd-f9c8054ce11e None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:11:56.884197 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee593883-48c7-4aa7-8d2a-75e506139368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:11:56.884983 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee593883-48c7-4aa7-8d2a-75e506139368 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:11:56.885423 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee593883-48c7-4aa7-8d2a-75e506139368 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:11:56.885697 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee593883-48c7-4aa7-8d2a-75e506139368 admin admin] PATH_INFO: `/v3/users/932f9f67743540bf81f25a0c660826e3` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:11:56.887036 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee593883-48c7-4aa7-8d2a-75e506139368 admin admin] RBAC: Authorizing `identity:delete_user(user_id=932f9f67743540bf81f25a0c660826e3)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:11:56.889688 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee593883-48c7-4aa7-8d2a-75e506139368 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:11:56.942510 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-ee593883-48c7-4aa7-8d2a-75e506139368 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '932f9f67743540bf81f25a0c660826e3'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:11:56.949188 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-ee593883-48c7-4aa7-8d2a-75e506139368 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '932f9f67743540bf81f25a0c660826e3'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:11:56.957451 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-ee593883-48c7-4aa7-8d2a-75e506139368 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '932f9f67743540bf81f25a0c660826e3'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:11:56.958402 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-ee593883-48c7-4aa7-8d2a-75e506139368 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '932f9f67743540bf81f25a0c660826e3'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:11:56.959101 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-ee593883-48c7-4aa7-8d2a-75e506139368 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '932f9f67743540bf81f25a0c660826e3'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:11:56.976992 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1428/2870] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 10 10:11:56 2022] DELETE /identity/v3/users/932f9f67743540bf81f25a0c660826e3 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:11:56.981774 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd67c34-b4b5-4e67-a2c1-2d089c3c9316 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:11:56.982302 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd67c34-b4b5-4e67-a2c1-2d089c3c9316 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:11:56.982302 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd67c34-b4b5-4e67-a2c1-2d089c3c9316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:11:57.002727 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-dcd67c34-b4b5-4e67-a2c1-2d089c3c9316 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:11:57.003941 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-dcd67c34-b4b5-4e67-a2c1-2d089c3c9316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:11:57.063933 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1443/2871] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:11:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:11:57.075800 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee593883-48c7-4aa7-8d2a-75e506139368 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:11:57.077481 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-ee593883-48c7-4aa7-8d2a-75e506139368 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:11:57.156929 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:11:57.162181 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee593883-48c7-4aa7-8d2a-75e506139368 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:11:57.166990 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672a90bb-5d63-4c7a-bd8d-f66967dbbcc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4294c170df354fe892831281acd4ea7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:11:57.167605 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a90bb-5d63-4c7a-bd8d-f66967dbbcc9 service neutron] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:11:57.168068 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a90bb-5d63-4c7a-bd8d-f66967dbbcc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:11:57.168382 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a90bb-5d63-4c7a-bd8d-f66967dbbcc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:11:57.178005 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672a90bb-5d63-4c7a-bd8d-f66967dbbcc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:11:57.179456 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672a90bb-5d63-4c7a-bd8d-f66967dbbcc9 service neutron] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:11:57.189397 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1429/2872] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:11:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:11:57.471186 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd67c34-b4b5-4e67-a2c1-2d089c3c9316 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:11:57.472613 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-dcd67c34-b4b5-4e67-a2c1-2d089c3c9316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:11:57.485365 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd67c34-b4b5-4e67-a2c1-2d089c3c9316 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:11:57.490752 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a41799-df2a-49c8-8cdb-449ad3109d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:11:57.491398 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a41799-df2a-49c8-8cdb-449ad3109d07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:11:57.491675 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a41799-df2a-49c8-8cdb-449ad3109d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:11:57.491944 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a41799-df2a-49c8-8cdb-449ad3109d07 admin admin] PATH_INFO: `/v3/projects/4b1fd969c3454cb9b47b153817e01afe` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:11:57.493249 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a41799-df2a-49c8-8cdb-449ad3109d07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b1fd969c3454cb9b47b153817e01afe)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:11:57.495217 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a41799-df2a-49c8-8cdb-449ad3109d07 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:11:57.543091 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:11:57.544785 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-68a41799-df2a-49c8-8cdb-449ad3109d07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b1fd969c3454cb9b47b153817e01afe', 'request_id': 'req-68a41799-df2a-49c8-8cdb-449ad3109d07'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:11:57.552195 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-68a41799-df2a-49c8-8cdb-449ad3109d07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b1fd969c3454cb9b47b153817e01afe', 'request_id': 'req-68a41799-df2a-49c8-8cdb-449ad3109d07'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:11:57.560154 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-68a41799-df2a-49c8-8cdb-449ad3109d07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b1fd969c3454cb9b47b153817e01afe', 'request_id': 'req-68a41799-df2a-49c8-8cdb-449ad3109d07'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:11:57.571108 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-68a41799-df2a-49c8-8cdb-449ad3109d07 admin admin] The token cache is being invalidate because project 4b1fd969c3454cb9b47b153817e01afe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 10:11:57.571398 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-68a41799-df2a-49c8-8cdb-449ad3109d07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:11:57.572034 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-68a41799-df2a-49c8-8cdb-449ad3109d07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:11:57.573724 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1444/2873] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 10 10:11:57 2022] DELETE /identity/v3/projects/4b1fd969c3454cb9b47b153817e01afe => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:11:58.453916 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bc7bd9-81db-4e7e-b44e-2f03a47bb5c6 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:11:58.454503 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bc7bd9-81db-4e7e-b44e-2f03a47bb5c6 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:11:58.454503 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bc7bd9-81db-4e7e-b44e-2f03a47bb5c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:11:58.475000 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-f5bc7bd9-81db-4e7e-b44e-2f03a47bb5c6 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:11:58.476226 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-f5bc7bd9-81db-4e7e-b44e-2f03a47bb5c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:11:58.536518 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1430/2874] 10.222.0.40 () {58 vars in 1016 bytes} [Wed Aug 10 10:11:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:11:58.587865 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a41799-df2a-49c8-8cdb-449ad3109d07 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:11:58.590453 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-68a41799-df2a-49c8-8cdb-449ad3109d07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:11:58.668577 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a41799-df2a-49c8-8cdb-449ad3109d07 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:11:58.676064 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09988cc-ffb8-4660-9987-8392e9ce53fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd8580888cba41a88566da4540b1130c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:11:58.676683 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09988cc-ffb8-4660-9987-8392e9ce53fa service nova] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:11:58.676958 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09988cc-ffb8-4660-9987-8392e9ce53fa service nova] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:11:58.677257 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09988cc-ffb8-4660-9987-8392e9ce53fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:11:58.686541 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09988cc-ffb8-4660-9987-8392e9ce53fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:11:58.688133 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09988cc-ffb8-4660-9987-8392e9ce53fa service nova] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:11:58.697700 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1445/2875] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:11:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:12:01.578832 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89cc46d-607c-4d2a-ae68-9c5cd3295426 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:12:01.579869 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89cc46d-607c-4d2a-ae68-9c5cd3295426 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:12:01.579869 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89cc46d-607c-4d2a-ae68-9c5cd3295426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:12:01.605241 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-d89cc46d-607c-4d2a-ae68-9c5cd3295426 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:12:01.606445 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-d89cc46d-607c-4d2a-ae68-9c5cd3295426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:12:01.615747 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1431/2876] 10.222.0.40 () {58 vars in 1016 bytes} [Wed Aug 10 10:12:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:12:01.655604 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09988cc-ffb8-4660-9987-8392e9ce53fa service nova] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:12:01.657275 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-b09988cc-ffb8-4660-9987-8392e9ce53fa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:12:01.673310 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09988cc-ffb8-4660-9987-8392e9ce53fa service nova] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:12:01.680667 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead17c3c-7d9f-4fd9-a527-bbacee38db94 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd8580888cba41a88566da4540b1130c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:12:01.681141 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead17c3c-7d9f-4fd9-a527-bbacee38db94 service nova] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:12:01.681421 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead17c3c-7d9f-4fd9-a527-bbacee38db94 service nova] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:12:01.681693 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead17c3c-7d9f-4fd9-a527-bbacee38db94 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:12:01.690899 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead17c3c-7d9f-4fd9-a527-bbacee38db94 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:12:01.692475 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead17c3c-7d9f-4fd9-a527-bbacee38db94 service nova] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:12:01.702092 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1446/2877] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:12:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:12:04.754515 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1edc9f-e04f-4ea2-a6db-c06526088471 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:12:04.755308 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1edc9f-e04f-4ea2-a6db-c06526088471 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:12:04.755507 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1edc9f-e04f-4ea2-a6db-c06526088471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:12:04.787488 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-0b1edc9f-e04f-4ea2-a6db-c06526088471 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:12:04.788722 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-0b1edc9f-e04f-4ea2-a6db-c06526088471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:12:04.799138 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1432/2878] 10.222.0.40 () {58 vars in 1016 bytes} [Wed Aug 10 10:12:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:12:04.851624 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead17c3c-7d9f-4fd9-a527-bbacee38db94 service nova] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:12:04.866973 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead17c3c-7d9f-4fd9-a527-bbacee38db94 service nova] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:12:04.874202 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d29f069-883c-4f3b-a286-cadca065f7b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd8580888cba41a88566da4540b1130c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:12:04.874801 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d29f069-883c-4f3b-a286-cadca065f7b4 service nova] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:12:04.875079 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d29f069-883c-4f3b-a286-cadca065f7b4 service nova] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:12:04.875350 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d29f069-883c-4f3b-a286-cadca065f7b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:12:04.884298 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d29f069-883c-4f3b-a286-cadca065f7b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:12:04.886084 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d29f069-883c-4f3b-a286-cadca065f7b4 service nova] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:12:04.896048 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1447/2879] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:12:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:12:07.922266 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d276974d-7809-417b-b4f4-8e1b595a9489 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:12:07.922860 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d276974d-7809-417b-b4f4-8e1b595a9489 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:12:07.922860 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d276974d-7809-417b-b4f4-8e1b595a9489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:12:07.942350 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-d276974d-7809-417b-b4f4-8e1b595a9489 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:12:07.943545 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-d276974d-7809-417b-b4f4-8e1b595a9489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:12:07.951488 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1433/2880] 10.222.0.40 () {58 vars in 1016 bytes} [Wed Aug 10 10:12:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:12:08.005233 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d29f069-883c-4f3b-a286-cadca065f7b4 service nova] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:12:08.022697 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d29f069-883c-4f3b-a286-cadca065f7b4 service nova] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:12:08.029825 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3202da7e-f11b-4f79-a3d5-322619bd6cb2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd8580888cba41a88566da4540b1130c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:12:08.030426 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3202da7e-f11b-4f79-a3d5-322619bd6cb2 service nova] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:12:08.030708 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3202da7e-f11b-4f79-a3d5-322619bd6cb2 service nova] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:12:08.030975 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3202da7e-f11b-4f79-a3d5-322619bd6cb2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:12:08.039803 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3202da7e-f11b-4f79-a3d5-322619bd6cb2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:12:08.041415 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3202da7e-f11b-4f79-a3d5-322619bd6cb2 service nova] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:12:08.051325 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1448/2881] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:12:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:12:17.937881 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=41 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:12:18.047069 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=59,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:12:18.711545 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d276974d-7809-417b-b4f4-8e1b595a9489 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:12:18.713272 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-d276974d-7809-417b-b4f4-8e1b595a9489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:12:18.815717 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d276974d-7809-417b-b4f4-8e1b595a9489 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:12:18.821041 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35f0436-4fab-4f4b-ab16-dd465eca571f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6b658f1e27b4dfb96de71dc6a7e9496', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:12:18.821876 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35f0436-4fab-4f4b-ab16-dd465eca571f service placement] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:12:18.822222 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35f0436-4fab-4f4b-ab16-dd465eca571f service placement] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:12:18.822564 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35f0436-4fab-4f4b-ab16-dd465eca571f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:12:18.824548 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-e35f0436-4fab-4f4b-ab16-dd465eca571f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:12:18.839624 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35f0436-4fab-4f4b-ab16-dd465eca571f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:12:18.841256 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35f0436-4fab-4f4b-ab16-dd465eca571f service placement] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:12:18.852104 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1434/2882] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:12:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:12:23.495697 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee83fc-cb43-44de-a826-40fdacb64673 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:12:23.496283 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee83fc-cb43-44de-a826-40fdacb64673 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:12:23.496283 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee83fc-cb43-44de-a826-40fdacb64673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:12:23.528741 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-4cee83fc-cb43-44de-a826-40fdacb64673 None None] MFA Rules not processed for user `1448e6ea4df54e2ca99a318b1dc7e9f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:12:23.530382 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-4cee83fc-cb43-44de-a826-40fdacb64673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:12:23.592040 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1449/2883] 10.222.0.27 () {58 vars in 958 bytes} [Wed Aug 10 10:12:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:12:27.304221 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35f0436-4fab-4f4b-ab16-dd465eca571f service placement] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:12:27.306070 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-e35f0436-4fab-4f4b-ab16-dd465eca571f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:12:27.370374 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35f0436-4fab-4f4b-ab16-dd465eca571f service placement] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:12:27.374096 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21ef0aa-8a9d-4539-8cc1-20646ef56d6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4294c170df354fe892831281acd4ea7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:12:27.374724 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21ef0aa-8a9d-4539-8cc1-20646ef56d6c service neutron] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:12:27.374999 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21ef0aa-8a9d-4539-8cc1-20646ef56d6c service neutron] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:12:27.375267 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21ef0aa-8a9d-4539-8cc1-20646ef56d6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:12:27.377038 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-e21ef0aa-8a9d-4539-8cc1-20646ef56d6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:12:27.387532 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21ef0aa-8a9d-4539-8cc1-20646ef56d6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:12:27.388984 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21ef0aa-8a9d-4539-8cc1-20646ef56d6c service neutron] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:12:27.399421 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1435/2884] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:12:27 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:12:27.522442 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cee83fc-cb43-44de-a826-40fdacb64673 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:12:27.523968 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-4cee83fc-cb43-44de-a826-40fdacb64673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:12:27.538565 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cee83fc-cb43-44de-a826-40fdacb64673 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:12:27.543440 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73efe76f-826e-44bd-9faa-ef5227233a74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4294c170df354fe892831281acd4ea7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:12:27.544324 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73efe76f-826e-44bd-9faa-ef5227233a74 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:12:27.544829 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73efe76f-826e-44bd-9faa-ef5227233a74 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:12:27.545701 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73efe76f-826e-44bd-9faa-ef5227233a74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:12:27.547907 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-73efe76f-826e-44bd-9faa-ef5227233a74 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:12:27.565160 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73efe76f-826e-44bd-9faa-ef5227233a74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:12:27.568339 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73efe76f-826e-44bd-9faa-ef5227233a74 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:12:27.581162 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1450/2885] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:12:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:12:37.394473 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=67 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:12:37.576225 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=31 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:12:39.710475 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b0e08c-50b2-4b2d-ba3d-fced1e0a8b8b None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:12:39.711043 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b0e08c-50b2-4b2d-ba3d-fced1e0a8b8b None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:12:39.711043 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b0e08c-50b2-4b2d-ba3d-fced1e0a8b8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:12:39.732253 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-44b0e08c-50b2-4b2d-ba3d-fced1e0a8b8b None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:12:39.733507 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-44b0e08c-50b2-4b2d-ba3d-fced1e0a8b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:12:39.743651 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1436/2886] 10.222.0.40 () {58 vars in 1016 bytes} [Wed Aug 10 10:12:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:12:39.766402 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73efe76f-826e-44bd-9faa-ef5227233a74 service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:12:39.778502 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73efe76f-826e-44bd-9faa-ef5227233a74 service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:12:39.784560 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175fc37a-6f9d-473f-b927-e8faf3de6adc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd8580888cba41a88566da4540b1130c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:12:39.785218 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175fc37a-6f9d-473f-b927-e8faf3de6adc service nova] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:12:39.785481 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175fc37a-6f9d-473f-b927-e8faf3de6adc service nova] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:12:39.785755 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175fc37a-6f9d-473f-b927-e8faf3de6adc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:12:39.794608 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175fc37a-6f9d-473f-b927-e8faf3de6adc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:12:39.796497 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175fc37a-6f9d-473f-b927-e8faf3de6adc service nova] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:12:39.806450 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1451/2887] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:12:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:12:43.031367 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51df204-d864-4eab-b0fd-b2de66d3d921 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:12:43.032220 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51df204-d864-4eab-b0fd-b2de66d3d921 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:12:43.032220 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51df204-d864-4eab-b0fd-b2de66d3d921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:12:43.061316 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-c51df204-d864-4eab-b0fd-b2de66d3d921 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:12:43.062523 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-c51df204-d864-4eab-b0fd-b2de66d3d921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:12:43.071526 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1437/2888] 10.222.0.40 () {58 vars in 1016 bytes} [Wed Aug 10 10:12:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:12:43.114279 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175fc37a-6f9d-473f-b927-e8faf3de6adc service nova] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:12:43.125938 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175fc37a-6f9d-473f-b927-e8faf3de6adc service nova] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:12:43.133017 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3255f84c-238e-4898-bf83-9a0c9dfaa62e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd8580888cba41a88566da4540b1130c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:12:43.133641 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255f84c-238e-4898-bf83-9a0c9dfaa62e service nova] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:12:43.133916 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255f84c-238e-4898-bf83-9a0c9dfaa62e service nova] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:12:43.134287 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255f84c-238e-4898-bf83-9a0c9dfaa62e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:12:43.143075 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3255f84c-238e-4898-bf83-9a0c9dfaa62e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:12:43.144697 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3255f84c-238e-4898-bf83-9a0c9dfaa62e service nova] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:12:43.154430 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1452/2889] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:12:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:12:46.143120 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a393d6ec-2d20-497c-965f-c1bae542d340 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:12:46.143969 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a393d6ec-2d20-497c-965f-c1bae542d340 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:12:46.144151 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a393d6ec-2d20-497c-965f-c1bae542d340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:12:46.168235 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-a393d6ec-2d20-497c-965f-c1bae542d340 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:12:46.169492 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-a393d6ec-2d20-497c-965f-c1bae542d340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:12:46.179298 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1438/2890] 10.222.0.40 () {58 vars in 1016 bytes} [Wed Aug 10 10:12:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:12:46.206211 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3255f84c-238e-4898-bf83-9a0c9dfaa62e service nova] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:12:46.218592 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3255f84c-238e-4898-bf83-9a0c9dfaa62e service nova] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:12:46.226471 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8cf569-f29b-46ca-a311-b2f1795aa56d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd8580888cba41a88566da4540b1130c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:12:46.227069 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8cf569-f29b-46ca-a311-b2f1795aa56d service nova] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:12:46.227350 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8cf569-f29b-46ca-a311-b2f1795aa56d service nova] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:12:46.227605 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8cf569-f29b-46ca-a311-b2f1795aa56d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:12:46.236599 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8cf569-f29b-46ca-a311-b2f1795aa56d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:12:46.238218 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8cf569-f29b-46ca-a311-b2f1795aa56d service nova] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:12:46.248092 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1453/2891] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:12:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:12:49.281265 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b094d02-bec1-41cd-87ae-50c61da43b59 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:12:49.281790 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b094d02-bec1-41cd-87ae-50c61da43b59 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:12:49.281790 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b094d02-bec1-41cd-87ae-50c61da43b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:12:49.302859 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-5b094d02-bec1-41cd-87ae-50c61da43b59 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:12:49.304056 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-5b094d02-bec1-41cd-87ae-50c61da43b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:12:49.312596 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1439/2892] 10.222.0.40 () {58 vars in 1016 bytes} [Wed Aug 10 10:12:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 10:12:49.341466 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8cf569-f29b-46ca-a311-b2f1795aa56d service nova] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:12:49.353334 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8cf569-f29b-46ca-a311-b2f1795aa56d service nova] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:12:49.360385 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936d746d-4d9a-4656-a0cd-1255126a7e0d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd8580888cba41a88566da4540b1130c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:12:49.361001 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936d746d-4d9a-4656-a0cd-1255126a7e0d service nova] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:12:49.361312 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936d746d-4d9a-4656-a0cd-1255126a7e0d service nova] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:12:49.361586 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936d746d-4d9a-4656-a0cd-1255126a7e0d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:12:49.370015 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936d746d-4d9a-4656-a0cd-1255126a7e0d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:12:49.371614 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936d746d-4d9a-4656-a0cd-1255126a7e0d service nova] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:12:49.381234 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1454/2893] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:12:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:12:52.462795 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61d4ac6-e9de-4458-80bd-f2a5908bf0b7 None None] REQUEST_METHOD: `POST` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:12:52.463548 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61d4ac6-e9de-4458-80bd-f2a5908bf0b7 None None] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:12:52.463548 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61d4ac6-e9de-4458-80bd-f2a5908bf0b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:12:52.489535 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.auth.core [None req-a61d4ac6-e9de-4458-80bd-f2a5908bf0b7 None None] MFA Rules not processed for user `68006355826841798d09dd7cab67ec78`. Rule list: `[]` (Enabled: `True`). {{(pid=80232) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 10:12:52.490732 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-a61d4ac6-e9de-4458-80bd-f2a5908bf0b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:12:52.499882 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1440/2894] 10.222.0.40 () {58 vars in 1016 bytes} [Wed Aug 10 10:12:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 10:12:52.523337 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936d746d-4d9a-4656-a0cd-1255126a7e0d service nova] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:12:52.537403 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936d746d-4d9a-4656-a0cd-1255126a7e0d service nova] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:12:52.543885 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7c35f7-0127-4898-a119-7f002479b3de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd8580888cba41a88566da4540b1130c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:12:52.544835 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c35f7-0127-4898-a119-7f002479b3de service nova] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:12:52.545162 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c35f7-0127-4898-a119-7f002479b3de service nova] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:12:52.545433 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c35f7-0127-4898-a119-7f002479b3de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:12:52.554104 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7c35f7-0127-4898-a119-7f002479b3de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:12:52.555678 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7c35f7-0127-4898-a119-7f002479b3de service nova] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:12:52.565516 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1455/2895] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:12:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:13:02.484240 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=15 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:13:02.561227 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=30 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:13:21.912058 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61d4ac6-e9de-4458-80bd-f2a5908bf0b7 None None] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:13:21.913569 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-a61d4ac6-e9de-4458-80bd-f2a5908bf0b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:13:21.926373 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61d4ac6-e9de-4458-80bd-f2a5908bf0b7 None None] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:13:21.931744 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2c83ab-5950-438b-90a3-bc90a86bcfcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:13:21.932392 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2c83ab-5950-438b-90a3-bc90a86bcfcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:13:21.932669 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2c83ab-5950-438b-90a3-bc90a86bcfcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:13:21.932937 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2c83ab-5950-438b-90a3-bc90a86bcfcc admin admin] PATH_INFO: `/v3/users/1448e6ea4df54e2ca99a318b1dc7e9f5` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:13:21.934161 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2c83ab-5950-438b-90a3-bc90a86bcfcc admin admin] RBAC: Authorizing `identity:delete_user(user_id=1448e6ea4df54e2ca99a318b1dc7e9f5)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:13:21.936090 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2c83ab-5950-438b-90a3-bc90a86bcfcc admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:13:21.984654 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-fa2c83ab-5950-438b-90a3-bc90a86bcfcc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1448e6ea4df54e2ca99a318b1dc7e9f5'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:13:21.991547 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-fa2c83ab-5950-438b-90a3-bc90a86bcfcc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1448e6ea4df54e2ca99a318b1dc7e9f5'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:13:22.000480 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-fa2c83ab-5950-438b-90a3-bc90a86bcfcc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1448e6ea4df54e2ca99a318b1dc7e9f5'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:13:22.001109 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-fa2c83ab-5950-438b-90a3-bc90a86bcfcc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1448e6ea4df54e2ca99a318b1dc7e9f5'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:13:22.001716 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-fa2c83ab-5950-438b-90a3-bc90a86bcfcc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1448e6ea4df54e2ca99a318b1dc7e9f5'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:13:22.018904 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1441/2896] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 10 10:13:21 2022] DELETE /identity/v3/users/1448e6ea4df54e2ca99a318b1dc7e9f5 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:13:22.217868 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7c35f7-0127-4898-a119-7f002479b3de service nova] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:13:22.227851 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7c35f7-0127-4898-a119-7f002479b3de service nova] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:13:22.286904 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5e0487-7dfe-4cfc-a23c-043a91e69ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:13:22.287541 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5e0487-7dfe-4cfc-a23c-043a91e69ca7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:13:22.287821 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5e0487-7dfe-4cfc-a23c-043a91e69ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:13:22.288095 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5e0487-7dfe-4cfc-a23c-043a91e69ca7 admin admin] PATH_INFO: `/v3/projects/2307d489afdd43e1b7f369414daa821b` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:13:22.289297 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5e0487-7dfe-4cfc-a23c-043a91e69ca7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2307d489afdd43e1b7f369414daa821b)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:13:22.291346 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5e0487-7dfe-4cfc-a23c-043a91e69ca7 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:13:22.338673 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-4b5e0487-7dfe-4cfc-a23c-043a91e69ca7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2307d489afdd43e1b7f369414daa821b', 'request_id': 'req-4b5e0487-7dfe-4cfc-a23c-043a91e69ca7'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:13:22.344215 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-4b5e0487-7dfe-4cfc-a23c-043a91e69ca7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2307d489afdd43e1b7f369414daa821b', 'request_id': 'req-4b5e0487-7dfe-4cfc-a23c-043a91e69ca7'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:13:22.352636 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-4b5e0487-7dfe-4cfc-a23c-043a91e69ca7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2307d489afdd43e1b7f369414daa821b', 'request_id': 'req-4b5e0487-7dfe-4cfc-a23c-043a91e69ca7'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:13:22.365338 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-4b5e0487-7dfe-4cfc-a23c-043a91e69ca7 admin admin] The token cache is being invalidate because project 2307d489afdd43e1b7f369414daa821b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 10:13:22.365624 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-4b5e0487-7dfe-4cfc-a23c-043a91e69ca7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:13:22.366301 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-4b5e0487-7dfe-4cfc-a23c-043a91e69ca7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:13:22.367866 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1456/2897] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 10 10:13:22 2022] DELETE /identity/v3/projects/2307d489afdd43e1b7f369414daa821b => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:13:32.015633 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:13:32.362485 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=51,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:13:57.708292 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2c83ab-5950-438b-90a3-bc90a86bcfcc admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:13:57.709828 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-fa2c83ab-5950-438b-90a3-bc90a86bcfcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:13:57.801089 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2c83ab-5950-438b-90a3-bc90a86bcfcc admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:13:57.881005 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c071a2-6f61-474b-bb43-23eb893341fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd8580888cba41a88566da4540b1130c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:13:57.881642 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c071a2-6f61-474b-bb43-23eb893341fd service nova] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:13:57.881917 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c071a2-6f61-474b-bb43-23eb893341fd service nova] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:13:57.882188 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c071a2-6f61-474b-bb43-23eb893341fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:13:57.883986 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-a5c071a2-6f61-474b-bb43-23eb893341fd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:13:57.889488 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5e0487-7dfe-4cfc-a23c-043a91e69ca7 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:13:57.890940 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-4b5e0487-7dfe-4cfc-a23c-043a91e69ca7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:13:57.900260 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c071a2-6f61-474b-bb43-23eb893341fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:13:57.901928 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c071a2-6f61-474b-bb43-23eb893341fd service nova] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:13:57.918558 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1442/2898] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:13:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:13:57.968899 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5e0487-7dfe-4cfc-a23c-043a91e69ca7 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:13:57.972533 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efe989e-a8d5-4386-8de6-ffdd09cce8bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4294c170df354fe892831281acd4ea7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:13:57.973162 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efe989e-a8d5-4386-8de6-ffdd09cce8bd service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:13:57.973441 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efe989e-a8d5-4386-8de6-ffdd09cce8bd service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:13:57.973706 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efe989e-a8d5-4386-8de6-ffdd09cce8bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:13:57.975445 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-9efe989e-a8d5-4386-8de6-ffdd09cce8bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:13:57.988890 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efe989e-a8d5-4386-8de6-ffdd09cce8bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:13:57.990453 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efe989e-a8d5-4386-8de6-ffdd09cce8bd service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:13:58.001614 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1457/2899] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:13:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 10:13:59.198977 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c071a2-6f61-474b-bb43-23eb893341fd service nova] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:13:59.210175 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c071a2-6f61-474b-bb43-23eb893341fd service nova] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:13:59.215258 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b04349-b0fb-41df-b2f4-7f37c0859ec4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4294c170df354fe892831281acd4ea7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:13:59.215856 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b04349-b0fb-41df-b2f4-7f37c0859ec4 service neutron] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:13:59.216135 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b04349-b0fb-41df-b2f4-7f37c0859ec4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:13:59.216405 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b04349-b0fb-41df-b2f4-7f37c0859ec4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:13:59.218822 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-a8b04349-b0fb-41df-b2f4-7f37c0859ec4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:13:59.235673 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b04349-b0fb-41df-b2f4-7f37c0859ec4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:13:59.237207 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b04349-b0fb-41df-b2f4-7f37c0859ec4 service neutron] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:13:59.248778 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1443/2900] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:13:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:13:59.252529 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efe989e-a8d5-4386-8de6-ffdd09cce8bd service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:13:59.254042 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-9efe989e-a8d5-4386-8de6-ffdd09cce8bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:13:59.264929 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efe989e-a8d5-4386-8de6-ffdd09cce8bd service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:13:59.268839 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd00bf6c-abe4-4d57-ac32-ec8aa26f5a49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4294c170df354fe892831281acd4ea7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:13:59.269464 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd00bf6c-abe4-4d57-ac32-ec8aa26f5a49 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:13:59.269741 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd00bf6c-abe4-4d57-ac32-ec8aa26f5a49 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:13:59.270008 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd00bf6c-abe4-4d57-ac32-ec8aa26f5a49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:13:59.271832 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-fd00bf6c-abe4-4d57-ac32-ec8aa26f5a49 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:13:59.281703 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd00bf6c-abe4-4d57-ac32-ec8aa26f5a49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:13:59.283164 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd00bf6c-abe4-4d57-ac32-ec8aa26f5a49 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:13:59.291020 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1458/2901] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:13:59 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:14:08.068747 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b04349-b0fb-41df-b2f4-7f37c0859ec4 service neutron] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:14:08.070968 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-a8b04349-b0fb-41df-b2f4-7f37c0859ec4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:14:08.139628 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b04349-b0fb-41df-b2f4-7f37c0859ec4 service neutron] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:14:08.144340 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fafb680-cbca-498b-ba50-7ca5d14692a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:14:08.145027 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fafb680-cbca-498b-ba50-7ca5d14692a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:14:08.145219 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fafb680-cbca-498b-ba50-7ca5d14692a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:14:08.145488 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fafb680-cbca-498b-ba50-7ca5d14692a9 admin admin] PATH_INFO: `/v3/users/4f32f9bf4a634282bda01c1e2b908186` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:14:08.146603 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fafb680-cbca-498b-ba50-7ca5d14692a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f32f9bf4a634282bda01c1e2b908186)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:14:08.148532 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fafb680-cbca-498b-ba50-7ca5d14692a9 admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:14:08.166298 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:14:08.204566 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-6fafb680-cbca-498b-ba50-7ca5d14692a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f32f9bf4a634282bda01c1e2b908186'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:14:08.211270 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-6fafb680-cbca-498b-ba50-7ca5d14692a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f32f9bf4a634282bda01c1e2b908186'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:14:08.219665 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-6fafb680-cbca-498b-ba50-7ca5d14692a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f32f9bf4a634282bda01c1e2b908186'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:14:08.220820 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-6fafb680-cbca-498b-ba50-7ca5d14692a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f32f9bf4a634282bda01c1e2b908186'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:14:08.221458 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-6fafb680-cbca-498b-ba50-7ca5d14692a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f32f9bf4a634282bda01c1e2b908186'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:14:08.238715 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1444/2902] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 10 10:14:08 2022] DELETE /identity/v3/users/4f32f9bf4a634282bda01c1e2b908186 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:14:08.418936 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd00bf6c-abe4-4d57-ac32-ec8aa26f5a49 service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:14:08.431699 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd00bf6c-abe4-4d57-ac32-ec8aa26f5a49 service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:14:08.489801 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b01dd1-bb05-453d-8852-f13f7cea2610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:14:08.490441 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b01dd1-bb05-453d-8852-f13f7cea2610 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:14:08.490719 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b01dd1-bb05-453d-8852-f13f7cea2610 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:14:08.490994 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b01dd1-bb05-453d-8852-f13f7cea2610 admin admin] PATH_INFO: `/v3/projects/7e2feae7dddd42e2bd76bfc949c7d3cb` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:14:08.492166 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b01dd1-bb05-453d-8852-f13f7cea2610 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e2feae7dddd42e2bd76bfc949c7d3cb)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:14:08.494118 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b01dd1-bb05-453d-8852-f13f7cea2610 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:14:08.547625 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-41b01dd1-bb05-453d-8852-f13f7cea2610 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e2feae7dddd42e2bd76bfc949c7d3cb', 'request_id': 'req-41b01dd1-bb05-453d-8852-f13f7cea2610'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:14:08.553881 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-41b01dd1-bb05-453d-8852-f13f7cea2610 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e2feae7dddd42e2bd76bfc949c7d3cb', 'request_id': 'req-41b01dd1-bb05-453d-8852-f13f7cea2610'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:14:08.562663 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-41b01dd1-bb05-453d-8852-f13f7cea2610 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e2feae7dddd42e2bd76bfc949c7d3cb', 'request_id': 'req-41b01dd1-bb05-453d-8852-f13f7cea2610'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:14:08.574114 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-41b01dd1-bb05-453d-8852-f13f7cea2610 admin admin] The token cache is being invalidate because project 7e2feae7dddd42e2bd76bfc949c7d3cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 10:14:08.574400 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-41b01dd1-bb05-453d-8852-f13f7cea2610 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:14:08.575156 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-41b01dd1-bb05-453d-8852-f13f7cea2610 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:14:08.576893 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1459/2903] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 10 10:14:08 2022] DELETE /identity/v3/projects/7e2feae7dddd42e2bd76bfc949c7d3cb => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:14:08.581399 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fafb680-cbca-498b-ba50-7ca5d14692a9 admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:14:08.582953 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-6fafb680-cbca-498b-ba50-7ca5d14692a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:14:08.597262 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fafb680-cbca-498b-ba50-7ca5d14692a9 admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:14:08.663397 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb09f35-4158-4875-9c94-d1b733c9860a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:14:08.664031 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb09f35-4158-4875-9c94-d1b733c9860a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:14:08.664311 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb09f35-4158-4875-9c94-d1b733c9860a admin admin] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:14:08.664576 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb09f35-4158-4875-9c94-d1b733c9860a admin admin] PATH_INFO: `/v3/users/994d1818878449b7a2bd290dc87256fd` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:14:08.665875 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb09f35-4158-4875-9c94-d1b733c9860a admin admin] RBAC: Authorizing `identity:delete_user(user_id=994d1818878449b7a2bd290dc87256fd)` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:14:08.668373 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb09f35-4158-4875-9c94-d1b733c9860a admin admin] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:14:08.720709 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-fbb09f35-4158-4875-9c94-d1b733c9860a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '994d1818878449b7a2bd290dc87256fd'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:14:08.727958 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-fbb09f35-4158-4875-9c94-d1b733c9860a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '994d1818878449b7a2bd290dc87256fd'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:14:08.736244 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-fbb09f35-4158-4875-9c94-d1b733c9860a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '994d1818878449b7a2bd290dc87256fd'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:14:08.737034 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-fbb09f35-4158-4875-9c94-d1b733c9860a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '994d1818878449b7a2bd290dc87256fd'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:14:08.737759 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.notifications [None req-fbb09f35-4158-4875-9c94-d1b733c9860a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '994d1818878449b7a2bd290dc87256fd'} {{(pid=80232) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:14:08.755059 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1445/2904] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Aug 10 10:14:08 2022] DELETE /identity/v3/users/994d1818878449b7a2bd290dc87256fd => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:14:08.946900 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b01dd1-bb05-453d-8852-f13f7cea2610 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:14:08.948340 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-41b01dd1-bb05-453d-8852-f13f7cea2610 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:14:08.967300 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b01dd1-bb05-453d-8852-f13f7cea2610 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:14:08.984426 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:14:09.025754 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a10311-2d2a-4830-801d-72ac0fd535c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68006355826841798d09dd7cab67ec78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16002ad64714b509607c7c129a68ed7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:14:09.026384 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a10311-2d2a-4830-801d-72ac0fd535c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:14:09.026661 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a10311-2d2a-4830-801d-72ac0fd535c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:14:09.026928 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a10311-2d2a-4830-801d-72ac0fd535c1 admin admin] PATH_INFO: `/v3/projects/6d8bda38e6d04d5c8decaf99e60dcf86` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:14:09.028099 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a10311-2d2a-4830-801d-72ac0fd535c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d8bda38e6d04d5c8decaf99e60dcf86)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:14:09.030083 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a10311-2d2a-4830-801d-72ac0fd535c1 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:14:09.079353 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-02a10311-2d2a-4830-801d-72ac0fd535c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d8bda38e6d04d5c8decaf99e60dcf86', 'request_id': 'req-02a10311-2d2a-4830-801d-72ac0fd535c1'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:14:09.084896 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-02a10311-2d2a-4830-801d-72ac0fd535c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d8bda38e6d04d5c8decaf99e60dcf86', 'request_id': 'req-02a10311-2d2a-4830-801d-72ac0fd535c1'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:14:09.094417 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-02a10311-2d2a-4830-801d-72ac0fd535c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d8bda38e6d04d5c8decaf99e60dcf86', 'request_id': 'req-02a10311-2d2a-4830-801d-72ac0fd535c1'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:14:09.106406 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-02a10311-2d2a-4830-801d-72ac0fd535c1 admin admin] The token cache is being invalidate because project 6d8bda38e6d04d5c8decaf99e60dcf86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 10:14:09.106693 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-02a10311-2d2a-4830-801d-72ac0fd535c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:14:09.107363 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-02a10311-2d2a-4830-801d-72ac0fd535c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 10:14:09.108877 dv-cinder-850836-5-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1460/2905] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Aug 10 10:14:08 2022] DELETE /identity/v3/projects/6d8bda38e6d04d5c8decaf99e60dcf86 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 10:14:18.751935 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=75,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:14:19.103159 dv-cinder-850836-5-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=42,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 10:17:26.504897 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb09f35-4158-4875-9c94-d1b733c9860a admin admin] Authenticating user token {{(pid=80232) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 10:17:26.506704 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-fbb09f35-4158-4875-9c94-d1b733c9860a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:17:26.598400 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb09f35-4158-4875-9c94-d1b733c9860a admin admin] Validating token access rules against request {{(pid=80232) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 10:17:26.661155 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338829a2-eec7-41f2-bfa6-620e40dd57ea service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6b658f1e27b4dfb96de71dc6a7e9496', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd47d5b72a00642a1a239b785110643ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80232) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 10:17:26.661767 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338829a2-eec7-41f2-bfa6-620e40dd57ea service placement] REQUEST_METHOD: `GET` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 10:17:26.662401 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338829a2-eec7-41f2-bfa6-620e40dd57ea service placement] SCRIPT_NAME: `/identity` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 10:17:26.662692 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338829a2-eec7-41f2-bfa6-620e40dd57ea service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80232) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 10:17:26.664719 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.fernet_utils [None req-338829a2-eec7-41f2-bfa6-620e40dd57ea service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80232) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 10:17:26.676691 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338829a2-eec7-41f2-bfa6-620e40dd57ea service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 10:17:26.678342 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338829a2-eec7-41f2-bfa6-620e40dd57ea service placement] RBAC: Authorization granted {{(pid=80232) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 10:17:26.689201 dv-cinder-850836-5-smb devstack@keystone.service[80232]: [pid: 80232|app: 0|req: 1446/2906] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Aug 10 10:17:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 10:17:36.685025 dv-cinder-850836-5-smb devstack@keystone.service[80232]: DEBUG dbcounter [-] [80232] Writing DB stats keystone:SELECT=58 {{(pid=80232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}